Week 3, Session 5 — G-methods, IV, DiD, RDD; heterogeneity of treatment effect

Course 3 — #courses

R. Heller

Note

Workflow lab: Goal → Approach → Execution → Check → Report.

Learning objectives

  • Use inverse-probability weighting as a g-method for time-varying confounding.
  • Recognise the data-generating situations that justify an instrumental-variable (IV), difference-in-differences (DiD), or regression-discontinuity (RDD) design.
  • Estimate and interpret heterogeneity of treatment effect (HTE) with a subgroup-agnostic method.

Prerequisites

Propensity-score and IPTW basics (W3 S4).

Background

Traditional regression adjustment fails for time-varying confounders that are affected by prior treatment — adjusting for them blocks part of the treatment effect, failing to adjust leaves residual confounding. Robins’s g-methods solve this by reweighting or standardising in a way that respects the temporal order. IV methods exploit a variable that affects treatment but not outcome directly; DiD compares changes over time between groups sharing a counterfactual trend; RDD exploits a sharp assignment rule around a threshold.

Heterogeneity of treatment effect is the shift from “is the average effect non-zero?” to “for whom is it largest?” Model-based HTE uses causal forests, meta-learners (S-, T-, X-learner), or Bayesian hierarchical models to estimate conditional average treatment effects (CATEs) while controlling for multiple testing.

Setup

1. Goal

Simulate a time-varying-confounding scenario, estimate the causal effect naively and then with IPTW (a marginal structural model), and finish with brief conceptual sketches of other identification strategies.

2. Approach

The intervention contrast for a0, holding a1 fixed, is 1.25: its direct effect 1 plus the pathway through l1 (0.5 × 0.5). The intervention effect of a1 is 0.8. l1 is a time-varying confounder because it is affected by a0 and predicts both a1 and y.

3. Execution

Naive regression adjusting for l1 blocks part of the a0 effect.

# A tibble: 2 × 7
  term  estimate std.error statistic  p.value conf.low conf.high
  <chr>    <dbl>     <dbl>     <dbl>    <dbl>    <dbl>     <dbl>
1 a0       0.956    0.0459      20.8 1.91e-87    0.866     1.05 
2 a1       0.804    0.0450      17.9 2.55e-66    0.716     0.893

IPTW with stabilised weights:

# A tibble: 2 × 2
  term  estimate
  <chr>    <dbl>
1 a0       1.23 
2 a1       0.806

4. Check

Balance and weight sanity:

   Min. 1st Qu.  Median    Mean 3rd Qu.    Max. 
 0.5802  0.8982  0.9813  0.9997  1.0849  1.9544 

Inspect the weight distribution and covariate balance. Extreme weights can reflect limited overlap, model misspecification, or sampling variability. Only weighted point estimates are shown: ordinary weighted-least-squares standard errors do not account for this weighting procedure. For uncertainty, bootstrap whole subjects and refit both propensity models and the outcome model in every replicate, or use an appropriate estimating-equation method.

5. Report

In a simulated cohort with time-varying confounding (n = 2000), the adjusted conditional coefficient for initial treatment was 0.96, while the weighted marginal estimate was 1.23 (intervention target 1.25). The weighted estimate for later treatment was 0.81 (target 0.8). Instrumental variable, difference-in-differences, and regression-discontinuity designs exploit alternative identification strategies, each with its own assumptions. Heterogeneity of treatment effect can be explored with causal forests or meta-learners.

Brief sketches

  • IV: regress y on an instrument z to recover β = cov(y,z)/cov(a,z).
  • DiD: fit lm(y ~ time*group) on repeated measures.
  • RDD: fit local linear regression on each side of the assignment cutoff.

Common pitfalls

  • Using ordinary regression adjustment for time-varying confounders.
  • Trimming extreme weights silently, hiding model misspecification.
  • Reporting subgroup p-values without multiplicity control as HTE evidence.

Further reading

  • Hernán MA, Robins JM. Causal Inference: What If.
  • Athey S, Imbens GW. (2019). Machine Learning Methods That Economists Should Know About.

Session info

R version 4.6.1 (2026-06-24)
Platform: x86_64-pc-linux-gnu
Running under: Ubuntu 26.04.1 LTS

Matrix products: default
BLAS:   /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 
LAPACK: /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.32.so;  LAPACK version 3.12.0

locale:
 [1] LC_CTYPE=C.UTF-8       LC_NUMERIC=C           LC_TIME=C.UTF-8       
 [4] LC_COLLATE=C.UTF-8     LC_MONETARY=C.UTF-8    LC_MESSAGES=C.UTF-8   
 [7] LC_PAPER=C.UTF-8       LC_NAME=C              LC_ADDRESS=C          
[10] LC_TELEPHONE=C         LC_MEASUREMENT=C.UTF-8 LC_IDENTIFICATION=C   

time zone: UTC
tzcode source: system (glibc)

attached base packages:
[1] stats     graphics  grDevices datasets  utils     methods   base     

other attached packages:
 [1] broom_1.0.13    lubridate_1.9.5 forcats_1.0.1   stringr_1.6.0  
 [5] dplyr_1.2.1     purrr_1.2.2     readr_2.2.0     tidyr_1.3.2    
 [9] tibble_3.3.1    ggplot2_4.0.3   tidyverse_2.0.0

loaded via a namespace (and not attached):
 [1] gtable_0.3.6       jsonlite_2.0.0     compiler_4.6.1     renv_1.3.1        
 [5] tidyselect_1.2.1   scales_1.4.0       yaml_2.3.12        fastmap_1.2.0     
 [9] R6_2.6.1           generics_0.1.4     knitr_1.52         backports_1.5.1   
[13] pillar_1.11.1      RColorBrewer_1.1-3 tzdb_0.5.0         rlang_1.3.0       
[17] utf8_1.2.6         stringi_1.8.9      xfun_0.62          S7_0.2.2          
[21] otel_0.2.0         timechange_0.4.0   cli_3.6.6          withr_3.0.3       
[25] magrittr_2.0.5     digest_0.6.39      grid_4.6.1         hms_1.1.4         
[29] lifecycle_1.0.5    vctrs_0.7.3        evaluate_1.0.5     glue_1.8.1        
[33] farver_2.1.2       rmarkdown_2.32     tools_4.6.1        pkgconfig_2.0.3   
[37] htmltools_0.5.9