I have a high-frequency panel dataset on the order of $i=150$ and $t=5000$. I am interested in studying the causal impact of a treatment with the following characteristics:

  • The same unit can be treated several times
  • Different units can be treated at different times
  • The effect of the treatment does not spill over beyond the current time period

Here is an example of treatment over time (where black indicates treated, and the y axis contains a row for each unit $i$):

enter image description here

Here is an example of a treated unit (black) and a comparison unit (blue) when treatment is administered (red), where the $y$ axis is an outcome of interest:

enter image description here

Coming from the perspective of causal inference / program evaluation, it seems like the natural approach is to use some sort of difference-in-differences flavored model, where treated units act as controls for untreated units at different points in time. However, I am struggling to find an analogy in the literature.

  • Typically, in example diff-and-diff models I have seen, units are treated only once, control units are never treated, and the treatment persists into the future.
  • Also, with such a long time horizon autocorrelation seems problematic, and time-varying, individual-level seasonal fixed effects are likely necessary. Consequently, I expect that I need to make some modifications to the basic panel approach of including fixed effects for $i$ and $t$.

My question is:

  1. Have people used diff-in-diff analyses with similar datasets? If so, could you point me to some sample papers?
  2. Is there an alternative approach that would be be better suited to this setting? If so, are there relevant references? (e.g. from macro, finance, time series literature).

Thanks for any guidance you can provide.

  • $\begingroup$ I don't know this literature all that well but here are three papers that might help guide you in the right direction: (1) Inference with Difference-in-Differences and Other Panel Data (doi.org/10.1162/rest.89.2.221), (2) Inferring causal impact using Bayesian structural time-series models (ai.google/research/pubs/pub41854), (3) Semiparametric Estimates of Monetary Policy Effects: String Theory Revisited (doi.org/10.1080/07350015.2016.1204919) $\endgroup$ – Andrew M Jan 15 at 20:48
  • $\begingroup$ Thanks @AndrewM for the papers! I will investigate those further and answer my own question if I come up with a solution. @ caverac thanks also for the suggestion, I am working in the context of econ so I thought this community would be most relevant, but if I don't get an answer I will try to migrate to CS or Stats. $\endgroup$ – atkat12 Jan 15 at 21:06

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.