4
$\begingroup$

According to Angrist & Pischke "Undergraduate econometrics instruction: Through our classes, darkly" (2017) Tables 2 and 3, econometrics textbooks deemphasized simultaneous equation models considerably from 1970s to 2010s. Their relative weight in terms of page count has shrunk about 4-5 times relative to other topics and they occupy very little space in modern syllabi. Edit: as 1muflon1 correctly notes, Angrist & Pischke (2017) provide evidence on undergraduate textbooks, not textbooks in general nor use of simultaneous equation models in academic or nonacademic research.

Are simultaneous equation models out of fashion (besides their coverage in undergraduate textbooks)?
If so, why did this happen?

  • Were these models found especially problematic?
  • Were alternative, more attractive models proposed to deal with the same research problems?
  • Were the research problems requiring structural equation models abandoned?
  • Did changes in data availability (size, dimensionality of samples) play a major role?
  • Did the increase in computational power play a major role?
  • Any other cause?
$\endgroup$
3
  • $\begingroup$ By the way I added soft-question tag because I think based on your edits that is also a fitting tag - hopefully it will bring also more attention to your Q $\endgroup$
    – 1muflon1
    Oct 28, 2020 at 13:36
  • 1
    $\begingroup$ @1muflon1, thanks! Also thanks for your excellent answer! $\endgroup$ Oct 28, 2020 at 13:46
  • $\begingroup$ Just glancing at Wikipedia real quick, have to say that this topic looks ancient. Like a bunch of estimation tricks to deal with a historical lack of computers. $\endgroup$
    – Nat
    Oct 28, 2020 at 18:44

1 Answer 1

5
$\begingroup$

I think this is already answered in the paper itself and in addition I think this is due to the way how they define 'simultaneous equations' topics.

First as authors of that paper opine:

This presumably reflects declining use of an orthodox multi-equation framework, especially in macroeconomics. The reduced coverage of Simultaneous equations has made space for modest attention to Panel data and Causal effects, but the biggest single expansion has been in the coverage of Functional form (mostly discrete choice and limited dependent variable models).

In addition I would add that macroeconomic modelling also shifted more towards not just panel data but also time series as macroeconomic data with lengthy $T$ dimension became more readily avaiable.

Second, note how they define simultaneous equation models (in table 1):

Simultaneous equations models - Discussion of multi-equation models and estimators, including identification of simultaneous equation systems and system estimators like seemingly unrelated regressions (SUR) and three-stage least squares (3SLS)

Third, note how they define time series [emphasis mine] (again from table 1):

Time series - Time series issues, including distributed lag models, stochastic processes, autoregressive integrated moving average (ARIMA) modeling, vector autoregressions, and unit root tests. This category omits narrow discussions of serial correlation as a violation of classical assumptions

Fourth, instrumental variables have their own category (again from table 1):

Instrumental variables (IV), two-stage least squares (2SLS), and other single equation IV-estimators like limited information maximium likelihood (LIML) and k-class estimators, the use of IV for omitted variables and errors-in-variables problems.

As far as I can see from skimming the paper it is not possible for a topic to be in two categories at once. So in addition to the switch toward panel and time series methods note that they do not seem to define simultaneous equations the same way as they are colloquially known in economics.

For example, I often hear at conferences people colloquially referring to VAR, VECM or 2SLS as a 'simultaneous equations' model, yet authors here created separate categories for them. Yet, these models would be not included in the simultaneous equation category, and we can see that the time series category and IV category expanded relatively to the simultaneous equations category (in comparison to 1970s - table 2 column 1 vs 3).

Lastly, many simultaneous equations approaches (as defined in the paper) like 3SLS, are usually considered advanced topics. The research you cite focuses on undergraduate texts. I don't think any econometrics teacher would go over 3SLS before going over 2SLS and a reasonable writer of undergraduate econometric textbook might want to make the textbook narrow and focused as opposed to forever expanding page count as new techniques emerge. Hence, I think that often topics like 3SLS simply won't make a cut compared to more basic techniques like IV when it comes to undergraduate textbooks.

Response to questions in edit:

  • Were these models found especially problematic?

I don't think these models are considered generally problematic. At least no more problematic than other strands of models having separate categories in the paper you cite that are used more. I was not also able to find some work that would consider simultaneous equations approach especially problematic (although absence of evidence might not be evidence of absence). I am a graduate student and I visit conferences where I see simultaneous equations being used (although as mentioned above colloquially the term is used far more broader than how the authors of the paper define it, and of course this is just anecdotal evidence - the lowest form of evidence there is).

  • Were alternative, more attractive models proposed to deal with the same research problems?

Yes, many panel data/time series techniques can be considered alternative to simultaneous equations approach. For example, fixed effects regression that can correct for time invariant omitted variable bias can be often considered more preferable to SUR.

Moreover, Angrist & Pischke in that paper subset all 'simple' simultaneous equation approaches such as 2SLS/IV in a separate category. Given that this research is about undergraduate texts I am not surprised that this kind of categorization yields this sort of result. 3SLS/Multiple eq. GMM would probably be considered too advanced for most undergraduate texts, and simple SUR is less used nowadays.

  • Were the research problems requiring structural equation models abandoned?

I am not aware of any such problems. As mentioned above you will see these models used in research, also typing just 3SLS Macroeconomics into google scholar with filter $year \geq 2020$ yields 262 results. Sure some of those will be just references but I would argue that this showcases that such models are still used.

  • Did changes in data availability (size, dimensionality of samples) play a major role?

I think yes. Currently you see a lot of research that could be done by simultaneous equations as defined by Angrist and Pischke by panel methods/time series methods. For full disclosure I am fairly young graduate student so I don't have first hand knowledge of this transition, but I see models such as SUR being applied more in past research than in present.

Also, more generally data availability always played role in modeling choices. Even at the present you can see people more and more often talking about 'panel time series' analysis rather than just panel analysis (e.g. see ch 10.6 in Verbeek (2008) Guide to modern econometrics). The idea that people are adopting more 'time-series-esque' models is also supported by the paper you cite which shows that the focus on time series increased over time

  • Did the increase in computational power play a major role?

It is possible, some of the newer techniques definitely have higher computational requirements but as I am fairly young scholar I don't have much insight into how limiting factor this was when deciding between models mentioned above and I did not managed to find any relevant discussion of it (maybe someone else will provide answer).

$\endgroup$
6
  • $\begingroup$ Thanks! So you would agree that alternative, more attractive models [were] proposed to deal with the same research problems, namely, VAR, VECM, panel data models? But you would disagree that (1) these models [were] found especially problematic (misspecification of a single equation rippling through the entire system being a prominent problem) AND (2) the research problems requiring structural equation models [were] abandoned? Would you say that the popularity of simultaneous equations has not fallen among practitioners (including academics) despite exclusion from undergraduate textbooks? $\endgroup$ Oct 28, 2020 at 10:32
  • $\begingroup$ @RichardHardy yes I would agree that VAR, VECM and panel data models are often considered more attractive. VAR & VECM and their later varieties (e.g. structural/bayesian VARs) are really ubiquitous in macroeconomics. Also, it is not that SUR or 3SLS would not be used at all but they use is quite diminished. In case of canonical SUR, panel models are often more enticing, and in the case of 3SLS I think this is purely because it is considered advanced topic $\endgroup$
    – 1muflon1
    Oct 28, 2020 at 10:46
  • 1
    $\begingroup$ This is an interesting discussion for me because I'm only familiar with econometrics in a very specific area. So, a lot of learning there for me. But possibly one of the people who may have caused the decrease in popularity of simultaneous equation models was Sims. He didn't buy into the whole issue of figuring out what is endogenous and what is exogenous. His view was : "Make everything endogenous". This probably made the VAR more popular and sim eq less popular. Another problem with sim eq is that its ( or atleast I find it ) very confusing. $\endgroup$
    – mark leeds
    Oct 28, 2020 at 12:59
  • $\begingroup$ @markleeds, thanks for your perspective. FYI: 1mulfon1 gets notified of your comment automatically, because it is posted under 1muflon1's own answer. Meanwhile, I did not get notified since you did not include [at]RichardHardy. (The system prevents me from using the [at] symbol here, but what I mean is the symbol followed by my name.) Unless it was intentional, please include me next time. Thanks! $\endgroup$ Oct 28, 2020 at 13:09
  • 1
    $\begingroup$ @RichardHardy tried to answer your additional questions $\endgroup$
    – 1muflon1
    Oct 28, 2020 at 13:28

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.