0
$\begingroup$

A well-received comment on this site stated:

Pundits might not understand inflation but macroeconomists actually understand inflation well nowadays

What models are currently used to forecast inflation, and what are their empirical accuracies?

$\endgroup$
2
  • 3
    $\begingroup$ ? This question seems to be off. Understanding =/= ability to forecast. For example, physics of weather is pretty well understood by physicists to the point that there is very little if anything to be learned about how weather operates. Yet forecasting what weather will be in future is quite a challenge. What even more, ability to forecast something provides no indication of understanding the subject matter. There are numerous variables that can be forecasted without understanding them. For example, most of the top line machine learning models used for short term forecasting $\endgroup$
    – 1muflon1
    Commented Mar 12, 2023 at 17:49
  • 2
    $\begingroup$ give excellent forecast without telling us how the forecasts were made and without having any structural parameters that would explain how things works. For example, an alien via statistical analysis might be able to forecast with 100% accuracy post-Christmas sale with 0 socio-economic understanding why the sale occurred or even why humans have sales at all. PS: you seem to link to some random user rather than to comment $\endgroup$
    – 1muflon1
    Commented Mar 12, 2023 at 17:53

1 Answer 1

1
$\begingroup$

Before providing answer, you should note forecasting is separate discipline from standard empirical economics. Even the word model has slightly different meaning in lets say theoretical economics, applied economics and forecasting where the latter uses purely statistical definition. As a result forecasting models are not a measure of our understanding of economic phenomena, and what even worse ability to forecast variable can be completely orthogonal on level of knowledge or actual 'deep' understanding of a variable (more on this in PS if you are interested).

What models are currently used to forecast inflation, and what are their empirical accuracies?

Since you are talking about forecasting there is extremely large number of models, since the way how modern 21st century forecasting is being done is that you on purpose construct multiplicity of models (even very similar ones) like for example multiple DSGE models, and then you aggregate forecasts. Since, it is beyond scope of stack exchange to cover every single model I will cover 4 big categories:

  • Machine learning (ML) models:

These are models that are currently quite a 'hit' with central bankers. Generally having quite small forecasting errors. For example, LASSO or Random Forest ML methods were shown to be able to achieve RSME/MAE relative to random walk (RW) benchmark of approximately 0.7 in some specification for price level (change of which gives you inflation) which is quite accurate (Medeiros et al, 2019).

  • Univariate time series models:

These include simple things such as AR models. This category somewhat overlaps with previous one as ML models can be based on some simple time series regression if you look deep enough under the hood, but in this category I include simply direct use of univariate time series models without.

These are not as accurate as ML models but still can have quite high accuracy Medeiros, 2019 report RSME/MAE relative to RW of around 0.8 for price level.

  • Multivariate time series models (VAR. BVAR etc):

These models are being used although sometimes they have problem beating random walk. However, depending on exact specification they can still do it (see Christoffel et al 2010).

  • Structural and mixed DSGE models

These are models based on some structural model of an economy. Mixed DSGE models can be showed to perform better than pure VAR Christoffel et al 2010, they typically don't work as well as ML models but they are used as they actually are able to provide us with some structural insight beside just providing in-sightless forecasts.

To sum it up, there are actually quite decent models for forecasting price level/deflator and thus by extension inflation, which are able to beat random walk (which is considered benchmark for success). However, again ability to forecast variable has nothing to do with understanding why something happens (people were able to forecast lunar cycle long before they had even rudimentary present day high school level understanding of astrophysics).


PS: Your question seems to be motivated about some comment about understanding inflation. You should note that forecasting accuracy can be completely orthogonal on our understanding of subject matter. That is we can have excellent understanding of a topic but poor forecasting ability (e.g. weather) or excellent forecasting ability but extremely poor understanding (e.g. random walk is often quite good forecasting model).

Hence it is impossible to judge someone's understanding of topic by forecasts. For example, even ancient humans could forecast rain quite accurately using frogs in jar yet ancient scientists had laughable understanding of climate or biology (e.g. Aristoteles believed that life is conceived when semen mixes with menstrual blood) or Ptolemy was able to forecast natural phenomena with excellent accuracy unmatched prior to modern era with his (in hindsight) preposterous model of solar system with epicycles.

If you are actually interested in knowing which models offer good understanding on the economy, you should ask which models fit best historical data, or which models yield causal predictions (as opposed to forecasts) or mechanics that can be matched to real life data, using some appropriate method (e.g. forecasting models generally can't even tell you what direction of causality is as opposed to lets say quasi experimental methods such as diff-in-diff or RDD that can tell you what causality exists but would be terrible forecasting models) not which models are best able to forecast future.

Forecasting models are made by construction in such a way that they often completely disregard our understanding of subject matter (e.g. some price forecasting models completely ignore endogeneity issue which is important for lets say understanding optimal pricing). In fact structural models that offer good understanding are at great disadvantage because if you have a structural model where x causes y, and you want to use such model for forecasting you need to forecast x first! Hence, with any reasonable structural model where something is causally explained by multiple variables you would have to pile forecasts upon forecasts to use it to forecast the variable of interest compounding forecasting errors (as forecasting errors for x will affect forecasts of y). This can quickly lead to models that are bad at forecasting even if they might be real life accurate (meaning real life causal relationships are accurately modeled).

$\endgroup$
8
  • $\begingroup$ Hi! Thank you for the model lists! I understand that e.g.; chaotic systems may be perfectly understood and yet they are difficult to forecast. Unfortunately I do not have access to the papers; 1. Medeiros seems to study solely the US; what is the time period? Does it contain periods with high inflation? $\endgroup$
    – Giskard
    Commented Mar 12, 2023 at 20:04
  • $\begingroup$ 2. Do you agree with the quoted statement that "macroeconomists actually understand inflation well nowadays"? If you have an opinion about these, can you please explain to me with what tests is this understanding measured/controlled? $\endgroup$
    – Giskard
    Commented Mar 12, 2023 at 20:06
  • 1
    $\begingroup$ @Giskard 1. sample period is 1990-2015 that does contain some periods of higher than average inflation. 2. Well that is difficult to answer, lets unpack that statement, what does 'understand inflation well' even mean? With simple QTM you can probably accurately describe 60% of monetary history of US and most other countries (by my guesstimate). Using modern IS-LM-PC state of the art model you can probably explain up to 70%, with some cutting edge theories like FTPL you can probably do 75%, yet there are definitely some periods of inflation that are difficult to explain with current models. $\endgroup$
    – 1muflon1
    Commented Mar 12, 2023 at 20:14
  • 1
    $\begingroup$ if you want to be completely cynical about it you could simply throw your hands in the air and say we don't understand anything as a result but I would consider that extremely cynical stance. Of course, saying we understand everything about inflation would extremely naive but we do understand quite a lot $\endgroup$
    – 1muflon1
    Commented Mar 12, 2023 at 20:28
  • 1
    $\begingroup$ @Giskard In that guesstimate I measure it as % of years where if you would run lets say long run cointegrated model you would not be able to reject hypothesis that in a model with $\ln p = \alpha \ln m+ \beta \ln v - \gamma \ln y$ that $\beta=\alpha = \gamma =1$ which is what QTM would predict. I will provide fuller answer to your question there $\endgroup$
    – 1muflon1
    Commented Mar 13, 2023 at 9:47

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.