RDP 2016-02: Disagreement about Inflation Expectations 7. Is Disagreement a Proxy for Forecast Uncertainty?

Despite conceptual differences, disagreement among forecasters is often used as a proxy for mean forecast uncertainty (Bloom 2014). In theory, an increase in disagreement can occur when there is no change in uncertainty – if at least some agents change their reported expectation, but all are no less sure about the likely outcome – but in practice forecaster disagreement co-moves with other measures of economic uncertainty (e.g. mentions of economic uncertainty in newspapers).

In this section, we investigate whether disagreement in inflation expectations is related to the magnitude of RBA inflation forecast errors. We assess predictability of the magnitude of RBA forecast errors, rather than the forecast errors in the mean expectation of each survey measure, because these forecasts are of most interest for the setting of monetary policy.

Figure 14 shows a scatterplot of absolute RBA year-ahead CPI inflation forecast errors against disagreement in CPI inflation expectations. For the Consensus Economics and RBA survey measures, there is some evidence that large forecast errors were preceded by a relatively high level of disagreement among survey respondents.

Figure 14: Disagreement and RBA Forecast Errors
1996:Q3 to 2013:Q4
Figure 14: Disagreement and RBA Forecast Errors

Note: Datum points are quarterly combinations of year-ahead absolute RBA forecast error and survey forecast disagreement lagged one quarter, which matches the RBA forecast error with the survey disagreement available at the time the RBA forecast was made

Sources: Authors' calculations; Consensus Economics; RBA; Workplace Research Centre

We formally test for a relationship between forecast disagreement and the magnitude of RBA CPI inflation forecast errors by estimating the following regression for each inflation survey measure:

where πt + h is CPI inflation over the period t to t + h, πt + h|t is the time t RBA forecast, and thus Inline Equation is the magnitude of the RBA's inflation forecast error. We use the standard deviation of year-ahead inflation forecasts for each survey measure i as our measure of disagreement: σt:t + 4. The absolute value of past forecast errors, Inline Equation, are included as a control variable.

Consistent with the graphical evidence, the estimated β parameters are positive for the Consensus Economics and RBA survey measures, suggesting some positive relationship between forecast disagreement and the magnitude of RBA forecast errors, but the relationship is not precisely estimated. There is no evidence of a relationship between disagreement and forecast errors for the union and consumer survey measures. Taken together, the regression results reported in Table 9 provide relatively weak evidence that forecast disagreement can be used to predict the magnitude of RBA inflation forecast errors.

Table 9: Relationship between Disagreement and Mean Expectations
RBA forecast error Consensus Economics RBA survey Unions Consumers
Four-quarters-ahead 0.326
(0.213)
0.154
(0.398)
−0.050
(0.134)
−0.067
(0.056)
Five-quarters-ahead 0.393*
(0.231)
0.626
(0.387)
−0.060
(0.118)
−0.117
(0.049)
Six-quarters-ahead 0.655
(0.412)
1.098
(0.453)
0.077
(0.109)
−0.150
(0.048)
Notes: Regressions include a constant term and two autoregressive terms, and are run for the full sample period that the survey data are available; ***, ** and * denote statistical significance at the 1, 5 and 10 per cent levels, respectively; Newey-West standard errors in parentheses