Boosting high dimensional predictive regressions with time varying parameters

High dimensional predictive regressions are useful in wide range of applications. However, the theory is mainly developed assuming that the model is stationary with time invariant parameters. This is at odds with the prevalent evidence for parameter instability in economic time series, but theories for parameter instability are mainly developed for models with a small number of covariates. In this paper, we present two L-2 boosting algorithms for estimating high dimensional models in which the coefficients are modeled as functions evolving smoothly over time and the predictors are locally stationary. The first method uses componentwise local constant estimators as base learner, while the second relies on componentwise local linear estimators. We establish consistency of both methods, and address the practical issues of choosing the bandwidth for the base learners and the number of boosting iterations. In an extensive application to macroeconomic forecasting with many potential predictors, we find that the benefits to modeling time variation are substantial and they increase with the forecast horizon. Furthermore, the timing of the benefits suggests that the Great Moderation is associated with substantial instability in the conditional mean of various economic series. (C) 2020 Elsevier B.V. All rights reserved.

Automated summary

High dimensional predictive regressions are useful in a wide range of applications, but theories assuming stationary models with time invariant parameters may not align with evidence of parameter instability in economic time series. This paper introduces two L-2 boosting algorithms for estimating high dimensional models with smoothly evolving coefficients and locally stationary predictors. The study establishes the consistency of both methods and explores the benefits of modeling time variation in macroeconomic forecasting.