Journal
STATISTICA SINICA
Volume 31, Issue 4, Pages 2051-2072Publisher
STATISTICA SINICA
DOI: 10.5705/ss.202019.0133
Keywords
Collinearity; empirical Bayes; posterior convergence rate; stochastic search; variable selection
Categories
Funding
- U.S. National Science Foundation [1737933]
- Division Of Mathematical Sciences
- Direct For Mathematical & Physical Scien [1737933] Funding Source: National Science Foundation
Ask authors/readers for more resources
In the context of high-dimensional linear regression models, this study introduces a new approach to address multicollinearity issues, typically achieving optimal posterior estimation and demonstrating superior performance compared to existing methods on real and simulated data.
In the context of a high-dimensional linear regression model, we propose an empirical correlation-adaptive prior that uses information in the observed predictor variable matrix to adaptively address high collinearity. We use this prior to determine whether the parameters associated with the correlated predictors should be shrunk together or kept apart. Under certain conditions, we prove that our empirical Bayes posterior concentrates at the optimal rate. Therefore the benefits of correlation-adaptation in finite samples can be achieved without sacrificing asymptotic optimality. A version of the shotgun stochastic search algorithm is employed to compute the posterior and facilitate variable selection. Finally we demonstrate our method's favorable performance compared with that of existing methods using real and simulated data examples, even in ultrahigh-dimensional settings.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available