Journal
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION
Volume 103, Issue 482, Pages 681-686Publisher
AMER STATISTICAL ASSOC
DOI: 10.1198/016214508000000337
Keywords
empirical Bayes; Gibbs sampler; hierarchical model; inverse Gaussian; linear regression; penalized regression; scale mixture of normals
Categories
Ask authors/readers for more resources
The Lasso estimate for linear regression parameters can be interpreted as a Bayesian posterior mode estimate when the regression parameters have independent Laplace (i.e., double-exponential) priors. Gibbs sampling from this posterior is possible using an expanded hierarchy with conjugate normal priors for the regression parameters and independent exponential priors on their variances. A connection with the inverse-Gaussian distribution provides tractable full conditional distributions. The Bayesian Lasso provides interval estimates (Bayesian credible intervals) that can guide variable selection. Moreover, the structure of the hierarchical model provides both Bayesian and likelihood methods for selecting the Lasso parameter. Slight modifications lead to Bayesian versions of other Lasso-related estimation methods, including bridge regression and a robust variant.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available