4.4 Article

An Ensemble EM Algorithm for Bayesian Variable Selection

Journal

BAYESIAN ANALYSIS
Volume 17, Issue 3, Pages 879-900

Publisher

INT SOC BAYESIAN ANALYSIS
DOI: 10.1214/21-BA1275

Keywords

Bayesian variable selection; EM; Bayesian bootstrap; asymptotic consistency

Ask authors/readers for more resources

In this study, we explore the Bayesian approach to variable selection in linear regression models. We propose an efficient EM algorithm that returns the MAP estimator of the relevant variables set. The algorithm avoids the need for inverting large matrices in each iteration, making it scalable for big data. Additionally, we introduce an ensemble EM algorithm to address the issue of local modes and achieve better variable selection results. Empirical studies have shown the superior performance of the ensemble EM algorithm.
We study the Bayesian approach to variable selection for linear re-gression models. Motivated by a recent work by Roc??kova?? and George (2014), we propose an EM algorithm that returns the MAP estimator of the set of relevant variables. Due to its particular updating scheme, our algorithm can be imple-mented efficiently without inverting a large matrix in each iteration and therefore can scale up with big data. We also have showed that the MAP estimator returned by our EM algorithm achieves variable selection consistency even when p diverges with n. In practice, our algorithm could get stuck with local modes, a common problem with EM algorithms. To address this issue, we propose an ensemble EM algorithm, in which we repeatedly apply our EM algorithm to a subset of the samples with a subset of the covariates, and then aggregate the variable selection results across those bootstrap replicates. Empirical studies have demonstrated the superior performance of the ensemble EM algorithm.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.4
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available