4.4 Article

IMPROVED VARIABLE SELECTION WITH FORWARD-LASSO ADAPTIVE SHRINKAGE

期刊

ANNALS OF APPLIED STATISTICS
卷 5, 期 1, 页码 427-448

出版社

INST MATHEMATICAL STATISTICS
DOI: 10.1214/10-AOAS375

关键词

Forward Selection; Lasso; shrinkage; variable selection

资金

  1. NSF [DMS-07-05312, DMS-09-06784]
  2. Division Of Mathematical Sciences
  3. Direct For Mathematical & Physical Scien [0906784] Funding Source: National Science Foundation

向作者/读者索取更多资源

Recently, considerable interest has focused on variable selection methods in regression situations where the number of predictors, p, is large relative to the number of observations, n. Two commonly applied variable selection approaches are the Lasso, which computes highly shrunk regression coefficients, and Forward Selection, which uses no shrinkage. We propose a new approach, Forward-Lasso Adaptive SHrinkage (FLASH), which includes the Lasso and Forward Selection as special cases, and can be used in both the linear regression and the Generalized Linear Model domains. As with the Lasso and Forward Selection, FLASH iteratively adds one variable to the model in a hierarchical fashion but, unlike these methods, at each step adjusts the level of shrinkage so as to optimize the selection of the next variable. We first present FLASH in the linear regression setting and show that it can be fitted using a variant of the computationally efficient LARS algorithm. Then, we extend FLASH to the GLM domain and demonstrate, through numerous simulations and real world data sets, as well as some theoretical analysis, that FLASH generally outperforms many competing approaches.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.4
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

暂无数据
暂无数据