4.8 Article

Statistical learning and selective inference

Publisher

NATL ACAD SCIENCES
DOI: 10.1073/pnas.1507583112

Keywords

inference; P values; lasso

Funding

  1. National Science Foundation [DMS-9971405]
  2. National Institutes of Health [N01-HV-28183]
  3. Direct For Mathematical & Physical Scien
  4. Division Of Mathematical Sciences [1208857] Funding Source: National Science Foundation

Ask authors/readers for more resources

We describe the problem of selective inference. This addresses the following challenge: Having mined a set of data to find potential associations, how do we properly assess the strength of these associations? The fact that we have cherry-picked-searched for the strongest associations-means that we must set a higher bar for declaring significant the associations that we see. This challenge becomes more important in the era of big data and complex statistical modeling. The cherry tree (dataset) can be very large and the tools for cherry picking (statistical learning methods) are now very sophisticated. We describe some recent new developments in selective inference and illustrate their use in forward stepwise regression, the lasso, and principal components analysis.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.8
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available