Journal
STATISTICA SINICA
Volume 33, Issue 1, Pages 259-279Publisher
STATISTICA SINICA
DOI: 10.5705/ss.202020.0226
Keywords
Feature information; model selection; variable selection; prediction
Categories
Ask authors/readers for more resources
In some supervised learning settings, practitioners may have additional information on prediction features. Our proposed method, called the feature-weighted elastic net (fwelnet), uses this information to improve prediction by adjusting penalties on feature coefficients in the elastic net penalty. In simulations, fwelnet outperforms the lasso in terms of test mean squared error and often improves true positive or false positive rates for feature selection. Comparison with other methods reveals fwelnet's superiority, and its application to early prediction of preeclampsia shows improved performance compared to the lasso.
In some supervised learning settings, the practitioner might have additional information on the features used for prediction. We propose a new method that leverages this additional information for better prediction. The method, which we call the feature-weighted elastic net (fwelnet), uses these features of features to adapt the relative penalties on the feature coefficients in the elastic net penalty. In our simulations, fwelnet outperforms the lasso in terms of the test mean squared error, and usually gives an improvement in terms of the true positive rate or false positive rate for feature selection. We also compare this method with the group lasso and Bayesian estimation. Lastly, we apply the proposed method to the early prediction of preeclampsia, where fwelnet outperforms the lasso in terms of the 10fold cross-validated area under the curve (0.84 vs. 0.80, respectively), and suggest how fwelnet might be used for multi-task learning.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available