Journal
MACHINE LEARNING
Volume 48, Issue 1-3, Pages 9-23Publisher
KLUWER ACADEMIC PUBL
DOI: 10.1023/A:1013943418833
Keywords
model selection; parametric regression; uniform convergence bounds
Categories
Ask authors/readers for more resources
Model selection is an important ingredient of many machine learning algorithms, in particular when the sample size in small, in order to strike the right trade-off between overfitting and underfitting. Previous classical results for linear regression are based on an asymptotic analysis. We present a new penalization method for performing model selection for regression that is appropriate even for small samples. Our penalization is based on an accurate estimator of the ratio of the expected training error and the expected generalization error, in terms of the expected eigenvalues of the input covariance matrix.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available