Journal
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY
Volume 62, Issue -, Pages 413-428Publisher
BLACKWELL PUBL LTD
DOI: 10.1111/1467-9868.00240
Keywords
generalized additive models; generalized cross-validation; generalized ridge regression; model selection; multiple smoothing parameters; non-linear modelling; penalized likelihood; penalized regression splines
Categories
Ask authors/readers for more resources
Penalized likelihood methods provide a range of practical modelling tools, including spline smoothing, generalized additive models and variants of ridge regression. Selecting the correct weights for penalties is a critical part of using these methods and in the single-penalty case the analyst has several well-founded techniques to choose from. However, many modelling problems suggest a formulation employing multiple penalties, and here general methodology is lacking. A wide family of models with multiple penalties can be fitted to data by iterative solution of the generalized ridge regression problem minimize parallel to W-1/2 (Xp - y)parallel to(2) rho + Sigma(i=1)(m)theta(i)p'S(i)p (p is a parameter vector, X a design matrix, S-i a non-negative definite coefficient matrix defining the ith penalty with associated smoothing parameter theta(i), W a diagonal weight matrix, y a vector of data or pseudodata and rho an 'overall' smoothing parameter included for computational efficiency). This paper shows how smoothing parameter selection can be performed efficiently by applying generalized cross-validation to this problem and how this allows non-linear, generalized linear and linear models to be fitted using multiple penalties, substantially increasing the scope of penalized modelling methods. Examples of non-linear modelling, generalized additive modelling and anisotropic smoothing are given.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available