Journal
CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS
Volume 221, Issue -, Pages -Publisher
ELSEVIER
DOI: 10.1016/j.chemolab.2021.104487
Keywords
Ridge adding homotopy; LASSO; Sparse representation; Variable selection; Chemometrics
Categories
Funding
- National Natural Science Foundation of China [62071206]
- earmarked fund for the China Agriculture Research System
- University of Surrey
- Jiangsu University
Ask authors/readers for more resources
In this study, the RAH algorithm is combined with LASSO to fit the entire solution of the LASSO problem by tracking KKT conditions and selecting the optimal regularization parameter. The results demonstrate that RAH-LASSO + PLS outperforms other methods in terms of wavelength selection and calibration.
The least absolute shrinkage and selection operator (LASSO) is an established sparse representation approach for variable selection, and its performance relies on finding a good value for the regularization parameter, typically through cross-validation. However, cross-validation is a computationally intensive step and requires a properly determined search range and step size. In the present study, the ridge-adding homotopy (RAH) algorithm is applied with LASSO to overcome the aforementioned shortcomings. The homotopy algorithm can fit the entire solution of the LASSO problem by tracking the Karush-Kuhn Tucker (KKT) conditions and yields a finite number of potential regularization parameters. Considering the singularities, a M x 1 random ridge vector will be added to the KKT conditions, which ensures that only one element is added to or removed from the active set. Finally, we can select the optimal regularization parameter by traversing the potential parameters with modelling and evaluation metrics. The selected variables are the nonzero elements in the sparse regression coefficient vector derived by the optimal regularization parameter. The proposed method has been demonstrated on three nearinfrared (NIR) datasets with regard to wavelength selection and calibration. The results suggested that the RAH-LASSO + PLS outperforms LASSO + PLS and full-wavelength PLS in most cases. Importantly, the RAH method provides a systematic, as opposed to trial-and-error, procedure to determine the regularization parameter in LASSO.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available