4.5 Article

Penalized Least Square in Sparse Setting with Convex Penalty and Non Gaussian Errors

Journal

ACTA MATHEMATICA SCIENTIA
Volume 41, Issue 6, Pages 2198-2216

Publisher

SPRINGER
DOI: 10.1007/s10473-021-0624-0

Keywords

penalized least squares; Gaussian errors; convex penalty

Categories

Funding

  1. French National Research Agency [EFI ANR-17-CE40-0030]

Ask authors/readers for more resources

This paper examines penalized least squares estimators with convex penalties or regularization norms, providing sparsity oracle inequalities for prediction errors in a general convex penalty context, as well as for specific cases like Lasso and Group Lasso estimators in regression. The main contribution is the establishment of oracle inequalities for scenarios where observation noise stems from probability measures with weak spectral gaps, as opposed to just Gaussian distributions. The results are demonstrated on heavy-tailed and sub-Gaussian examples, with explicit bounds given for these special cases.
This paper consider the penalized least squares estimators with convex penalties or regularization norms. We provide sparsity oracle inequalities for the prediction error for a general convex penalty and for the particular cases of Lasso and Group Lasso estimators in a regression setting. The main contribution is that our oracle inequalities are established for the more general case where the observations noise is issued from probability measures that satisfy a weak spectral gap (or Poincare) inequality instead of Gaussian distributions. We illustrate our results on a heavy tailed example and a sub Gaussian one; we especially give the explicit bounds of the oracle inequalities for these two special examples.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.5
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available