4.4 Article

SPARSE ESTIMATION OF LARGE COVARIANCE MATRICES VIA A NESTED LASSO PENALTY

Journal

ANNALS OF APPLIED STATISTICS
Volume 2, Issue 1, Pages 245-263

Publisher

INST MATHEMATICAL STATISTICS
DOI: 10.1214/07-AOAS139

Keywords

Covariance matrix; high dimension low sample size; large p small n; Lasso; sparsity; Cholesky decomposition

Funding

  1. NSF [DMS-05-05424, DMS-05-05432, DMS-07-05532]
  2. NSA [MSPF-04Y-120]

Ask authors/readers for more resources

The paper proposes a new covariance estimator for large covariance matrices when the variables have if natural ordering. Using the Cholesky decomposition of the inverse, we impose if handed structure on the Cholesky factor, and select the bandwidth adaptively for each row of the Cholesky factor, using a novel penalty we call nested Lasso. This structure has more flexibility than regular banding, but, unlike regular Lasso applied to the entries of the Cholesky factor, results in a sparse estimator for the inverse of the covariance matrix. matrix. An iterative algorithm for solving the optimization problem is developed. The estimator is compared to a number of other covariance estimators and is shown to de best, both in simulations and on a real data example. Simulations show that the margin by which the estimator outperforms its competitors tends to increase with dimension.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.4
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available