Journal
ANNALS OF STATISTICS
Volume 43, Issue 4, Pages 1774-1800Publisher
INST MATHEMATICAL STATISTICS
DOI: 10.1214/15-AOS1324
Keywords
Adaptation; convex polyhedral cones; global risk bounds; local minimax bounds; model misspecification; statistical dimension
Categories
Funding
- NSF [DMS-13-09356, DMS-11-50435, AST-1107373]
- Division Of Mathematical Sciences
- Direct For Mathematical & Physical Scien [1309356, 1150435] Funding Source: National Science Foundation
Ask authors/readers for more resources
We consider the problem of estimating an unknown theta is an element of R-n from noisy observations under the constraint that theta belongs to certain convex polyhedral cones in R-n. Under this setting, we prove bounds for the risk of the least squares estimator (LSE). The obtained risk bound behaves differently depending on the true sequence theta which highlights the adaptive behavior of theta. As special cases of our general result, we derive risk bounds for the LSE in univariate isotonic and convex regression. We study the risk bound in isotonic regression in greater detail: we show that the isotonic LSE converges at a whole range of rates from log n/n (when theta is constant) to n(-2/3) (when is uniformly increasing in a certain sense). We argue that the bound presents a benchmark for the risk of any estimator in isotonic regression by proving nonasymptotic local minimax lower bounds. We prove an analogue of our bound for model misspecification where the true theta is not necessarily nondecreasing.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available