4.7 Article

Distributed High-dimensional Regression Under a Quantile Loss Function

期刊

出版社

MICROTOME PUBL

关键词

Distributed estimation; high-dimensional linear model; quantile loss; robust estimator; support recovery

资金

  1. NSF [IIS-1845444]
  2. National Program on Key Basic Research Project (973 Program) [2018AAA0100704]
  3. NSFC [11825104, 11690013]
  4. Youth Talent Support Program
  5. Australian Research Council
  6. Shanghai Sailing Program [19YF1402800]

向作者/读者索取更多资源

This paper studies distributed estimation and support recovery for high-dimensional linear regression model with heavy-tailed noise. To deal with heavy-tailed noise whose variance can be infinite, we adopt the quantile regression loss function instead of the commonly used squared loss. However, the non-smooth quantile loss poses new challenges to high-dimensional distributed estimation in both computation and theoretical development. To address the challenge, we transform the response variable and establish a new connection between quantile regression and ordinary linear regression. Then, we provide a distributed estimator that is both computationally and communicationally efficient, where only the gradient information is communicated at each iteration. Theoretically, we show that, after a constant number of iterations, the proposed estimator achieves a near-oracle convergence rate without any restriction on the number of machines. Moreover, we establish the theoretical guarantee for the support recovery. The simulation analysis is provided to demonstrate the effectiveness of our method.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.7
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

暂无数据
暂无数据