4.7 Article

Incorporating Unlabeled Data into Distributionally-Robust Learning

Journal

JOURNAL OF MACHINE LEARNING RESEARCH
Volume 22, Issue -, Pages 1-46

Publisher

MICROTOME PUBL

Keywords

Distributionally robust optimization; Wasserstein distance; optimal transport; supervised learning; active learning

Ask authors/readers for more resources

We studied the distributionally robust learning (DRL) method and proposed a solution to constrain the adversary by incorporating unlabeled data. The new formulation provides a computable guarantee on learning performance through stochastic gradient-based optimization.
We study a robust alternative to empirical risk minimization called distributionally robust learning (DRL), in which one learns to perform against an adversary who can choose the data distribution from a specified set of distributions. We illustrate a problem with current DRL formulations, which rely on an overly broad definition of allowed distributions for the adversary, leading to learned classifiers that are unable to predict with any confidence. We propose a solution that incorporates unlabeled data into the DRL problem to further constrain the adversary. We show that this new formulation is tractable for stochastic gradient-based optimization and yields a computable guarantee on the future performance of the learned classifier, analogous to-but tighter than-guarantees from conventional DRL. We examine the performance of this new formulation on 14 real data sets and find that it often yields effective classifiers with nontrivial performance guarantees in situations where conventional DRL produces neither. Inspired by these results, we extend our DRL formulation to active learning with a novel, distributionally-robust version of the standard model-change heuristic. Our active learning algorithm often achieves superior learning performance to the original heuristic on real data sets.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available