期刊
JOURNAL OF MACHINE LEARNING RESEARCH
卷 23, 期 -, 页码 -出版社
MICROTOME PUBL
关键词
regularization; semi-supervised learning; self-supervised learning; adversarial; robustness; few-shot classification
资金
- Spanish Ministry of Economy and Competitiveness (MINECO)
- European Regional Development Fund (ERDF) [PID2020-120311RB-I00, MCIN/AEI/10.13039/501100011033]
- Generalitat de Catalunya under the Industrial Doctorate Program [2020DI62]
Supervised training of neural networks requires a large amount of annotated data but is sensitive to out-of-distribution data. Self- and semi-supervised training can reduce the amount of labeled data required but out-of-distribution generalization remains a challenge. Embedding propagation, a method that promotes smoother decision boundaries, has shown improvements in out-of-distribution performance.
Supervised training of neural networks requires a large amount of manually annotated data and the resulting networks tend to be sensitive to out-of-distribution (OOD) data. Self-and semi-supervised training schemes reduce the amount of annotated data required during the training process. However, OOD generalization remains a major challenge for most methods. Strategies that promote smoother decision boundaries play an important role in out-of-distribution generalization. For example, embedding propagation (EP) for manifold smoothing has recently shown to considerably improve the OOD performance for few-shot classification. EP achieves smoother class manifolds by building a graph from sample embeddings and propagating information through the nodes in an unsupervised manner. In this work, we extend the original EP paper providing additional evidence and experiments showing that it attains smoother class embedding manifolds and improves results in settings beyond few-shot classification. Concretely, we show that EP improves the robustness of neural networks against multiple adversarial attacks as well as semi-and self-supervised learning performance.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据