期刊
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS
卷 52, 期 12, 页码 7561-7573出版社
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TSMC.2022.3161067
关键词
Manifolds; Data models; Clustering algorithms; Approximation algorithms; Semisupervised learning; Probabilistic logic; Computational modeling; Minimax probability machine (MPM); mixed-integer programming; semi-supervised learning (SSL)
资金
- National Key R&D Program of China [2019YFC1408703]
- National Natural Science Foundation of China [62022048]
This paper proposes a novel assumption and algorithm for semi-supervised learning, which complements the common low-density separation assumption and solves the transductive label assignment problem. Experimental results show that the proposed algorithm achieves competitive performance on multiple datasets and is almost one order of magnitude faster than existing SSL approaches.
We propose a novel semi-supervised learning (SSL) assumption--the high separation probability (HSP) assumption--that is complementary to the common low density separation (LDS) assumption, and a highly accurate and efficient SSL algorithm, the transductive minimax probability machine (TMPM). Under the HSP assumption, a preferred classifier should ensure that with high probability the samples are far away from the decision boundary. Similarly, the LDS assumption states that the decision boundary should lie in a low-density region. A remarkable property of HSP is that it provides an elegant theoretical framework for analyzing the generalization performance of SSL, while it remains difficult for the LDS assumption to have a quantitative criterion on how it fits the data. Moreover, it has the same paradigm as the minimax probability machine (MPM) and yields an intractable mixed-integer optimization for solving the transductive label assignment problem. Consequently, we propose TMPM with a label-switching strategy and iterative manner to formalize our approximate solution. Theoretically, we analyze the computational complexity, convergence property, and generalization error bound of TMPM. Empirically, we show that TMPM achieves competitive performance on a wide range of datasets, while being almost one order of magnitude faster than existing SSL approaches.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据