期刊
NEURAL COMPUTATION
卷 25, 期 5, 页码 1324-1370出版社
MIT PRESS
DOI: 10.1162/NECO_a_00442
关键词
-
资金
- JST PRESTO program
- MEXT KAKENHI [22700289]
- Aihara Project
- FIRST program from JSPS
- FIRST program
- SCAT
- AOARD
- CSTP
- [20700251]
- Grants-in-Aid for Scientific Research [22700289, 24500340] Funding Source: KAKEN
Divergence estimators based on direct approximation of density ratios without going through separate approximation of numerator and denominator densities have been successfully applied to machine learning tasks that involve distribution comparison such as outlier detection, transfer learning, and two-sample homogeneity test. However, since density-ratio functions often possess high fluctuation, divergence estimation is a challenging task in practice. In this letter, we use relative divergences for distribution comparison, which involves approximation of relative density ratios. Since relative density ratios are always smoother than corresponding ordinary density ratios, our proposed method is favorable in terms of nonparametric convergence speed. Furthermore, we show that the proposed divergence estimator has asymptotic variance independent of the model complexity under a parametric setup, implying that the proposed estimator hardly overfits even with complex models. Through experiments, we demonstrate the usefulness of the proposed approach.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据