期刊
IEEE TRANSACTIONS ON CYBERNETICS
卷 51, 期 5, 页码 2676-2687出版社
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TCYB.2019.2921559
关键词
Training; Neural networks; Task analysis; Adaptation models; Probabilistic logic; Clustering methods; Predictive models; Deep feature learning; domain adaptation; latent domain discovery; probabilistic hierarchical clustering
类别
资金
- Natural Science Foundation of China [61673062]
A novel unified framework based on deep neural networks is proposed for domain adaptation, which aims to predict latent domains from source data and learn deep representations from both source and target data. The framework utilizes an iterative algorithm to separate the source domain into latent clusters and train deep neural networks using domain membership as supervision, achieving better performance in latent domain discovery and feature learning tasks. The key idea behind this joint learning framework is that good representations can enhance prediction accuracy of latent domains, while domain prediction results provide useful supervisory information for feature learning, leading to semantically meaningful features among different classes.
In domain adaptation, the automatic discovery of multiple latent source domains has succeeded by capturing the intrinsic structure underlying the source data. Different from previous works that mainly rely on shallow models for domain discovery, we propose a novel unified framework based on deep neural networks to jointly address latent domain prediction from source data and deep representation learning from both source and target data. Within this framework, an iterative algorithm is proposed to alternate between 1) utilizing a new probabilistic hierarchical clustering method to separate the source domain into latent clusters and 2) training deep neural networks by using the domain membership as the supervision to learn deep representations. The key idea behind this joint learning framework is that good representations can help to improve the prediction accuracy of latent domains and, in turn, domain prediction results can provide useful supervisory information for feature learning. During the training of the deep model, a domain prediction loss, a domain confusion loss, and a task-specific classification loss are effectively integrated to enable the learned feature to distinguish between different latent source domains, transfer between source and target domains, and become semantically meaningful among different classes. Trained in an end-to-end fashion, our framework outperforms the state-of-the-art methods for latent domain discovery, as validated by extensive experiments on both object classification and human action-recognition tasks.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据