期刊
IEEE TRANSACTIONS ON MULTIMEDIA
卷 17, 期 11, 页码 1887-1898出版社
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TMM.2015.2476655
关键词
Deep learning; large-margin feature learning; multi-modality; RGB-D object recognition
资金
- Singapore National Research Foundation under its International Research Centre@Singapore Funding Initiative
- Singapore Ministry of Education (MOE) [RG 138/14]
- MOE [ARC28/14]
- Singapore A*STAR Science and Engineering Research Council [PSF1321202099]
Most existing feature learning-based methods for RGB-D object recognition either combine RGB and depth data in an undifferentiated manner from the outset, or learn features from color and depth separately, which do not adequately exploit different characteristics of the two modalities or utilize the shared relationship between the modalities. In this paper, we propose a general CNN-based multi-modal learning framework for RGB-D object recognition. We first construct deep CNN layers for color and depth separately, which are then connected with a carefully designed multi-modal layer. This layer is designed to not only discover the most discriminative features for each modality, but is also able to harness the complementary relationship between the two modalities. The results of the multi-modal layer are back-propagated to update parameters of the CNN layers, and the multi-modal feature learning and the back-propagation are iteratively performed until convergence. Experimental results on two widely used RGB-D object datasets show that our method for general multi-modal learning achieves comparable performance to state-of-the-art methods specifically designed for RGB-D data.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据