4.7 Article

NIM-Nets: Noise-Aware Incomplete Multi-View Learning Networks

Journal

IEEE TRANSACTIONS ON IMAGE PROCESSING
Volume 32, Issue -, Pages 175-189

Publisher

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TIP.2022.3226408

Keywords

Multi-view representation learning; view-missing patterns; robustness to noise; consistent and informative representation; unified model

Ask authors/readers for more resources

In this paper, the authors investigate three challenging problems in the field of incomplete multi-view representation learning and propose a novel framework called NIM-Nets to address these challenges. NIM-Nets can fully utilize incomplete data from different views to produce a consistent, informative, and robust multi-view shared representation. The authors also introduce definitions of robustness and completeness for incomplete multi-view representation learning.
Data in real world are usually characterized in multiple views, including different types of features or different modalities. Multi-view learning has been popular in the past decades and achieved significant improvements. In this paper, we investigate three challenging problems in the field of incomplete multi-view representation learning, namely, i) how to reduce the influences produced by missing views in multi-view dataset, ii) how to learn a consistent and informative representation among different views and iii) how to alleviate the impacts of the inherent noise in multi-view data caused by high-dimensional features or varied quality for different data points. To address these challenges, we integrate these three tasks into a problem and propose a novel framework termed Noise-aware Incomplete Multi-view Learning Networks (NIM-Nets). NIM-Nets fully utilize incomplete data from different views to produce a multi view shared representation which is consistent, informative and robust to noise. We model the inherent noise in data by defining the distribution F and assuming that each observation in the incomplete dataset is sampled from the distribution gamma. To the best of our knowledge, this is the first work to unify learning the consistent and informative representation, alleviating the impacts of noise in data and handling the view-missing patterns in multi view learning into a framework. We also first give a definition of robustness and completeness for incomplete multi-view representation learning. Based on NIM-Nets, we present joint optimization models for classification and clustering, respectively. Extensive experiments on different datasets demonstrate the effectiveness of our method over the existing work based on classification and clustering tasks in terms of different metrics.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available