期刊
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING
卷 35, 期 6, 页码 6014-6027出版社
IEEE COMPUTER SOC
DOI: 10.1109/TKDE.2022.3177368
关键词
Manifolds; Noise reduction; Manifold learning; Point cloud compression; Noise measurement; Eigenvalues and eigenfunctions; Clustering algorithms; Ant algorithm; Markov chain; multiple manifold detection; evolutionary computation
Dimensionality reduction and clustering are important preprocessing steps for machine learning tasks. However, the presence of noise and outliers can greatly affect their performance. In this study, we propose a novel method based on Ant colony optimization to extract manifolds from noisy data. Our technique captures points aligned with major directions of the manifold, and the use of ant pheromone further enhances this behavior. We demonstrate the algorithm's performance on synthetic and real datasets, including an N-body simulation.
Dimensionality reduction and clustering are often used as preliminary steps for many complex machine learning tasks. The presence of noise and outliers can deteriorate the performance of such preprocessing and therefore impair the subsequent analysis tremendously. In manifold learning, several studies indicate solutions for removing background noise or noise close to the structure when the density is substantially higher than that exhibited by the noise. However, in many applications, including astronomical datasets, the density varies alongside manifolds that are buried in a noisy background. We propose a novel method to extract manifolds in the presence of noise based on the idea of Ant colony optimization. In contrast to the existing random walk solutions, our technique captures points that are locally aligned with major directions of the manifold. Moreover, we empirically show that the biologically inspired formulation of ant pheromone reinforces this behavior enabling it to recover multiple manifolds embedded in extremely noisy data clouds. The algorithm performance in comparison to state-of-the-art approaches for noise reduction in manifold detection and clustering is demonstrated, on several synthetic and real datasets, including an N-body simulation of a cosmological volume.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据