期刊
IEEE TRANSACTIONS ON MULTIMEDIA
卷 25, 期 -, 页码 4426-4438出版社
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TMM.2022.3175611
关键词
Image reconstruction; Anomaly detection; Location awareness; Image restoration; Training; Shape; Task analysis; anomaly localization; self-supervised learning; progressive mask refinement
In this research, a self-supervised learning approach named Self-Supervised Masking (SSM) is proposed for unsupervised anomaly detection and localization. It utilizes random masking and restoration of images for training, and introduces a progressive mask refinement method to improve the efficiency and effectiveness of anomaly detection and localization.
Recently, anomaly detection and localization in multimedia data have received significant attention among the machine learning community. In real-world applications such as medical diagnosis and industrial defect detection, anomalies only present in a fraction of the images. To extend the reconstruction-based anomaly detection architecture to the localized anomalies, we propose a self-supervised learning approach through random masking and then restoring, named Self-Supervised Masking (SSM) for unsupervised anomaly detection and localization. SSM not only enhances the training of the inpainting network but also leads to great improvement in the efficiency of mask prediction at inference. Through random masking, each image is augmented into a diverse set of training triplets, thus enabling the autoencoder to learn to reconstruct with masks of various sizes and shapes during training. To improve the efficiency and effectiveness of anomaly detection and localization at inference, we propose a novel progressive mask refinement approach that progressively uncovers the normal regions and finally locates the anomalous regions. The proposed SSM method outperforms several state-of-the-arts for both anomaly detection and anomaly localization, achieving 98.3% AUC on Retinal-OCT and 93.9% AUC on MVTec AD, respectively.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据