期刊
INFORMATION SCIENCES
卷 587, 期 -, 页码 142-163出版社
ELSEVIER SCIENCE INC
DOI: 10.1016/j.ins.2021.12.042
关键词
Anomaly detection ensembles; Outlier detection ensembles; Item Response Theory; Unsupervised learning; Latent trait models
Ensemble learning combines multiple algorithms or models to improve predictive performance and is used in various fields. This study introduces the use of Item Response Theory (IRT), a model used in educational psychometrics, to construct an unsupervised anomaly detection ensemble. The effectiveness of the IRT ensemble is demonstrated and shown to outperform other ensemble techniques, even with low correlation values among the anomaly detection methods.
Ensemble learning combines many algorithms or models to obtain better predictive perfor-mance. Ensembles have produced the winning algorithm in competitions such as the Netflix Prize. They are used in climate modeling and relied upon to make daily forecasts. Constructing an ensemble from a heterogeneous set of unsupervised anomaly detection methods presents challenges because the class labels or the ground truth is unknown. Thus, traditional ensemble techniques that use the class labels cannot be used for this task. We use Item Response Theory (IRT) - a class of models used in educational psychomet-rics - to construct an unsupervised anomaly detection ensemble. IRT's latent trait compu-tation lends itself to anomaly detection because the latent trait can be used to uncover the hidden ground truth. Using a novel IRT mapping to the anomaly detection problem, we construct an ensemble that can downplay noisy, non-discriminatory methods and accentu-ate sharper methods. We demonstrate the effectiveness of the IRT ensemble using two real data repositories and show that it outperforms other ensemble techniques. We find that the IRT ensemble performs well even if the set of anomaly detection methods have low cor-relation values.(c) 2021 Elsevier Inc. All rights reserved.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据