4.7 Article

Extended Isolation Forest

Journal

IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING
Volume 33, Issue 4, Pages 1479-1489

Publisher

IEEE COMPUTER SOC
DOI: 10.1109/TKDE.2019.2947676

Keywords

Forestry; Vegetation; Distributed databases; Anomaly detection; Standards; Clustering algorithms; Heating systems; Anomaly detection; isolation forest

Funding

  1. NSF [AST 08-13543, AST 07-15036]

Ask authors/readers for more resources

The Extended Isolation Forest (EIF) proposes improvements to the Isolation Forest algorithm, addressing issues with assigning anomaly scores to data points. The paper explains the artifacts in anomaly score heat maps and suggests two different approaches for enhancement, with using hyperplanes with random slopes being the preferred method. The study shows that the algorithm's robustness is significantly improved using this method, without notable differences in convergence rate or computation time compared to the standard Isolation Forest.
We present an extension to the model-free anomaly detection algorithm, Isolation Forest. This extension, named Extended Isolation Forest (EIF), resolves issues with assignment of anomaly score to given data points. We motivate the problem using heat maps for anomaly scores. These maps suffer from artifacts generated by the criteria for branching operation of the binary tree. We explain this problem in detail and demonstrate the mechanism by which it occurs visually. We then propose two different approaches for improving the situation. First we propose transforming the data randomly before creation of each tree, which results in averaging out the bias. Second, which is the preferred way, is to allow the slicing of the data to use hyperplanes with random slopes. This approach results in remedying the artifact seen in the anomaly score heat maps. We show that the robustness of the algorithm is much improved using this method by looking at the variance of scores of data points distributed along constant level sets. We report AUROC and AUPRC for our synthetic datasets, along with real-world benchmark datasets. We find no appreciable difference in the rate of convergence nor in computation time between the standard Isolation Forest and EIF.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available