4.6 Article

Rotation forest based on multimodal genetic algorithm

Journal

JOURNAL OF CENTRAL SOUTH UNIVERSITY
Volume 28, Issue 6, Pages 1747-1764

Publisher

JOURNAL OF CENTRAL SOUTH UNIV
DOI: 10.1007/s11771-021-4730-x

Keywords

ensemble learning; decision tree; multimodal optimization; genetic algorithm

Ask authors/readers for more resources

Randomness is crucial in ensemble learning, and a common practice is to rotate feature space randomly. However, this requires a large number of trees and computing resources. The MGARF algorithm proposed in this paper utilizes multimodal genetic algorithm to select diverse and accurate base learners, outperforming random forest and random rotation methods on classification datasets.
In machine learning, randomness is a crucial factor in the success of ensemble learning, and it can be injected into tree-based ensembles by rotating the feature space. However, it is a common practice to rotate the feature space randomly. Thus, a large number of trees are required to ensure the performance of the ensemble model. This random rotation method is theoretically feasible, but it requires massive computing resources, potentially restricting its applications. A multimodal genetic algorithm based rotation forest (MGARF) algorithm is proposed in this paper to solve this problem. It is a tree-based ensemble learning algorithm for classification, taking advantage of the characteristic of trees to inject randomness by feature rotation. However, this algorithm attempts to select a subset of more diverse and accurate base learners using the multimodal optimization method. The classification accuracy of the proposed MGARF algorithm was evaluated by comparing it with the original random forest and random rotation ensemble methods on 23 UCI classification datasets. Experimental results show that the MGARF method outperforms the other methods, and the number of base learners in MGARF models is much fewer.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.6
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available