4.2 Article

A bias-variance analysis of state-of-the-art random forest text classifiers

Journal

ADVANCES IN DATA ANALYSIS AND CLASSIFICATION
Volume 15, Issue 2, Pages 379-405

Publisher

SPRINGER HEIDELBERG
DOI: 10.1007/s11634-020-00409-4

Keywords

Random forests; Text classification; Bias variance analysis

Funding

  1. CAPES
  2. CNPq
  3. Finep
  4. Fapemig
  5. MasWeb
  6. InWeb

Ask authors/readers for more resources

The study analyzed variants of random forest (RF) classifiers in the case of noisy data, exploring the bias-variance decomposition of error rate and showing significant improvements in variance and bias stability for lazy and boosted RF variants. The research provides promising directions for further enhancements in RF-based learners.
Random forest (RF) classifiers do excel in a variety of automatic classification tasks, such as topic categorization and sentiment analysis. Despite such advantages, RF models have been shown to perform poorly when facing noisy data, commonly found in textual data, for instance. Some RF variants have been proposed to provide better generalization capabilities under such challenging scenario, including lazy, boosted and randomized forests, all which exhibit significant reductions on error rate when compared to the traditional RFs. In this work, we analyze the behavior of such variants under the bias-variance decomposition of error rate. Such an analysis is of utmost importance to uncover the main causes of the observed improvements enjoyed by those variants in classification effectiveness. As we shall see, significant reductions in variance along with stability in bias explain a large portion of the improvements for the lazy and boosted RF variants. Such an analysis also sheds light on new promising directions for further enhancements in RF-based learners, such as the introduction of new randomization sources on both, lazy and boosted variants.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.2
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available