Journal
WILEY INTERDISCIPLINARY REVIEWS-DATA MINING AND KNOWLEDGE DISCOVERY
Volume 6, Issue 1, Pages 5-21Publisher
WILEY PERIODICALS, INC
DOI: 10.1002/widm.1173
Keywords
-
Funding
- National Research Project by FEDER funds of the European Union [TIN2014-57251-P, TIN2012-37954, TIN2013-47210-P]
- Andalusian Research Plan by FEDER funds of the European Union [P10-TIC-6858, P11-TIC-7765, P12-TIC-2958]
- Xunta de Galicia by FEDER funds of the European Union [GRC 2014/035]
- Spanish Ministry of Education and Science [FPU13/00047]
- Xunta de Galicia [POS-A/2013/196, ED481B 2014/164-0]
Ask authors/readers for more resources
Discretization of numerical data is one of the most influential data preprocessing tasks in knowledge discovery and data mining. The purpose of attribute discretization is to find concise data representations as categories which are adequate for the learning task retaining as much information in the original continuous attribute as possible. In this article, we present an updated overview of discretization techniques in conjunction with a complete taxonomy of the leading discretizers. Despite the great impact of discretization as data preprocessing technique, few elementary approaches have been developed in the literature for Big Data. The purpose of this article is twofold: a comprehensive taxonomy of discretization techniques to help the practitioners in the use of the algorithms is presented; the article aims is to demonstrate that standard discretization methods can be parallelized in Big Data platforms such as Apache Spark, boosting both performance and accuracy. We thus propose a distributed implementation of one of the most well-known discretizers based on Information Theory, obtaining better results than the one produced by: the entropy minimization discretizer proposed by Fayyad and Irani. Our scheme goes beyond a simple parallelization and it is intended to be the first to face the Big Data challenge. (C) 2015 John Wiley & Sons, Ltd
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available