Journal
KUNSTLICHE INTELLIGENZ
Volume 29, Issue 4, Pages 329-337Publisher
SPRINGER HEIDELBERG
DOI: 10.1007/s13218-015-0381-0
Keywords
Hyperparameter optimization; Automatic machine learning; Autonomous learning; Deep learning
Categories
Funding
- German Research Foundation's Priority Programme Autonomous Learning'' [DFG SPP 1527]
Ask authors/readers for more resources
The success of hand-crafted machine learning systems in many applications raises the question of making machine learning algorithms more autonomous, i.e., to reduce the requirement of expert input to a minimum. We discuss two strategies towards this goal: (1) automated optimization of hyperparameters (including mechanisms for feature selection, preprocessing, model selection, etc) and (2) the development of algorithms with reduced sets of hyperparameters. Since many research directions (e.g., deep learning), show a tendency towards increasingly complex algorithms with more and more hyperparamters, the demand for both of these strategies continuously increases. We review recent hyperparameter optimization methods and discuss data-driven approaches to avoid the introduction of hyperparameters using unsupervised learning. We end in discussing how these complementary strategies can work hand-in-hand, representing a very promising approach towards autonomous machine learning.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available