4.5 Article

Structure-based hyperparameter selection with Bayesian optimization in multidimensional scaling

Journal

STATISTICS AND COMPUTING
Volume 33, Issue 1, Pages -

Publisher

SPRINGER
DOI: 10.1007/s11222-022-10197-w

Keywords

Exploratory data analysis; Data visualization; Manifold learning; Nonlinear dimension reduction; Ordination

Ask authors/readers for more resources

In this paper, the authors introduce the structure optimized proximity scaling (STOPS) framework for hyperparameter selection in parametrized multidimensional scaling and extensions (proximity scaling; PS). By combining c-structuredness indices with the PS badness-of-fit measure, a multi-objective scalarization approach called Stoploss objective is proposed. A profile-type algorithm is suggested for the computational implementation, and Bayesian optimization with treed Gaussian processes is recommended for outer hyperparameter optimization. The STOPS framework is demonstrated with three data examples.
We introduce the structure optimized proximity scaling (STOPS) framework for hyperparameter selection in parametrized multidimensional scaling and extensions (proximity scaling; PS). The selection process for hyperparameters is based on the idea that we want the configuration to show a certain structural quality (c-structuredness). A number of structures and how to measure them are discussed. We combine the structural quality by means of c-structuredness indices with the PS badness-of-fit measure in a multi-objective scalarization approach, yielding the Stoploss objective. Computationally we suggest a profile-type algorithm that first solves the PS problem and then uses Stoploss in an outer step to optimize over the hyperparameters. Bayesian optimization with treed Gaussian processes as a an apt and efficient strategy for carrying out the outer optimization is recommended. This way, hyperparameter tuning for many instances of PS is covered in a single conceptual framework. We illustrate the use of the STOPS framework with three data examples.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.5
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available