4.7 Article

A Novel k -Means Framework via Constrained Relaxation and Spectral Rotation

Publisher

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TNNLS.2023.3282938

Keywords

Clustering; k-means; Lloyd heuristic; spectral relaxation; spectral rotation

Ask authors/readers for more resources

In this article, we propose k-mRSR, which converts the traditional k-means clustering method into a combinatorial optimization problem. The main advantage of k-mRSR is that it only needs to solve the membership matrix instead of computing the cluster centers in each iteration. Experimental results show that k-mRSR can further decrease (increase) the objective function values of the k-means obtained by Lloyd (CD), while Lloyd (CD) cannot decrease (increase) the objective function obtained by k-mRSR. Furthermore, k-mRSR outperforms both Lloyd and CD in terms of the objective function value and outperforms other state-of-the-art methods in terms of clustering performance.
Owing to its simplicity, the traditional k-means (Lloyd heuristic) clustering method plays a vital role in a variety of machine-learning applications. Disappointingly, the Lloyd heuristic is prone to local minima. In this article, we propose k-mRSR, which converts the sum-of-squared error (SSE) (Lloyd) into a combinatorial optimization problem and incorporates a relaxed trace maximization term and an improved spectral rotation term. The main advantage of k-mRSR is that it only needs to solve the membership matrix instead of computing the cluster centers in each iteration. Furthermore, we present a nonredundant coordinate descent method that brings the discrete solution infinitely close to the scaled partition matrix. Two novel findings from the experiments are that k-mRSR can further decrease (increase) the objective function values of the k-means obtained by Lloyd (CD), while Lloyd (CD) cannot decrease (increase) the objective function obtained by k-mRSR. In addition, the results of extensive experiments on 15 datasets indicate that k-mRSR outperforms both Lloyd and CD in terms of the objective function value and outperforms other state-ofthe-art methods in terms of clustering performance.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available