Filtering non-balanced data using an evolutionary approach

Matrices that cannot be handled using conventional clustering, regression or classification methods are often found in every big data research area. In particular, datasets with thousands or millions of rows and less than a hundred columns regularly appear in biological so-called omic problems. The effectiveness of conventional data analysis approaches is hampered by this matrix structure, which necessitates some means of reduction. An evolutionary method called PreCLAS is presented in this article. Its main objective is to find a submatrix with fewer rows that exhibits some group structure. Three stages of experiments were performed. First, a benchmark dataset was used to assess the correct functionality of the method for clustering purposes. Then, a microarray gene expression data matrix was used to analyze the method's performance in a simple classification scenario, where differential expression was carried out. Finally, several classification methods were compared in terms of classification accuracy using an RNA-seq gene expression dataset. Experiments showed that the new evolutionary technique significantly reduces the number of rows in the matrix and intelligently performs unsupervised row selection, improving classification and clustering methods.

Automated summary

This article presents an evolutionary method called PreCLAS for handling matrices that cannot be analyzed using conventional clustering, regression or classification methods in big data research. The method significantly reduces the number of rows in the matrix and intelligently performs unsupervised row selection, improving the effectiveness of classification and clustering methods.