Comparative performance of six supervised learning methods for the development of models of hard rock pillar stability prediction

The prediction of pillar stability (PS) in hard rock mines is a crucial task for which many techniques and methods have been proposed in the literature including machine learning classification. In order to make the best use of the large variety of statistical and machine learning classification methods available, it is necessary to assess their performance before selecting a classifier and suggesting improvement. The objective of this paper is to compare different classification techniques for PS detection in hard rock mines. The data of this study consist of six features, namely pillar width, pillar height, the ratio of pillar width to its height, uniaxial compressive strength of the rock, pillar strength, and pillar stress. A total of 251 pillar cases between 1972 and 2011 are analyzed. Six supervised learning algorithms, including linear discriminant analysis, multinomial logistic regression, multilayer perceptron neural networks, support vector machine (SVM), random forest (RF), and gradient boosting machine, are evaluated for their ability to learn for PS based on different input parameter combinations. In this study, the available data set is randomly split into two parts: training set (70 %) and test set (30 %). A repeated tenfold cross-validation procedure (ten repeats) is applied to determine the optimal parameter values during modeling, and an external testing set is employed to validate the prediction performance of models. Two performance measures, namely classification accuracy rate and Cohen's kappa, are employed. The analysis of the accuracy together with kappa for the PS data set demonstrates that SVM and RF achieve comparable median classification accuracy rate and Cohen's kappa values. All models are fitted by R programs with the libraries and functions described in this study.