TY - JOUR
T1 - Strength of ensemble learning in multiclass classification of rockburst intensity
AU - Zhang, Junfei
AU - Wang, Yuhang
AU - Sun, Yuantian
AU - Li, Guichen
PY - 2020/9
Y1 - 2020/9
N2 - Rockbust is a violent expulsion of rock due to the extreme release of strain energy stored in surrounding rock mass, leading to considerable damages to underground strucures and equipment, and threatening workers' safety. As the operational depth of engineering projects increases, a larger number of factors influence the mechanism of rockburst. Therefore, accurate classification of rockburst intensity cannot be achieved based on conventional criteria. It is urgent to develop new models with high accuracy and ease to implement in practice. This study proposed an ensemble machine learning method by aggregating seven individual classifiers including back propagation neural network, support vector machine, decision tree, k-nearest neighbours, logistic regression, multiple linear regression and Naïve Bayes. In addition, we proposed nine data imputation methods to replace the missing values in the compiled database including 188 rockburst instances. Five-fold cross validation and the beetle antennae search algorithm are used to tune hyperparameters and voting weights of the individual classifiers. The results show that the rockburst classification accuracy obtained by the classifier ensemble has increased by 15.4% compared with the best individual classifier on the test set. The predictor importance obtained by the classifier ensemble shows that the elastic energy index is the most sensitive input variable for rockburst intensity classification. This robust ensemble method can be extended to solve other classification problems in underground engineering projects.
AB - Rockbust is a violent expulsion of rock due to the extreme release of strain energy stored in surrounding rock mass, leading to considerable damages to underground strucures and equipment, and threatening workers' safety. As the operational depth of engineering projects increases, a larger number of factors influence the mechanism of rockburst. Therefore, accurate classification of rockburst intensity cannot be achieved based on conventional criteria. It is urgent to develop new models with high accuracy and ease to implement in practice. This study proposed an ensemble machine learning method by aggregating seven individual classifiers including back propagation neural network, support vector machine, decision tree, k-nearest neighbours, logistic regression, multiple linear regression and Naïve Bayes. In addition, we proposed nine data imputation methods to replace the missing values in the compiled database including 188 rockburst instances. Five-fold cross validation and the beetle antennae search algorithm are used to tune hyperparameters and voting weights of the individual classifiers. The results show that the rockburst classification accuracy obtained by the classifier ensemble has increased by 15.4% compared with the best individual classifier on the test set. The predictor importance obtained by the classifier ensemble shows that the elastic energy index is the most sensitive input variable for rockburst intensity classification. This robust ensemble method can be extended to solve other classification problems in underground engineering projects.
KW - beetle antennae search
KW - classifier ensemble
KW - machine learning
KW - missing data imputation
KW - rockburst prediction
UR - http://www.scopus.com/inward/record.url?scp=85087317178&partnerID=8YFLogxK
U2 - 10.1002/nag.3111
DO - 10.1002/nag.3111
M3 - Article
AN - SCOPUS:85087317178
VL - 44
SP - 1833
EP - 1853
JO - International Journal of Numerical and Analytical Methods in Geomechanics
JF - International Journal of Numerical and Analytical Methods in Geomechanics
SN - 0363-9061
IS - 13
ER -