TY - JOUR
T1 - Can single classifiers be as useful as model ensembles to produce benthic seabed substratum maps?
AU - Turner, Joseph A.
AU - Babcock, Russell C.
AU - Hovey, Renae
AU - Kendrick, Gary A.
PY - 2018/5/1
Y1 - 2018/5/1
N2 - Numerous machine-learning classifiers are available for benthic habitat map production, which can lead to different results. This study highlights the performance of the Random Forest (RF) classifier, which was significantly better than Classification Trees (CT), Naïve Bayes (NB), and a multi-model ensemble in terms of overall accuracy, Balanced Error Rate (BER), Kappa, and area under the curve (AUC) values. RF accuracy was often higher than 90% for each substratum class, even at the most detailed level of the substratum classification and AUC values also indicated excellent performance (0.8–1). Total agreement between classifiers was high at the broadest level of classification (75–80%) when differentiating between hard and soft substratum. However, this sharply declined as the number of substratum categories increased (19–45%) including a mix of rock, gravel, pebbles, and sand. The model ensemble, produced from the results of all three classifiers by majority voting, did not show any increase in predictive performance when compared to the single RF classifier. This study shows how a single classifier may be sufficient to produce benthic seabed maps and model ensembles of multiple classifiers.
AB - Numerous machine-learning classifiers are available for benthic habitat map production, which can lead to different results. This study highlights the performance of the Random Forest (RF) classifier, which was significantly better than Classification Trees (CT), Naïve Bayes (NB), and a multi-model ensemble in terms of overall accuracy, Balanced Error Rate (BER), Kappa, and area under the curve (AUC) values. RF accuracy was often higher than 90% for each substratum class, even at the most detailed level of the substratum classification and AUC values also indicated excellent performance (0.8–1). Total agreement between classifiers was high at the broadest level of classification (75–80%) when differentiating between hard and soft substratum. However, this sharply declined as the number of substratum categories increased (19–45%) including a mix of rock, gravel, pebbles, and sand. The model ensemble, produced from the results of all three classifiers by majority voting, did not show any increase in predictive performance when compared to the single RF classifier. This study shows how a single classifier may be sufficient to produce benthic seabed maps and model ensembles of multiple classifiers.
KW - Automated classification
KW - Benthic habitat mapping
KW - Machine learning
KW - Multibeam echosounder
UR - http://www.scopus.com/inward/record.url?scp=85042868361&partnerID=8YFLogxK
U2 - 10.1016/j.ecss.2018.02.028
DO - 10.1016/j.ecss.2018.02.028
M3 - Article
AN - SCOPUS:85042868361
SN - 0272-7714
VL - 204
SP - 149
EP - 163
JO - Estuarine, Coastal and Shelf Science
JF - Estuarine, Coastal and Shelf Science
ER -