Uncertainty estimation and misclassification probability for classification models based on discriminant analysis and support vector machines

Medeiros-De-morais, Camilo De lelis orcid iconORCID: 0000-0003-2573-787X, Lima, Kassio M.G. and Martin, Francis L orcid iconORCID: 0000-0001-8562-4944 (2019) Uncertainty estimation and misclassification probability for classification models based on discriminant analysis and support vector machines. Analytica Chimica Acta, 1063 . pp. 40-46. ISSN 0003-2670

[thumbnail of Author Accepted Manuscript]
Preview
PDF (Author Accepted Manuscript) - Accepted Version
Available under License Creative Commons Attribution Non-commercial No Derivatives.

4MB

Official URL: https://doi.org/10.1016/j.aca.2018.09.022

Abstract

Uncertainty estimation provides a quantitative value of the predictive performance of a classification model based on its misclassification probability. Low misclassification probabilities are associated with a low degree of uncertainty, indicating high trustworthiness; while high misclassification probabilities are associated with a high degree of uncertainty, indicating a high susceptibility to generate incorrect classification. Herein, misclassification probability estimations based on uncertainty estimation by bootstrap were developed for classification models using discriminant analysis [linear discriminant analysis (LDA) and quadratic discriminant analysis (QDA)] and support vector machines (SVM). Principal component analysis (PCA) was used as variable reduction technique prior classification. Four spectral datasets were tested (1 simulated and 3 real applications) for binary and ternary classifications. Models with lower misclassification probabilities were more stable when the spectra were perturbed with white Gaussian noise, indicating better robustness. Thus, misclassification probability can be used as an additional figure of merit to assess model robustness, providing a reliable metric to evaluate the predictive performance of a classifier.


Repository Staff Only: item control page