Comparing linear discriminant analysis and supervised learning algorithms for binary classification—A method comparison study
Abstract: In psychology, linear discriminant analysis (LDA) is the method of choice for two‐group classification tasks based on questionnaire data. In this study, we present a comparison of LDA with several supervised learning algorithms. In particular, we examine to what extent the predictive performance of LDA relies on the multivariate normality assumption. As nonparametric alternatives, the linear support vector machine (SVM), classification and regression tree (CART), random forest (RF), probabilistic neural network (PNN), and the ensemble k conditional nearest neighbor (EkCNN) algorithms are applied. Predictive performance is determined using measures of overall performance, discrimination, and calibration, and is compared in two reference data sets as well as in a simulation study. The reference data are Likert‐type data, and comprise 5 and 10 predictor variables, respectively. Simulations are based on the reference data and are done for a balanced and an unbalanced scenario in each case. In order to compare the algorithms' performance, data are simulated from multivariate distributions with differing degrees of nonnormality. Results differ depending on the specific performance measure. The main finding is that LDA is always outperformed by RF in the bimodal data with respect to overall performance. Discriminative ability of the RF algorithm is often higher compared to LDA, but its model calibration is usually worse. Still LDA mostly ranges second in cases it is outperformed by another algorithm, or the differences are only marginal. In consequence, we still recommend LDA for this type of application.
- Location
-
Deutsche Nationalbibliothek Frankfurt am Main
- Extent
-
Online-Ressource
- Language
-
Englisch
- Bibliographic citation
-
Comparing linear discriminant analysis and supervised learning algorithms for binary classification—A method comparison study ; day:18 ; month:12 ; year:2022 ; extent:20
Biometrical journal ; (18.12.2022) (gesamt 20)
- Creator
- DOI
-
10.1002/bimj.202200098
- URN
-
urn:nbn:de:101:1-2022121914080085631991
- Rights
-
Open Access; Der Zugriff auf das Objekt ist unbeschränkt möglich.
- Last update
-
15.08.2025, 7:21 AM CEST
Data provider
Deutsche Nationalbibliothek. If you have any questions about the object, please contact the data provider.
Associated
- Graf, Ricarda
- Zeldovich, Marina
- Friedrich, Sarah
Other Objects (12)
Comparing linear discriminant analysis and supervised learning algorithms for binary classification - a method comparison study
Comparing different supervised machine learning algorithms for disease prediction
A supervised discriminant data representation: application to pattern classification
Note on the discriminant of a binary quantic.
Comparing climate time series – Part 3: Discriminant analysis
A comparison of supervised learning algorithms
Efficient supervised learning in networks with binary synapses
Comparing graphs : Algorithms & applications
Testing conditional independence in supervised learning algorithms
The discriminant embedding
Extremal discriminant analysis
FRAMEWORK FOR COMPARING SEGMENTATION ALGORITHMS
Comparing linear discriminant analysis and supervised learning algorithms for binary classification - a method comparison study
Comparing different supervised machine learning algorithms for disease prediction
A supervised discriminant data representation: application to pattern classification
Note on the discriminant of a binary quantic.
Comparing climate time series – Part 3: Discriminant analysis
A comparison of supervised learning algorithms
Efficient supervised learning in networks with binary synapses
Comparing graphs : Algorithms & applications
Testing conditional independence in supervised learning algorithms
The discriminant embedding
Extremal discriminant analysis
FRAMEWORK FOR COMPARING SEGMENTATION ALGORITHMS
Comparing linear discriminant analysis and supervised learning algorithms for binary classification - a method comparison study
Comparing different supervised machine learning algorithms for disease prediction
A supervised discriminant data representation: application to pattern classification
Note on the discriminant of a binary quantic.
Comparing climate time series – Part 3: Discriminant analysis
A comparison of supervised learning algorithms
Efficient supervised learning in networks with binary synapses
Comparing graphs : Algorithms & applications
Testing conditional independence in supervised learning algorithms
The discriminant embedding
Extremal discriminant analysis