Dynamic F1-score-based voting strategies for multi-class classification: an adaptive ensemble approach for non-linear and imbalanced datasets
Abstract: Classification is a core machine learning task, and ensemble voting methods are widely used to improve predictive accuracy in domains such as medical diagnosis, where class imbalance and non-linear decision boundaries are common. Conventional strategies: Majority Voting (MV), Weighted Voting (WV), and Soft Voting (SV) rely on static or classifier-level weighting schemes that fail to capture per-class differences in classifier reliability. Three dynamic, class-specific voting strategies are introduced: Highest Cl…
Nearest neighbor classification using a density sensitive distance measurement [electronic resource] by Burkholder, Joshua Jeremy.. Public domain
Researchers developed three adaptive ensemble voting methods that assign weights based on per-class F1-scores from validation instead of overall accuracy. They tested the approaches on Gaussian Mixture, Spiral, and Moon synthetic datasets and on the Breast Cancer Wisconsin and UCI Heart Disease datasets, comparing against majority, weighted, and soft voting.
The reported gains suggest more reliable ensembles when classes are imbalanced and boundaries are non-linear, which is relevant for diagnostic models. What remains uncertain is how the methods generalize beyond the five evaluated datasets and scikit-learn classifiers to deployed clinical workflows, larger populations, and other imbalance regimes.
- Introduced three dynamic voting strategies HCF1V, CCF1V, and ECF1V that weight classifiers by per-class F1-scores from validation.
- Evaluated on three synthetic non-linear datasets Gaussian Mixture, Spiral, and Moon and two medical benchmarks BCWD and UHDD using scikit-learn classifiers.
- Statistical significance assessed via Wilcoxon signed-rank tests, with ECF1V outperforming conventional MV, WV, SV and several recently published approaches.
Dynamic class-specific F1-score weighting with ECF1V increased ensemble classification accuracy to 98.25% on Breast Cancer Wisconsin and 89.47% on UCI Heart Disease datasets, outperforming conventional voting under non-linear and imbalanced conditions.
The rundown
The study replaces static classifier-level weights with per-class F1-scores obtained during validation, proposing Highest Class F1-Score Voting, Cumulative Class F1-Score Voting, and Enhanced Class F1-Score Voting to address reliability differences across classes.
Testing combined synthetic non-linear problems with real-world medical data, using scikit-learn-based classifiers, and found ECF1V consistently achieved top accuracy, indicating improved handling of class imbalance for high-stakes tasks like medical diagnosis.
Sources
- Peer-reviewedScientific Reports2026-08-25
How should this claim be treated?
ace
The debate