Article

The Balanced Accuracy and Its Posterior Distribution

Authors:

Kay Henning Brodersen,

Cheng Soon Ong,

Klaas Enno Stephan,

Joachim M. BuhmannAuthors Info & Claims

ICPR '10: Proceedings of the 2010 20th International Conference on Pattern Recognition

Pages 3121 - 3124

https://doi.org/10.1109/ICPR.2010.764

Published: 23 August 2010 Publication History

Publisher Site

Abstract

Evaluating the performance of a classification algorithm critically requires a measure of the degree to which unseen examples have been identified with their correct class labels. In practice, generalizability is frequently estimated by averaging the accuracies obtained on individual cross-validation folds. This procedure, however, is problematic in two ways. First, it does not allow for the derivation of meaningful confidence intervals. Second, it leads to an optimistic estimate when a biased classifier is tested on an imbalanced dataset. We show that both problems can be overcome by replacing the conventional point estimate of accuracy by an estimate of the posterior distribution of the balanced accuracy.

Cited By

View all

Alchieri LAbdalazim NAlecci LGashi SGjoreski MSantini S(2024)Lateralization Effects in Electrodermal Activity Data Collected Using Wearable DevicesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36435418:1(1-30)Online publication date: 6-Mar-2024
https://dl.acm.org/doi/10.1145/3643541
Xu XYao BDong YGabriel SYu HHendler JGhassemi MDey AWang D(2024)Mental-LLMProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36435408:1(1-32)Online publication date: 6-Mar-2024
https://dl.acm.org/doi/10.1145/3643540
Chan ELiu ZQiu RZhang YMaciejewski RTong H(2024)Group Fairness via Group ConsensusProceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency10.1145/3630106.3659006(1788-1808)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3630106.3659006
Show More Cited By

Index Terms

The Balanced Accuracy and Its Posterior Distribution
1. Computing methodologies
  1. Machine learning
    1. Learning paradigms
      1. Supervised learning
        Supervised learning by classification

Index terms have been assigned to the content through auto-classification.

Recommendations

Classification Performance of Bagging and Boosting Type Ensemble Methods with Small Training Sets
Abstract
Classification performance of an ensemble method can be deciphered by studying the bias and variance contribution to its classification error. Statistically, the bias and variance of a single classifier is controlled by the size of the training ...
Hybrid random subsample classifier ensemble for high dimensional data sets

This paper presents a comparative performance evaluation of a random subsample classifier ensemble with leading machine learning classifiers on high dimensional datasets. Classification performance of the hybrid random subsample ensemble is compared to ...
Joint maximization of accuracy and information for learning the structure of a Bayesian network classifier
Abstract
Although recent studies have shown that a Bayesian network classifier (BNC) that maximizes the classification accuracy (i.e., minimizes the 0/1 loss function) is a powerful tool in both knowledge representation and classification, this classifier: ...

Comments

Information & Contributors

Information

Published In

ICPR '10: Proceedings of the 2010 20th International Conference on Pattern Recognition

August 2010

4662 pages

ISBN:9780769541099

Publisher

IEEE Computer Society

United States

Publication History

Published: 23 August 2010

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

75
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 29 Jul 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Alchieri LAbdalazim NAlecci LGashi SGjoreski MSantini S(2024)Lateralization Effects in Electrodermal Activity Data Collected Using Wearable DevicesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36435418:1(1-30)Online publication date: 6-Mar-2024
https://dl.acm.org/doi/10.1145/3643541
Xu XYao BDong YGabriel SYu HHendler JGhassemi MDey AWang D(2024)Mental-LLMProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36435408:1(1-32)Online publication date: 6-Mar-2024
https://dl.acm.org/doi/10.1145/3643540
Chan ELiu ZQiu RZhang YMaciejewski RTong H(2024)Group Fairness via Group ConsensusProceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency10.1145/3630106.3659006(1788-1808)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3630106.3659006
Auch MBalluff MMandl PWolff C(2024)Towards an Automated Classification of Software LibrariesSN Computer Science10.1007/s42979-024-02654-25:4Online publication date: 27-Mar-2024
https://dl.acm.org/doi/10.1007/s42979-024-02654-2
Wu YDu KWang XMin F(2024)Misclassification-guided loss under the weighted cross-entropy loss frameworkKnowledge and Information Systems10.1007/s10115-024-02123-566:8(4685-4720)Online publication date: 1-Aug-2024
https://dl.acm.org/doi/10.1007/s10115-024-02123-5
Vieira PRodrigues F(2024)An automated approach for binary classification on imbalanced dataKnowledge and Information Systems10.1007/s10115-023-02046-766:5(2747-2767)Online publication date: 1-May-2024
https://dl.acm.org/doi/10.1007/s10115-023-02046-7
De Jonghe JKuczyński M(2024)Neural network classification of eigenmodes in the magnetohydrodynamic spectroscopy code LegolasNeural Computing and Applications10.1007/s00521-023-09403-136:11(5955-5964)Online publication date: 1-Apr-2024
https://dl.acm.org/doi/10.1007/s00521-023-09403-1
Tsirigotis CMonteiro JRodriguez PVazquez DCourville AOh ANaumann TGloberson ASaenko KHardt MLevine S(2023)Group robust classification without any group informationProceedings of the 37th International Conference on Neural Information Processing Systems10.5555/3666122.3668590(56553-56575)Online publication date: 10-Dec-2023
https://dl.acm.org/doi/10.5555/3666122.3668590
Chen SZhao YZhang JChern IGao SLiu PHe JOh ANaumann TGloberson ASaenko KHardt MLevine S(2023)FELMProceedings of the 37th International Conference on Neural Information Processing Systems10.5555/3666122.3668049(44502-44523)Online publication date: 10-Dec-2023
https://dl.acm.org/doi/10.5555/3666122.3668049
Nørskov AZahid AMørup MOh ANaumann TGloberson ASaenko KHardt MLevine S(2023)CSLP-AEProceedings of the 37th International Conference on Neural Information Processing Systems10.5555/3666122.3666700(13179-13199)Online publication date: 10-Dec-2023
https://dl.acm.org/doi/10.5555/3666122.3666700
Show More Cited By

Abstract

Cited By

Index Terms

Recommendations

Classification Performance of Bagging and Boosting Type Ensemble Methods with Small Training Sets

Hybrid random subsample classifier ensemble for high dimensional data sets

Joint maximization of accuracy and information for learning the structure of a Bayesian network classifier

Comments

Information

Published In

Publisher

Publication History

Author Tags

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations