Model-free posterior inference on the area under the receiver operating characteristic curve
From MaRDI portal
Publication:2189107
Abstract: The area under the receiver operating characteristic curve (AUC) serves as a summary of a binary classifier's performance. Methods for estimating the AUC have been developed under a binormality assumption which restricts the distribution of the score produced by the classifier. However, this assumption introduces an infinite-dimensional nuisance parameter and can be inappropriate, especially in the context of machine learning. This motivates us to adopt a model-free Gibbs posterior distribution for the AUC. We present the asymptotic Gibbs posterior concentration rate, and a strategy for tuning the learning rate so that the corresponding credible intervals achieve the nominal frequentist coverage probability. Simulation experiments and a real data analysis demonstrate the Gibbs posterior's strong performance compared to existing methods based on a rank likelihood.
Recommendations
- Using the area under an estimated ROC curve to test the adequacy of binary predictors
- AUC maximization in Bayesian hierarchical models
- Measuring classifier performance: a coherent alternative to the area under the ROC curve
- Multivariate binormal mixtures for semi-parametric inference on ROC curves
- A distributionally robust area under curve maximization model
Cites work
- A Class of Statistics with Asymptotically Normal Distribution
- A family of nonparametric statistics for comparing diagnostic markers with paired or unpaired data
- A General Framework for Updating Belief Distributions
- A Stochastic Approximation Method
- An MCMC approach to classical estimation.
- Assigning a value to a power likelihood in a general Bayesian model
- Bayesian nonparametric ROC regression modeling
- Bayesian ROC curve estimation under binormality using a rank likelihood
- Calibrating general posterior credible regions
- False confidence, non-additive beliefs, and valid statistical inference
- From -entropy to KL-entropy: analysis of minimum information complexity density estima\-tion
- Fundamentals of nonparametric Bayesian inference
- General Bayesian updating and the loss-likelihood bootstrap
- Gibbs posterior for variable selection in high-dimensional classification and data mining
- Gibbs posterior inference on the minimum clinically important difference
- Inconsistency of Bayesian inference for misspecified linear models, and a proposal for repairing it
- Information-theoretic upper and lower bounds for statistical estimation
- Is Bayes posterior just quick and dirty confidence?
- Misspecification in infinite-dimensional Bayesian statistics
- On a Test of Whether one of Two Random Variables is Stochastically Larger than the Other
- On the properties of variational approximations of Gibbs posteriors
- Semi-parametric estimation of the binormal ROC curve for a continuous diagnostic test
- Some mathematical properties of the ROC curve and their applications
- The area above the ordinal dominance graph and the area below the receiver operating characteristic graph
- The Bernstein-von Mises theorem under misspecification
- The safe Bayesian. Learning the learning rate via the mixability gap
- Two transformation models for estimating an ROC curve derived from continuous data
Cited in
(3)
This page was built for publication: Model-free posterior inference on the area under the receiver operating characteristic curve
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2189107)
