ROC curves for regression
From MaRDI portal
Publication:898227
Abstract: Several efforts have been done to bring ROC analysis beyond (binary) classification, especially in regression. However, the mapping and possibilities of these proposals do not correspond to what we expect from the analysis of operating conditions, dominance, hybrid methods, etc. In this paper we present a new representation of regression models in the so-called regression ROC (RROC) space. The basic idea is to represent over-estimation on the x axis and under-estimation on the y axis. The curves are just drawn by adjusting a shift, a constant that is added (or subtracted) to the predictions, and plays a similar role as a threshold in classification. From here, we develop the notions of optimal operating condition, convexity, dominance, and explore several evaluation metrics that can be shown graphically, such as the area over the RROC curve (AOC). In particular, we show a novel and significant result, the AOC is equal to the error variance (multiplied by a factor which does not depend on the model). The derivation of RROC curves with non-constant shifts and soft regression models, and the relation with cost plots is also discussed.
Recommendations
- Regression Models for Convex ROC Curves
- ROC curves in cost space
- Overestimation of the receiver operating characteristic curve for logistic regression
- A regression modelling framework for receiver operating characteristic curves in medical diagnostic testing
- ROC curves in non-parametric location-scale regression models
Cites work
- A unified view of performance metrics: translating threshold choice into expected classification loss
- An extension of the Gauss-Newton algorithm for estimation under asymmetric loss
- An online AUC formulation for binary classification
- Bayesian Estimation and Prediction Using Asymmetric Loss Functions
- Bayesian approach to life testing and reliability estimation using asymmetric loss function
- Iterative Boolean combination of classifiers in the ROC space: an application to anomaly detection with HMMs
- Maximizing area under ROC curve for biometric scores fusion
- Maximizing the area under the ROC curve by pairwise feature combination
- Measuring classifier performance: a coherent alternative to the area under the ROC curve
- Measuring the accuracy of diagnostic systems
- Partial AUC maximization in a linear combination of dichotomizers
- Prediction with a Generalized Cost of Error Function
- ROC Curves for Continuous Data
- ROC curve estimation and hypothesis testing: Applications to breast cancer detection
- ROC curves in cost space
- Selecting features in microarray classification using roc curves
- Testing Forecast Optimality Under Unknown Loss
- The ROC manifold for classification systems
- Volume under the ROC surface for multi-class problems.
Cited in
(11)- Model Checking for ROC Regression Analysis
- ROC curves in cost space
- R2DS: a novel hierarchical framework for driver fatigue detection in mountain freeway
- Receiver operating characteristic (ROC) movies, universal ROC (UROC) curves, and coefficient of predictive ability (CPA)
- Binarised regression tasks: methods and evaluation metrics
- An Interpretation for the ROC Curve and Inference Using GLM Procedures
- The ROC region of a regression tree
- Selecting cash management models from a multiobjective perspective
- A regression approach to ROC surface, with applications to Alzheimer's disease
- Imbalanced regression and extreme value prediction
- Density-based weighting for imbalanced regression
This page was built for publication: ROC curves for regression
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q898227)
