Learn then test: calibrating predictive algorithms to achieve risk control

DOI10.1214/24-AOAS1998MaRDI QIDQ6949465zbMATH OpenFDO

Authors Anastasios N. Angelopoulos, Stephen Bates, Emmanuel J. Candès, Michael Jordan, Lihua Lei

Publication date 1 August 2025

Published in The Annals of Applied Statistics (Search for Journal in Brave)

Full work available at URL https://www.projecteuclid.org/journals/annals-of-applied-statistics/volume-19/issue-2/Learn-then-test-Calibrating-predictive-algorithms-to-achieve-risk/10.1214/24-AOAS1998.full

zbMATH Keywords

computer visionconformal predictiondeep learningmachine learning

Mathematics Subject Classification ID

Applications of statistics (62P99) Artificial neural networks and deep learning (68T07) Machine vision and scene understanding (68T45)

Cites work

• A conformal prediction approach to explore functional data
• A result of Vapnik with applications
• An Extension of Wilks' Method for Setting Tolerance Limits
• Classification with confidence
• Conformal Inference of Counterfactuals and Individual Treatment Effects
• Conformal Prediction: A Gentle Introduction
• Conformalized survival analysis
• Cross-conformal predictors
• Determination of sample sizes for setting tolerance limits.
• Distribution-free, Risk-controlling Prediction Sets
• Gaussian approximations and multiplier bootstrap for maxima of sums of high-dimensional random vectors
• Greedy function approximation: A gradient boosting machine.
• scientific article; zbMATH DE number 2168212 (Why is no real title available?)
• scientific article; zbMATH DE number 1931847 (Why is no real title available?)
• scientific article; zbMATH DE number 7370598 (Why is no real title available?)
• Inference on directionally differentiable functions
• Learn then test: calibrating predictive algorithms to achieve risk control
• Least Ambiguous Set-Valued Classifiers With Bounded Error Levels
• Nested conformal prediction sets for classification with applications to probation data
• Non-Parametric Estimation II. Statistically Equivalent Blocks and Tolerance Regions--The Continuous Case
• On Hoeffding's inequalities.
• Prediction and Outlier Detection in Classification Problems
• Prediction, Estimation, and Attribution
• Predictive inference with the jackknife+
• Probability Inequalities for Sums of Bounded Random Variables
• Robust Validation: Confident Predictions Even When Distributions Shift
• Statistical modeling: The two cultures. (With comments and a rejoinder).
• Statistical Prediction with Special Reference to the Problem of Tolerance Limits
• Statistical Tolerance Regions: Theory, Applications, and Computation
• Testing for outliers with conformal p-values
• Testing randomness online
• The limits of distribution-free conditional predictive inference

Cited in

(2)

• False selection rate control in mixture models
• Learn then test: calibrating predictive algorithms to achieve risk control

This page was built for publication: Learn then test: calibrating predictive algorithms to achieve risk control

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6949465)