Training-conditional coverage for distribution-free predictive inference
From MaRDI portal
Abstract: The field of distribution-free predictive inference provides tools for provably valid prediction without any assumptions on the distribution of the data, which can be paired with any regression algorithm to provide accurate and reliable predictive intervals. The guarantees provided by these methods are typically marginal, meaning that predictive accuracy holds on average over both the training data set and the test point that is queried. However, it may be preferable to obtain a stronger guarantee of training-conditional coverage, which would ensure that most draws of the training data set result in accurate predictive accuracy on future test points. This property is known to hold for the split conformal prediction method. In this work, we examine the training-conditional coverage properties of several other distribution-free predictive inference methods, and find that training-conditional coverage is achieved by some methods but is impossible to guarantee without further assumptions for others.
Cites work
- scientific article; zbMATH DE number 2168212 (Why is no real title available?)
- An Extension of Wilks' Method for Setting Tolerance Limits
- Combining p-values via averaging
- Concrete functional calculus
- Conditional predictive inference for stable algorithms
- Conditional validity of inductive conformal predictors
- Conformal Predictive Distributions with Kernels
- Cross-conformal predictors
- Distribution-free Prediction Bands for Non-parametric Regression
- Distribution-free predictive inference for regression
- Distribution-free, Risk-controlling Prediction Sets
- Fast exact conformalization of the Lasso using piecewise linear homotopy
- Predictive inference with the jackknife+
- Random variables with maximum sums
- Surprises in high-dimensional ridgeless least squares interpolation
- The limits of distribution-free conditional predictive inference
Cited in
(2)
This page was built for publication: Training-conditional coverage for distribution-free predictive inference
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6184870)
