Predictive inference with the jackknife+
From MaRDI portal
Abstract: This paper introduces the jackknife+, which is a novel method for constructing predictive confidence intervals. Whereas the jackknife outputs an interval centered at the predicted response of a test point, with the width of the interval determined by the quantiles of leave-one-out residuals, the jackknife+ also uses the leave-one-out predictions at the test point to account for the variability in the fitted regression function. Assuming exchangeable training samples, we prove that this crucial modification permits rigorous coverage guarantees regardless of the distribution of the data points, for any algorithm that treats the training points symmetrically. Such guarantees are not possible for the original jackknife and we demonstrate examples where the coverage rate may actually vanish. Our theoretical and empirical analysis reveals that the jackknife and the jackknife+ intervals achieve nearly exact coverage and have similar lengths whenever the fitting algorithm obeys some form of stability. Further, we extend the jackknife+ to K-fold cross validation and similarly establish rigorous coverage properties. Our methods are related to cross-conformal prediction proposed by Vovk [2015] and we discuss connections.
Recommendations
Cites work
- 10.1162/153244302760200704
- A data-driven software tool for enabling cooperative information sharing among police departments
- Bootstrap methods: another look at the jackknife
- Bootstrap Prediction Intervals for Regression
- Cross-conformal predictors
- Distribution-free inequalities for the deleted and holdout error estimates
- Distribution-free predictive inference for regression
- Fast exact conformalization of the Lasso using piecewise linear homotopy
- scientific article; zbMATH DE number 3483405 (Why is no real title available?)
- scientific article; zbMATH DE number 2168212 (Why is no real title available?)
- scientific article; zbMATH DE number 3433376 (Why is no real title available?)
- scientific article; zbMATH DE number 3053501 (Why is no real title available?)
- NOTES ON BIAS IN ESTIMATION
- On conditional moments of high-dimensional random vectors given lower-dimensional projections
- Predictive Intervals Based on Reuse of the Sample
- Scikit-learn: machine learning in Python
- The Predictive Sample Reuse Method with Applications
Cited in
(46)- conformalbayes
- Multi split conformal prediction
- Distribution-free predictive inference for regression
- Homeostasis phenomenon in conformal prediction and predictive distribution functions
- On the power of conditional independence testing under model-X
- Conformal prediction: a unified review of theory and new challenges
- Distribution-free conditional median inference
- Nested conformal prediction sets for classification with applications to probation data
- JANOS: An Integrated Predictive and Prescriptive Modeling Framework
- Conformal Prediction: A Gentle Introduction
- Conditional predictive inference for stable algorithms
- Testing for outliers with conformal p-values
- Root-finding approaches for computing conformal prediction set
- Conformal prediction beyond exchangeability
- Distribution-Free Prediction Sets for Two-Layer Hierarchical Models
- Adaptive novelty detection with false discovery rate guarantee
- Conformal Sensitivity Analysis for Individual Treatment Effects
- Post-selection inference via algorithmic stability
- Training-conditional coverage for distribution-free predictive inference
- Incorporating relative error criterion to conformal prediction for positive data
- Multi-split conformal prediction via Cauchy aggregation
- A confidence machine for sparse high-order interaction model
- Regression trees for fast and adaptive prediction intervals
- Fast and Exact Leave-One-Out Analysis of Large-Margin Classifiers
- Optimal Subsampling via Predictive Inference
- A conformal test of linear models via permutation-augmented regressions
- Power enhancement of permutation-augmented partial-correlation tests via fixed-row permutations
- Double robust conditional independence test for novel biomarkers given established risk factors with survival data
- Predictive inference in multi-environment scenarios
- Conformal Prediction for Network-Assisted Regression
- Adaptive conformal classification with noisy labels
- Quantile super learning for independent and online settings with application to solar power forecasting
- Conformal prediction for multivariate responses with Euclidean likelihood
- Algorithmic stability implies training-conditional coverage for distribution-free prediction methods
- Learn then test: calibrating predictive algorithms to achieve risk control
- Local Gaussian Process Extrapolation for BART Models with Applications to Causal Inference
- A comprehensive framework for evaluating time to event predictions using the restricted mean survival time
- Distribution-Free Prediction Intervals Under Covariate Shift, With an Application to Causal Inference
- Selection and Aggregation of Conformal Prediction Sets
- Conformal prediction for robust deep nonparametric regression
- Highest Probability Density Conformal Regions
- The limits of assumption-free tests for algorithm performance
- Extreme conformal prediction: reliable intervals for high-impact events
- A conformal prediction framework for uncertainty quantification in physics-informed neural networks
- Conformalized robust principal component analysis
- Cross-conformal prediction and statistically efficient p-value combinations
This page was built for publication: Predictive inference with the jackknife+
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q100525)
