Distribution-free predictive inference for regression
From MaRDI portal
Abstract: We develop a general framework for distribution-free predictive inference in regression, using conformal inference. The proposed methodology allows for the construction of a prediction band for the response variable using any estimator of the regression function. The resulting prediction band preserves the consistency properties of the original estimator under standard assumptions, while guaranteeing finite-sample marginal coverage even when these assumptions do not hold. We analyze and compare, both empirically and theoretically, the two major variants of our conformal framework: full conformal inference and split conformal inference, along with a related jackknife method. These methods offer different tradeoffs between statistical accuracy (length of resulting prediction intervals) and computational efficiency. As extensions, we develop a method for constructing valid in-sample prediction intervals called {it rank-one-out} conformal inference, which has essentially the same computational efficiency as split conformal inference. We also describe an extension of our procedures for producing prediction bands with locally varying length, in order to adapt to heteroskedascity in the data. Finally, we propose a model-free notion of variable importance, called {it leave-one-covariate-out} or LOCO inference. Accompanying this paper is an R package { t conformalInference} that implements all of the proposals we have introduced. In the spirit of reproducibility, all of our empirical results can also be easily (re)generated using this package.
Recommendations
Cites work
- A conformal prediction approach to explore functional data
- Asymptotics of selective inference
- Classification with confidence
- Conditional validity of inductive conformal predictors
- Confidence Intervals and Hypothesis Testing for High-Dimensional Regression
- Confidence intervals for low dimensional parameters in high dimensional linear models
- Discussion: ``A significance test for the lasso
- Distribution-free Prediction Bands for Non-parametric Regression
- Distribution-Free Prediction Sets
- Exact post-selection inference, with application to the Lasso
- scientific article; zbMATH DE number 3145583 (Why is no real title available?)
- scientific article; zbMATH DE number 2168212 (Why is no real title available?)
- scientific article; zbMATH DE number 1931847 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- On asymptotically optimal confidence regions and tests for high-dimensional models
- On-line predictive linear regression
- Predictive Intervals Based on Reuse of the Sample
- Random forests
- Regularization and Variable Selection Via the Elastic Net
- Selective inference with a randomized response
- Simultaneous analysis of Lasso and Dantzig selector
- Sparse additive models
- Sparse models and methods for optimal instruments with an application to eminent domain
- Sparsity oracle inequalities for the Lasso
- Stability selection. With discussion and authors' reply
- Statistical significance in high-dimensional linear models
- Valid post-selection inference
Cited in
(only showing first 100 items - show all)- Predictive inference with the jackknife+
- Multi split conformal prediction
- conformalInference.multi
- Testing conditional independence in supervised learning algorithms
- Accelerating difficulty estimation for conformal regression forests
- Comparing six shrinkage estimators with large sample theory and asymptotically optimal prediction intervals
- Unrestricted permutation forces extrapolation: variable importance requires at least one more model, or there is no free variable importance
- Validity, consonant plausibility measures, and Conformal prediction
- Homeostasis phenomenon in conformal prediction and predictive distribution functions
- Clustering on the torus by conformal prediction
- Conformal prediction bands for multivariate functional data
- A minimax framework for quantifying risk-fairness trade-off in regression
- Methods to compute prediction intervals: a review and new results
- Robust prediction interval estimation for Gaussian processes by cross-validation method
- Conformal prediction: a unified review of theory and new challenges
- Post-model-selection inference in linear regression models: an integrated review
- Distributional anchor regression
- Grouped feature importance and combined features effect plot
- Comment: Statistical inference from a predictive perspective
- Rejoinder: Models as approximations
- Is distribution-free inference possible for binary regression?
- Distribution-free conditional median inference
- Unsupervised streaming anomaly detection for instrumented infrastructure
- Bootstrapping and sample splitting for high-dimensional, assumption-lean inference
- Quantile regression approach to conditional mode estimation
- Model-free model-fitting and predictive distributions
- Nested conformal prediction sets for classification with applications to probation data
- Model-free prediction and regression. A transformation-based approach to inference
- A Conformal Approach for Distribution-free Prediction of Functional Data
- scientific article; zbMATH DE number 1254128 (Why is no real title available?)
- A unified framework for random forest prediction error estimation
- Discussion of Kallus and Mo, Qi, and Liu: New Objectives for Policy Learning
- Valid model-free prediction of future insurance claims
- Prediction intervals for GLMs, GAMs, and some survival regression models
- scientific article; zbMATH DE number 7626724 (Why is no real title available?)
- The Holdout Randomization Test for Feature Selection in Black Box Models
- Discussion of the Paper “Prediction, Estimation, and Attribution” by B. Efron
- Discussion of Professor Bradley Efron’s Article on “Prediction, Estimation, and Attribution”
- GAMLSS: A distributional regression approach
- A survey on the explainability of supervised machine learning
- Cross-validation with confidence
- The limits of distribution-free conditional predictive inference
- Fast exact conformalization of the Lasso using piecewise linear homotopy
- Distribution-free prediction bands for non-parametric regression
- Random Forest Prediction Intervals
- An Exact and Robust Conformal Inference Method for Counterfactual and Synthetic Controls
- Conformal Prediction: A Gentle Introduction
- Conditional predictive inference for stable algorithms
- Nonparametric variable importance assessment using machine learning techniques
- Supervised Machine Learning Techniques: An Overview with Applications to Banking
- Discussion of the Paper “Prediction, Estimation, and Attribution” by B. Efron
- Gaussian copula function-on-scalar regression in reproducing kernel Hilbert space
- A General Framework for Inference on Algorithm-Agnostic Variable Importance
- Discussion of Professor Bradley Efron’s Article on “Prediction, Estimation, and Attribution”
- Root-finding approaches for computing conformal prediction set
- Variable Selection Via Thompson Sampling
- Honest Confidence Sets for High-Dimensional Regression by Projection and Shrinkage
- Stochastic Tree Ensembles for Regularized Nonlinear Regression
- Understanding complex predictive models with ghost variables
- Conformal prediction beyond exchangeability
- Model-independent detection of new physics signals using interpretable semisupervised classifier tests
- Distribution-Free Prediction Sets for Two-Layer Hierarchical Models
- Conformal Sensitivity Analysis for Individual Treatment Effects
- Inference for sparse linear regression based on the leave-one-covariate-out solution path
- Dimension-agnostic inference using cross U-statistics
- Training-conditional coverage for distribution-free predictive inference
- Set-Valued Support Vector Machine with Bounded Error Rates
- What is a Randomization Test?
- Incorporating relative error criterion to conformal prediction for positive data
- Explainable contextual anomaly detection using quantile regression forests
- Can a single neuron learn predictive uncertainty?
- Synthetic control as online linear regression
- Total effects with constrained features
- Multi-split conformal prediction via Cauchy aggregation
- A confidence machine for sparse high-order interaction model
- Variable selection in function-on-scalar single-index model via the alternating direction method of multipliers
- Valid Model-Free Spatial Prediction
- A Two-Sample Conditional Distribution Test Using Conformal Prediction and Weighted Rank Sum
- Conditional feature importance for mixed data
- De Finetti's theorem and related results for infinite weighted exchangeable sequences
- Selective review of biased sampling problems with applications in modern statistics
- Prediction in measurement error models
- Regression trees for fast and adaptive prediction intervals
- Nonparametric Estimation and Conformal Inference of the Sufficient Forecasting With a Diverging Number of Factors
- Uncertainty in lung cancer stage for survival estimation via set-valued classification
- Hoeffding and Bernstein inequalities for weighted sums of exchangeable random variables
- Feature importance: a closer look at Shapley values and LOCO
- Multivariate scalar on multidimensional distribution regression with application to modeling the association between physical activity and cognitive functions
- Optimal Subsampling via Predictive Inference
- Robust Validation: Confident Predictions Even When Distributions Shift
- Neural networks for extreme quantile regression with an application to forecasting of flood risk
- A latent variable mixture model for composition-on-composition regression with application to chemical recycling
- Prediction intervals with controlled length in the heteroscedastic Gaussian regression
- Nonparametric predictive distributions based on conformal prediction
- Online prediction for streaming observational data
- Model-free bootstrap and conformal prediction in regression: conditionality, conjecture testing, and pertinent prediction intervals
- Conditional mode: an approach via smoothed quantile regression
- Factor Importance Ranking and Selection Using Total Indices
- Variable importance measures for heterogeneous treatment effects
- Quantifying predictive uncertainty of aphasia severity in stroke patients with sparse heteroscedastic Bayesian high-dimensional regression
This page was built for publication: Distribution-free predictive inference for regression
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q112972)
