IPAD: stable interpretable forecasting with knockoffs inference
From MaRDI portal
Abstract: Interpretability and stability are two important features that are desired in many contemporary big data applications arising in economics and finance. While the former is enjoyed to some extent by many existing forecasting approaches, the latter in the sense of controlling the fraction of wrongly discovered features which can enhance greatly the interpretability is still largely underdeveloped in the econometric settings. To this end, in this paper we exploit the general framework of model-X knockoffs introduced recently in Cand`{e}s, Fan, Janson and Lv (2018), which is nonconventional for reproducible large-scale inference in that the framework is completely free of the use of p-values for significance testing, and suggest a new method of intertwined probabilistic factors decoupling (IPAD) for stable interpretable forecasting with knockoffs inference in high-dimensional models. The recipe of the method is constructing the knockoff variables by assuming a latent factor model that is exploited widely in economics and finance for the association structure of covariates. Our method and work are distinct from the existing literature in that we estimate the covariate distribution from data instead of assuming that it is known when constructing the knockoff variables, our procedure does not require any sample splitting, we provide theoretical justifications on the asymptotic false discovery rate control, and the theory for the power analysis is also established. Several simulation examples and the real data analysis further demonstrate that the newly suggested method has appealing finite-sample performance with desired interpretability and stability compared to some popularly used forecasting methods.
Recommendations
Cites work
- scientific article; zbMATH DE number 3624650 (Why is no real title available?)
- scientific article; zbMATH DE number 720689 (Why is no real title available?)
- scientific article; zbMATH DE number 765034 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- scientific article; zbMATH DE number 3021560 (Why is no real title available?)
- A One Covariate at a Time, Multiple Testing Approach to Variable Selection in High-Dimensional Linear Regression Models
- A knockoff filter for high-dimensional selective inference
- Asymptotic Confidence Regions for High-Dimensional Structured Sparsity
- Asymptotic Equivalence of Regularization Methods in Thresholded Parameter Space
- Confidence intervals for causal effects with invalid instruments by using two-stage hard thresholding with voting
- Controlling the false discovery rate via knockoffs
- Determining the Number of Factors in Approximate Factor Models
- Discovering the False Discovery Rate
- Double/debiased machine learning for treatment and structural parameters
- Eigenvalue ratio test for the number of factors
- Estimating false discovery proportion under arbitrary covariance dependence
- Exact and Approximate Stepdown Methods for Multiple Hypothesis Testing
- Forecasting using a large number of predictors: is Bayesian shrinkage a valid alternative to principal components?
- Goodness-of-Fit Tests for High Dimensional Linear Models
- High-dimensional classification using features annealed independence rules
- Impacts of high dimensionality in finite samples
- Inferential Theory for Factor Models of Large Dimensions
- Nonuniformity of p-values can occur early in diverging dimensions
- Panning for Gold: ‘Model-X’ Knockoffs for High Dimensional Controlled Variable Selection
- RANK: Large-Scale Inference With Graphical Nonlinear Knockoffs
- Random forests
- Sure independence screening for ultrahigh dimensional feature space. With discussion and authors' reply
- The control of the false discovery rate in multiple testing under dependency.
Cited in
(21)- Competition-based control of the false discovery proportion
- Model-X knockoffs for high-dimensional controlled variable selection under the proportional hazards model with heterogeneity parameter
- ARK: robust knockoffs inference with coupling
- A generalized knockoff procedure for FDR control in structural change detection
- A post-screening diagnostic study for ultrahigh dimensional data
- Reprint: Statistical inference for linear mediation models with high-dimensional mediators and application to studying stock reaction to COVID-19 pandemic
- Statistical inference for linear mediation models with high-dimensional mediators and application to studying stock reaction to COVID-19 pandemic
- Multiple competition-based FDR control and its application to peptide detection
- Null-free false discovery rate control using decoy permutations
- Reproducible learning for accelerated failure time models via deep knockoffs
- Model-free, monotone invariant and computationally efficient feature screening with data-adaptive threshold
- Reconciling model-X and doubly robust approaches to conditional independence testing
- Feature screening and FDR control with knockoff features for ultrahigh-dimensional right-censored data
- Variable selection in latent variable models via knockoffs: an application to international large-scale assessment in education
- Uniform knockoff filter for high-dimensional controlled graph recovery
- Overview of research advance for knockoff methods
- Metropolized Knockoff Sampling
- Threshold Selection in Feature Screening for Error Rate Control
- Ah-knockoff: false discovery rate control in high-dimensional additive hazards models
- CoxKnockoff: controlled feature selection for the Cox model using knockoffs
- Asymptotic Theory of Eigenvectors for Random Matrices With Diverging Spikes
This page was built for publication: IPAD: stable interpretable forecasting with knockoffs inference
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5146036)
