Kernel Knockoffs Selection for Nonparametric Additive Models
From MaRDI portal
Abstract: Thanks to its fine balance between model flexibility and interpretability, the nonparametric additive model has been widely used, and variable selection for this type of model has been frequently studied. However, none of the existing solutions can control the false discovery rate (FDR) unless the sample size tends to infinity. The knockoff framework is a recent proposal that can address this issue, but few knockoff solutions are directly applicable to nonparametric models. In this article, we propose a novel kernel knockoffs selection procedure for the nonparametric additive model. We integrate three key components: the knockoffs, the subsampling for stability, and the random feature mapping for nonparametric function approximation. We show that the proposed method is guaranteed to control the FDR for any sample size, and achieves a power that approaches one as the sample size tends to infinity. We demonstrate the efficacy of our method through intensive simulations and comparisons with the alternative solutions. Our proposal thus makes useful contributions to the methodology of nonparametric variable selection, FDR-based inference, as well as knockoffs.
Cites work
- scientific article; zbMATH DE number 5957408 (Why is no real title available?)
- scientific article; zbMATH DE number 45848 (Why is no real title available?)
- scientific article; zbMATH DE number 47282 (Why is no real title available?)
- scientific article; zbMATH DE number 720689 (Why is no real title available?)
- scientific article; zbMATH DE number 1944029 (Why is no real title available?)
- scientific article; zbMATH DE number 1906319 (Why is no real title available?)
- scientific article; zbMATH DE number 6734253 (Why is no real title available?)
- A knockoff filter for high-dimensional selective inference
- Additive regression and other nonparametric models
- Bootstrap inference for network construction with an application to a breast cancer microarray study
- Component selection and smoothing in multivariate nonparametric regression
- Controlling Variable Selection by the Addition of Pseudovariables
- Controlling the false discovery rate via knockoffs
- Deep knockoffs
- Derandomizing Knockoffs
- Empirical Bayes Analysis of a Microarray Experiment
- False discoveries occur early on the Lasso path
- High-dimensional Ising model selection using \(\ell _{1}\)-regularized logistic regression
- High-dimensional additive modeling
- High-dimensional regression with noisy and missing data: provable guarantees with nonconvexity
- Kernel Ordinary Differential Equations
- Large-scale multiple testing under dependence
- Minimax Rates of Estimation for High-Dimensional Linear Regression Over $\ell_q$-Balls
- Minimax optimal rates of estimation in high dimensional additive models
- Minimax-optimal rates for sparse additive models over kernel classes via convex programming
- Model-Free Variable Selection
- Oracle and Adaptive Compound Decision Rules for False Discovery Rate Control
- Panning for Gold: ‘Model-X’ Knockoffs for High Dimensional Controlled Variable Selection
- RANK: Large-Scale Inference With Graphical Nonlinear Knockoffs
- Robust inference with knockoffs
- Sparse additive models
- Sparsity in multiple kernel learning
- Stability Selection
- The Optimal Discovery Procedure: A New Approach to Simultaneous Significance Testing
- Theory of Reproducing Kernels
- Variable selection in nonparametric additive models
Cited in
(6)- Revisiting feature selection for linear models with FDR and power guarantees
- FDR control and power analysis for high-dimensional logistic regression via Stabkoff
- Overview of research advance for knockoff methods
- kko
- Kernel selection in nonparametric regression
- Stab-GKnock: controlled variable selection for partially linear models using generalized knockoffs
This page was built for publication: Kernel Knockoffs Selection for Nonparametric Additive Models
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q115586)
