Sparse additive models
From MaRDI portal
Abstract: We present a new class of methods for high-dimensional nonparametric regression and classification called sparse additive models (SpAM). Our methods combine ideas from sparse linear modeling and additive nonparametric regression. We derive an algorithm for fitting the models that is practical and effective even when the number of covariates is larger than the sample size. SpAM is closely related to the COSSO model of Lin and Zhang (2006), but decouples smoothing and sparsity, enabling the use of arbitrary nonparametric smoothers. An analysis of the theoretical properties of SpAM is given. We also study a greedy estimator that is a nonparametric version of forward stepwise regression. Empirical results on synthetic and real data are presented, showing that SpAM can be effective in fitting sparse nonparametric models in high dimensional data.
Recommendations
Cited in
(only showing first 100 items - show all)- Parsimonious additive models
- High-dimensional additive modeling
- Distribution-free predictive inference for regression
- Kernel Knockoffs Selection for Nonparametric Additive Models
- A lava attack on the recovery of sums of dense and sparse signals
- A simple measure of conditional dependence
- A projection-based conditional dependence measure with applications to high-dimensional undirected graphical models
- Flexible and Interpretable Models for Survival Data
- Multiresolution functional ANOVA for large-scale, many-input computer experiments
- Interquantile shrinkage and variable selection in quantile regression
- P-splines with an \(\ell_1\) penalty for repeated measures
- Penalized likelihood and Bayesian function selection in regression models
- Fast Bayesian model assessment for nonparametric additive regression
- Monotone splines Lasso
- Logitboost autoregressive networks
- Structured variable selection via prior-induced hierarchical penalty functions
- Variable selection for high dimensional Gaussian copula regression model: an adaptive hypothesis testing procedure
- Sparse learning of the disease severity score for high-dimensional data
- Error analysis for coefficient-based regularized regression in additive models
- Regression with stagewise minimization on risk function
- Improving the prediction performance of the Lasso by subtracting the additive structural noises
- Variable selection of high-dimensional non-parametric nonlinear systems by derivative averaging to avoid the curse of dimensionality
- Testing if a nonlinear system is additive or not
- Oracle inequalities for sparse additive quantile regression in reproducing kernel Hilbert space
- Feature screening for nonparametric and semiparametric models with ultrahigh-dimensional covariates
- New inference concepts for analysing complex data
- Sparse estimation for functional semiparametric additive models
- PAC-Bayesian estimation and prediction in sparse additive models
- Empirical Bayes oracle uncertainty quantification for regression
- Learning general sparse additive models from point queries in high dimensions
- Penalized kernel quantile regression for varying coefficient models
- Sparse mixture models inspired by ANOVA decompositions
- Interpretable machine learning: fundamental principles and 10 grand challenges
- Nonparametric variable screening for multivariate additive models
- Generalization bounds for sparse random feature expansions
- Nonparametric and high-dimensional functional graphical models
- RCV-based error density estimation in the ultrahigh dimensional additive model
- A joint estimation approach to sparse additive ordinary differential equations
- GRID: a variable selection and structure discovery method for high dimensional nonparametric regression
- Consistent group selection with Bayesian high dimensional modeling
- Estimation of undirected graph with finite mixture of nonparanormal distribution
- A sequential approach to feature selection in high-dimensional additive models
- Variable selection for fixed effects varying coefficient models
- Sparse model identification and learning for ultra-high-dimensional additive partially linear models
- Rank reduction for high-dimensional generalized additive models
- Additive models with trend filtering
- Sure independence screening in ultrahigh dimensional generalized additive models
- Rates of contraction with respect to \(L_2\)-distance for Bayesian nonparametric regression
- Doubly penalized estimation in additive regression with high-dimensional data
- Two stage smoothing in additive models with missing covariates
- Minimax-optimal nonparametric regression in high dimensions
- High dimensional single index models
- A unified penalized method for sparse additive quantile models: an RKHS approach
- PAC-Bayesian risk bounds for group-analysis sparse regression by exponential weighting
- Statistical inference in compound functional models
- Copulas in machine learning
- Nonparametric sparsity and regularization
- RANK: Large-Scale Inference With Graphical Nonlinear Knockoffs
- ABC–CDE: Toward Approximate Bayesian Computation With Complex High-Dimensional Data and Limited Simulations
- Additive nonparametric regression on principal components
- Profiled adaptive elastic-net procedure for partially linear models with high-dimensional covar\-i\-ates
- Semiparametric regression models with additive nonparametric components and high dimensional parametric components
- Nonparametric independence screening for ultra-high-dimensional longitudinal data under additive models
- Bayesian neural networks for selection of drug sensitive genes
- Metamodel construction for sensitivity analysis
- Error variance estimation in ultrahigh-dimensional additive models
- Penalized estimation of high-dimensional models under a generalized sparsity condition
- Feature screening in ultrahigh-dimensional additive Cox model
- Bayesian regression trees for high-dimensional prediction and variable selection
- Nonsparse learning with latent variables
- Sparse additive machine with ramp loss
- Sparse tensor additive regression
- Hypothesis testing in large-scale functional linear regression
- Univariate measurement error selection likelihood for variable selection of additive model
- Additive regression splines with total variation and non negative garrote penalties
- Improved Estimation of High-dimensional Additive Models Using Subspace Learning
- Hierarchical Total Variations and Doubly Penalized ANOVA Modeling for Multivariate Nonparametric Regression
- Stochastic compositional gradient descent: algorithms for minimizing compositions of expected-value functions
- Bayesian Model Selection in Additive Partial Linear Models Via Locally Adaptive Splines
- Sparse group lasso for multiclass functional logistic regression models
- Sure independence screening for analyzing supersaturated designs
- Asymptotic theory of _1-regularized PDE identification from a single noisy trajectory
- Ultrahigh dimensional feature screening for additive model with multivariate response
- Additive model selection
- Functional Horseshoe Priors for Subspace Shrinkage
- Kernel meets sieve: post-regularization confidence bands for sparse additive model
- Binarsity: a penalization for one-hot encoded features in linear supervised learning
- Layer-wise learning strategy for nonparametric tensor product smoothing spline regression and graphical models
- Global sensitivity analysis with dependence measures
- Bayesian additive machine: classification with a semiparametric discriminant function
- Partially Linear Functional Additive Models for Multivariate Functional Data
- Algorithms for learning sparse additive models with interactions in high dimensions
- Sparse additive regression on a regular lattice
- High-Dimensional Feature Selection by Feature-Wise Kernelized Lasso
- Refined generalization bounds of gradient learning over reproducing kernel Hilbert spaces
- Minimax-optimal rates for sparse additive models over kernel classes via convex programming
- Additive regression trees and smoothing splines -- predictive modeling and interpretation in data mining
- scientific article; zbMATH DE number 2232736 (Why is no real title available?)
- Spike-and-Slab Group Lassos for Grouped Regression and Sparse Generalized Additive Models
- AdaBoost Semiparametric Model Averaging Prediction for Multiple Categories
This page was built for publication: Sparse additive models
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4632616)
