High-dimensional additive modeling
From MaRDI portal
Abstract: We propose a new sparsity-smoothness penalty for high-dimensional generalized additive models. The combination of sparsity and smoothness is crucial for mathematical theory as well as performance for finite-sample data. We present a computationally efficient algorithm, with provable numerical convergence properties, for optimizing the penalized likelihood. Furthermore, we provide oracle results which yield asymptotic optimality of our estimator for high dimensional but sparse additive models. Finally, an adaptive version of our sparsity-smoothness penalized approach yields large additional performance gains.
Recommendations
Cites work
- A Bennett concentration inequality and its application to suprema of empirical processes
- Aggregation and Sparsity Via ℓ1 Penalized Least Squares
- Blockwise sparse regression
- Boosting algorithms: regularization, prediction and model fitting
- Boosting With theL2Loss
- Component selection and smoothing in multivariate nonparametric regression
- High-dimensional generalized linear models and the lasso
- High-dimensional graphs and variable selection with the Lasso
- scientific article; zbMATH DE number 49190 (Why is no real title available?)
- scientific article; zbMATH DE number 700016 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- scientific article; zbMATH DE number 1420699 (Why is no real title available?)
- scientific article; zbMATH DE number 3229907 (Why is no real title available?)
- Lasso-type recovery of sparse representations for high-dimensional data
- Model Selection and Estimation in Regression with Grouped Variables
- Model selection for regression on a random design
- Nonparametric and semiparametric models.
- Persistene in high-dimensional linear predictor-selection and the virtue of overparametrization
- Relaxed Lasso
- Simultaneous analysis of Lasso and Dantzig selector
- Sparsity oracle inequalities for the Lasso
- The Adaptive Lasso and Its Oracle Properties
- The Dantzig selector: statistical estimation when \(p\) is much larger than \(n\). (With discussions and rejoinder).
- The Group Lasso for Logistic Regression
- The sparsity and bias of the LASSO selection in high-dimensional linear regression
- Variable selection in high-dimensional linear models: partially faithful distributions and the PC-simple algorithm
- Weak convergence and empirical processes. With applications to statistics
Cited in
(only showing first 100 items - show all)- Regularizing double machine learning in partially linear endogenous models
- Kernel Knockoffs Selection for Nonparametric Additive Models
- Reluctant generalized additive modeling
- Flexible and Interpretable Models for Survival Data
- Interquantile shrinkage and variable selection in quantile regression
- P-splines with an \(\ell_1\) penalty for repeated measures
- Penalized likelihood and Bayesian function selection in regression models
- Fast Bayesian model assessment for nonparametric additive regression
- Monotone splines Lasso
- Nonparametric independence screening via favored smoothing bandwidth
- Fast learning rate of non-sparse multiple kernel learning and optimal regularization strategies
- Regularized estimation for the least absolute relative error models with a diverging number of covariates
- Variable selection for high dimensional Gaussian copula regression model: an adaptive hypothesis testing procedure
- Sparse learning of the disease severity score for high-dimensional data
- Regression with stagewise minimization on risk function
- Improving the prediction performance of the Lasso by subtracting the additive structural noises
- Oracle inequalities for sparse additive quantile regression in reproducing kernel Hilbert space
- Fixed and random effects selection in nonparametric additive mixed models
- A dimension reduction based approach for estimation and variable selection in partially linear single-index models with high-dimensional covariates
- PAC-Bayesian estimation and prediction in sparse additive models
- Dimension reduction and variable selection in case control studies via regularized likelihood optimization
- A continuous analogue of the tensor-train decomposition
- Empirical Bayes oracle uncertainty quantification for regression
- Learning general sparse additive models from point queries in high dimensions
- On histogram-based regression and classification with incomplete data
- Penalized kernel quantile regression for varying coefficient models
- Variable selection in functional regression models: a review
- Interpretable machine learning: fundamental principles and 10 grand challenges
- Nonparametric variable screening for multivariate additive models
- Nonparametric and high-dimensional functional graphical models
- RCV-based error density estimation in the ultrahigh dimensional additive model
- Extreme eigenvalues of nonlinear correlation matrices with applications to additive models
- Nonparametric variable selection and its application to additive models
- GRID: a variable selection and structure discovery method for high dimensional nonparametric regression
- Nonparametric distributed learning under general designs
- Composite quantile regression for ultra-high dimensional semiparametric model averaging
- A sequential approach to feature selection in high-dimensional additive models
- Robust feature screening for elliptical copula regression model
- Rank reduction for high-dimensional generalized additive models
- Additive models with trend filtering
- Asymptotic properties of concave \(L_1\)-norm group penalties
- Feature screening for ultrahigh-dimensional additive logistic models
- Information based complexity for high dimensional sparse functions
- Gradient-based optimization for regression in the functional tensor-train format
- Nonparametric screening under conditional strictly convex loss for ultrahigh dimensional sparse data
- hgam
- Sure independence screening in ultrahigh dimensional generalized additive models
- Multidimensional linear functional estimation in sparse Gaussian models and robust estimation of the mean
- Approximate large-scale Bayesian spatial modeling with application to quantitative magnetic resonance imaging
- Rates of contraction with respect to \(L_2\)-distance for Bayesian nonparametric regression
- Doubly penalized estimation in additive regression with high-dimensional data
- Two stage smoothing in additive models with missing covariates
- Structured estimation for the nonparametric Cox model
- Minimax-optimal nonparametric regression in high dimensions
- High dimensional single index models
- Sparse high-dimensional varying coefficient model: nonasymptotic minimax study
- A unified penalized method for sparse additive quantile models: an RKHS approach
- A uniform framework for the combination of penalties in generalized structured models
- PAC-Bayesian risk bounds for group-analysis sparse regression by exponential weighting
- Statistical inference in compound functional models
- On the uniform convergence of empirical norms and inner products, with application to causal inference
- SCAD-penalized regression in additive partially linear proportional hazards models with an ultra-high-dimensional linear part
- Model structure selection in single-index-coefficient regression models
- Nonparametric inference for additive models estimated via simplified smooth backfitting
- An introduction to recent advances in high/infinite dimensional statistics
- COBRA: a combined regression strategy
- Nonparametric Statistics and High/Infinite Dimensional Data
- Bayesian nonlinear model selection for gene regulatory networks
- Sparse nonparametric model for regression with functional covariate
- Partially linear structure selection in Cox models with varying coefficients
- Component selection in the additive regression model
- Identification of partially linear structure in additive models with an application to gene expression prediction from sequences
- scientific article; zbMATH DE number 6670732 (Why is no real title available?)
- Non-asymptotic oracle inequalities for the Lasso and group Lasso in high dimensional logistic model
- SCAD-penalised generalised additive models with non-polynomial dimensionality
- RANK: Large-Scale Inference With Graphical Nonlinear Knockoffs
- A semiparametric model for matrix regression
- Variable selection in partial linear regression with functional covariate
- Fast learning rate of multiple kernel learning: trade-off between sparsity and smoothness
- Polynomial spline estimation for generalized varying coefficient partially linear models with a diverging number of components
- Simultaneous confidence bands for sequential autoregressive fitting
- Correlated variables in regression: clustering and sparse estimation
- Consistency of support vector machines using additive kernels for additive models
- Semiparametric regression models with additive nonparametric components and high dimensional parametric components
- Transductive versions of the Lasso and the Dantzig selector
- Nonparametric independence screening for ultra-high-dimensional longitudinal data under additive models
- On density and regression estimation with incomplete data
- Metamodel construction for sensitivity analysis
- Tuning parameters in random forests
- Impact of subsampling and tree depth on random forests
- Sparse additive models
- Semiparametric model average prediction in panel data analysis
- Variable selection in infinite-dimensional problems
- Error variance estimation in ultrahigh-dimensional additive models
- CAM: causal additive models, high-dimensional order search and penalized regression
- High-dimensional Bayesian inference in nonparametric additive models
- Spike-and-slab priors for function selection in structured additive regression models
- Penalized estimation of high-dimensional models under a generalized sparsity condition
- Feature screening in ultrahigh-dimensional additive Cox model
- Semiparametric Ultra-High Dimensional Model Averaging of Nonlinear Dynamic Time Series
This page was built for publication: High-dimensional additive modeling
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1043712)
