High-dimensional additive modeling
From MaRDI portal
Abstract: We propose a new sparsity-smoothness penalty for high-dimensional generalized additive models. The combination of sparsity and smoothness is crucial for mathematical theory as well as performance for finite-sample data. We present a computationally efficient algorithm, with provable numerical convergence properties, for optimizing the penalized likelihood. Furthermore, we provide oracle results which yield asymptotic optimality of our estimator for high dimensional but sparse additive models. Finally, an adaptive version of our sparsity-smoothness penalized approach yields large additional performance gains.
Recommendations
Cites work
- scientific article; zbMATH DE number 49190 (Why is no real title available?)
- scientific article; zbMATH DE number 700016 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- scientific article; zbMATH DE number 1420699 (Why is no real title available?)
- scientific article; zbMATH DE number 3229907 (Why is no real title available?)
- A Bennett concentration inequality and its application to suprema of empirical processes
- Aggregation and Sparsity Via ℓ1 Penalized Least Squares
- Blockwise sparse regression
- Boosting With theL2Loss
- Boosting algorithms: regularization, prediction and model fitting
- Component selection and smoothing in multivariate nonparametric regression
- High-dimensional generalized linear models and the lasso
- High-dimensional graphs and variable selection with the Lasso
- Lasso-type recovery of sparse representations for high-dimensional data
- Model Selection and Estimation in Regression with Grouped Variables
- Model selection for regression on a random design
- Nonparametric and semiparametric models.
- Persistene in high-dimensional linear predictor-selection and the virtue of overparametrization
- Relaxed Lasso
- Simultaneous analysis of Lasso and Dantzig selector
- Sparsity oracle inequalities for the Lasso
- The Adaptive Lasso and Its Oracle Properties
- The Dantzig selector: statistical estimation when \(p\) is much larger than \(n\). (With discussions and rejoinder).
- The Group Lasso for Logistic Regression
- The sparsity and bias of the LASSO selection in high-dimensional linear regression
- Variable selection in high-dimensional linear models: partially faithful distributions and the PC-simple algorithm
- Weak convergence and empirical processes. With applications to statistics
Cited in
(only showing first 100 items - show all)- Statistical inference in sparse high-dimensional additive models
- Variable selection for high dimensional Gaussian copula regression model: an adaptive hypothesis testing procedure
- On density and regression estimation with incomplete data
- Locally adaptive sparse additive quantile regression model with TV penalty
- Spike-and-slab priors for function selection in structured additive regression models
- Regression with stagewise minimization on risk function
- Spectrally Sparse Nonparametric Regression via Elastic Net Regularized Smoothers
- Functional additive regression
- Robust sparse functional regression model
- Partially linear structure selection in Cox models with varying coefficients
- Approximate large-scale Bayesian spatial modeling with application to quantitative magnetic resonance imaging
- Rates of contraction with respect to \(L_2\)-distance for Bayesian nonparametric regression
- A reluctant additive model framework for interpretable nonlinear individualized treatment rules
- Tuning parameters in random forests
- Fast learning rate of non-sparse multiple kernel learning and optimal regularization strategies
- Block-wise primal-dual algorithms for large-scale doubly penalized ANOVA modeling
- Improving the prediction performance of the Lasso by subtracting the additive structural noises
- Sparse additive ordinary differential equations for dynamic gene regulatory network modeling
- Gradient-based optimization for regression in the functional tensor-train format
- Empirical Bayes oracle uncertainty quantification for regression
- Lag selection in stochastic additive models
- Multifold Cross-Validation Model Averaging for Generalized Additive Partial Linear Models
- Interquantile shrinkage and variable selection in quantile regression
- P-splines with an \(\ell_1\) penalty for repeated measures
- Non-asymptotic oracle inequalities for the Lasso and group Lasso in high dimensional logistic model
- Learning non-parametric basis independent models from point queries via low-rank methods
- Metamodel construction for sensitivity analysis
- scientific article; zbMATH DE number 7370581 (Why is no real title available?)
- Semiparametric model average prediction in panel data analysis
- Oracle inequalities for sparse additive quantile regression in reproducing kernel Hilbert space
- Monotone splines Lasso
- Two stage smoothing in additive models with missing covariates
- Sparse additive models
- Nonparametric independence screening via favored smoothing bandwidth
- A uniform framework for the combination of penalties in generalized structured models
- Variable selection for functional additive models and an application to the population age structure data
- Identification of partially linear structure in additive models with an application to gene expression prediction from sequences
- Rank reduction for high-dimensional generalized additive models
- Sparse nonparametric model for regression with functional covariate
- Minimax-optimal nonparametric regression in high dimensions
- Martingale difference correlation and its use in high-dimensional variable screening
- Iterative adaptive robust variable selection in nomparametric additive models
- Semiparametric regression models with additive nonparametric components and high dimensional parametric components
- Coordinatewise Gaussianization: Theories and Applications
- Nonparametric variable selection and its application to additive models
- Robust feature screening for elliptical copula regression model
- A continuous analogue of the tensor-train decomposition
- High dimensional single index models
- Additive models with trend filtering
- Penalized estimation of high-dimensional models under a generalized sparsity condition
- Sure independence screening in ultrahigh dimensional generalized additive models
- Cross-Fitted Residual Regression for High-Dimensional Heteroscedasticity Pursuit
- Nonparametric independence screening for ultra-high-dimensional longitudinal data under additive models
- RCV-based error density estimation in the ultrahigh dimensional additive model
- Variable selection in functional regression models: a review
- Subgroup analysis for longitudinal data via semiparametric additive mixed effects model
- Grouped variable selection with discrete optimization: computational and statistical perspectives
- SCAD-penalized regression in additive partially linear proportional hazards models with an ultra-high-dimensional linear part
- Variable selection in partial linear regression with functional covariate
- Testing for additivity in non-parametric regression
- A sequential approach to feature selection in high-dimensional additive models
- Additive regression splines with total variation and non negative garrote penalties
- Irrational Exuberance: Correcting Bias in Probability Estimates
- scientific article; zbMATH DE number 7750672 (Why is no real title available?)
- Least angle regression for model selection
- A kernel-type regression estimator for NMAR response variables with applications to classification
- Estimation by polynomial splines with variable selection in additive Cox models
- Transductive versions of the Lasso and the Dantzig selector
- Bayesian quantile regression for partially linear additive models
- Binacox: automatic cut‐point detection in high‐dimensional Cox model with applications in genetics
- SCAD-penalised generalised additive models with non-polynomial dimensionality
- Statistical inference in compound functional models
- Generalization of constraints for high dimensional regression problems
- Extreme eigenvalues of nonlinear correlation matrices with applications to additive models
- Component selection in the additive regression model
- Impact of subsampling and tree depth on random forests
- PAC-Bayesian estimation and prediction in sparse additive models
- Feature screening in ultrahigh-dimensional additive Cox model
- A unified penalized method for sparse additive quantile models: an RKHS approach
- Nonparametric Statistics and High/Infinite Dimensional Data
- Measures of Uncertainty for Shrinkage Model Selection
- Estimation and inference in generalized additive coefficient models for nonlinear interactions with high-dimensional covariates
- hgam
- RANK: Large-Scale Inference With Graphical Nonlinear Knockoffs
- Doubly penalized estimation in additive regression with high-dimensional data
- Regularized estimation for the least absolute relative error models with a diverging number of covariates
- On histogram-based regression and classification with incomplete data
- Semiparametric Ultra-High Dimensional Model Averaging of Nonlinear Dynamic Time Series
- Consistency of support vector machines using additive kernels for additive models
- Multiple Kernel Learningの学習理論
- Efficient functional Lasso kernel smoothing for high-dimensional additive regression
- Data-adaptive additive modeling
- Robust estimation of heterogeneous treatment effects using electronic health record data
- Univariate measurement error selection likelihood for variable selection of additive model
- Bayesian nonlinear model selection for gene regulatory networks
- COBRA: a combined regression strategy
- Refined generalization bounds of gradient learning over reproducing kernel Hilbert spaces
- Nonparametric distributed learning under general designs
- DDAC-SpAM: A Distributed Algorithm for Fitting High-dimensional Sparse Additive Models with Feature Division and Decorrelation
- On the uniform convergence of empirical norms and inner products, with application to causal inference
This page was built for publication: High-dimensional additive modeling
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1043712)
