Sparse Partial Least Squares Regression for Simultaneous Dimension Reduction and Variable Selection

DOI10.1111/j.1467-9868.2009.00723.xzbMath1411.62184OpenAlexW2170917242WikidataQ33608112 ScholiaQ33608112MaRDI QIDQ4632618

Hyonho Chun

Publication date: 30 April 2019

Published in: Journal of the Royal Statistical Society Series B: Statistical Methodology (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1111/j.1467-9868.2009.00723.x

zbMATH Keywords

partial least squaresdimension reductionsparsitygene expressionmicroarraysLassochromatin immuno-precipitationvariable and feature selection

Mathematics Subject Classification ID

Linear regression; mixed models (62J05) Applications of statistics to biology and medical sciences; meta analysis (62P10)

Related Items (64)

Summaries of three keynote lectures at the SAE – 2018 ⋮ Automatic odor prediction for electronic nose ⋮ Projection correlation between scalar and vector variables and its use in feature screening with multi-response data ⋮ Sparse functional partial least squares regression with a locally sparse slope function ⋮ A sequential test for variable selection in high dimensional complex data ⋮ Dimension-wise sparse low-rank approximation of a matrix with application to variable selection in high-dimensional integrative analyzes of association ⋮ Optimal learning rates for kernel partial least squares ⋮ High-dimensional regression with potential prior information on variable importance ⋮ Penalized principal logistic regression for sparse sufficient dimension reduction ⋮ Simultaneous dimension reduction and variable selection in modeling high dimensional data ⋮ Nonparametric independence screening for ultra-high-dimensional longitudinal data under additive models ⋮ Revisiting useful approaches to data-rich macroeconomic forecasting ⋮ Bayesian sparse reduced rank multivariate regression ⋮ High-dimensional multivariate posterior consistency under global-local shrinkage priors ⋮ An enhanced random forest with canonical partial least squares for classification ⋮ Sparse principal component regression with adaptive loading ⋮ Large-scale multivariate sparse regression with applications to UK Biobank ⋮ Combining clustering of variables and feature selection using random forests ⋮ Simultaneous selection of predictors and responses for high dimensional multivariate linear regression ⋮ Envelope-based sparse partial least squares ⋮ On the oracle property of a generalized adaptive elastic-net for multivariate linear regression with a diverging number of parameters ⋮ Machine learning-based surrogate modeling for data-driven optimization: a comparison of subset selection for regression techniques ⋮ Sparse wavelet estimation in quantile regression with multiple functional predictors ⋮ Supervised clustering of variables ⋮ A Review of Envelope Models ⋮ Penalized partial least square applied to structured data ⋮ Temporal prediction of future state occupation in a multistate model from high-dimensional baseline covariates via pseudo-value regression ⋮ Pairwise directions estimation for multivariate response regression data ⋮ [HDDA sparse subspace constrained partial least squares] ⋮ Convergence properties of data augmentation algorithms for high-dimensional robit regression ⋮ The EAS approach to variable selection for multivariate response data in high-dimensional settings ⋮ Scalable Model-Free Feature Screening via Sliced-Wasserstein Dependency ⋮ Risk spillover network structure learning for correlated financial assets: a directed acyclic graph approach ⋮ On model-based clustering of directional data with heavy tails ⋮ Elegant robustification of sparse partial least squares by robustness-inducing transformations ⋮ Low-Rank Regression Models for Multiple Binary Responses and their Applications to Cancer Cell-Line Encyclopedia Data ⋮ Sparse dimension reduction based on energy and ball statistics ⋮ Convergence rate analysis of proximal iteratively reweighted \(\ell_1\) methods for \(\ell_p\) regularization problems ⋮ Envelopes and principal component regression ⋮ Envelope-based sparse reduced-rank regression for multivariate linear model ⋮ Unnamed Item ⋮ SNP selection for predicting a quantitative trait ⋮ Bayesian Sparse Partial Least Squares ⋮ Sparse alternatives to ridge regression: a random effects approach ⋮ Partial least squares prediction in high-dimensional regression ⋮ News-based forecasts of macroeconomic indicators: a semantic path model for interpretable predictions ⋮ Sparse wavelet regression with multiple predictive curves ⋮ A multi-loss super regression learner (MSRL) with application to survival prediction using proteomics ⋮ Efficient reconstructions of Common Era climate via integrated nested Laplace approximations ⋮ Sparse factor regression via penalized maximum likelihood estimation ⋮ Prediction risk for the horseshoe regression ⋮ Signal extraction approach for sparse multivariate response regression ⋮ Adaptive sparse group LASSO in quantile regression ⋮ Sparse principal component regression via singular value decomposition approach ⋮ Variable selection models based on multiple imputation with an application for predicting median effective dose and maximum effect ⋮ Correlated Component Regression: Re-thinking Regression in the Presence of Near Collinearity ⋮ Ultra high-dimensional multivariate posterior contraction rate under shrinkage priors ⋮ Comparing six shrinkage estimators with large sample theory and asymptotically optimal prediction intervals ⋮ PLS for Big Data: a unified parallel algorithm for regularised group PLS ⋮ Variable selection in high-dimensional sparse multiresponse linear regression models ⋮ Outlyingness: which variables contribute most? ⋮ On Cross-Validation for Sparse Reduced Rank Regression ⋮ Variable Selection Methods in High-dimensional Regression—A Simulation Study ⋮ Extreme partial least-squares

Uses Software

• R
• spls

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• An overview on the shrinkage properties of partial least squares regression
• A limit theorem for the norm of random matrices
• Partial least squares algorithm yields shrinkage estimators
• Least angle regression. (With discussion)
• Marginal asymptotics for the ``large \(p\), small \(n\) paradigm: with applications to microarray data
• Adapting to unknown sparsity by controlling the false discovery rate
• On Interchanging Limits and Integrals
• Partial Least Squares: A First‐order Analysis
• A Criterion for Stepwise Regression
• Comparison of Prediction Methods When Only a Few Components are Relevant
• The Peculiar Shrinkage Properties of Partial Least Squares Regression
• Partial Least Squares Estimator for Single-Index Models
• A Statistical View of Some Chemometrics Regression Tools
• Model Reduction for Prediction in Regression Models
• Regularization and Variable Selection Via the Elastic Net
• Prediction by Supervised Principal Components
• A Direct Formulation for Sparse PCA Using Semidefinite Programming

This page was built for publication: Sparse Partial Least Squares Regression for Simultaneous Dimension Reduction and Variable Selection