Functional linear regression that's interpretable

DOI10.1214/08-AOS641MaRDI QIDQ834333zbMATH OpenOpenAlexFDO

Authors Gareth M. James, Jing Wang, Ji Zhu

Publication date 19 August 2009

Published in The Annals of Statistics (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/0908.2918

zbMATH Keywords

lassofunctional linear regressionDantzig selectorCanadian weather datainterpretable regression

Mathematics Subject Classification ID

Nonparametric regression and quantile regression (62G08) Linear regression; mixed models (62J05) Linear inference, regression (62J99) Generalized linear models (logistic models) (62J12) Applications of statistics to environmental and related topics (62P12)

Abstract: Regression models to relate a scalar $Y$ to a functional predictor $X(t)$ are becoming increasingly common. Work in this area has concentrated on estimating a coefficient function, $$, with $Y$ related to $X(t)$ through $$. Regions where $$ correspond to places where there is a relationship between $X(t)$ and $Y$. Alternatively, points where $$ indicate no relationship. Hence, for interpretation purposes, it is desirable for a regression procedure to be capable of producing estimates of $$ that are exactly zero over regions with no apparent relationship and have simple structures over the remaining regions. Unfortunately, most fitting procedures result in an estimate for $$ that is rarely exactly zero and has unnatural wiggles making the curve hard to interpret. In this article we introduce a new approach which uses variable selection ideas, applied to various derivatives of $$, to produce estimates that are both interpretable, flexible and accurate. We call our method "Functional Linear Regression That's Interpretable" (FLiRTI) and demonstrate it on simulated and real-world data sets. In addition, non-asymptotic theoretical bounds on the estimation error are presented. The bounds provide strong theoretical motivation for our approach.

Recommendations

• Functional linear regression with derivatives
• Varying-coefficient functional linear regression
• Interpretable sparse SIR for functional data
• scientific article; zbMATH DE number 2015204
• Functional linear regression with points of impact

Cites work

• scientific article; zbMATH DE number 845714 (Why is no real title available?)
• A Statistical View of Some Chemometrics Regression Tools
• A generalized Dantzig selector with shrinkage tuning
• Applied functional data analysis. Methods and case studies
• Asymptotic Confidence Regions for Kernel Smoothing of a Varying-Coefficient Model with Longitudinal Data
• Atomic Decomposition by Basis Pursuit
• Curves discrimination: a nonparametric functional approach
• DASSO: Connections Between the Dantzig Selector and Lasso
• Decoding by Linear Programming
• Functional Adaptive Model Estimation
• Functional data analysis.
• Functional linear discriminant analysis for irregularly sampled curves
• Generalized Linear Models with Functional Predictors
• Generalized functional linear models
• Least angle regression. (With discussion)
• Longitudinal data analysis using generalized linear models
• Multivariate statistical modelling based on generalized linear models. With contributions by Wolfgang Hennevogl
• Nonparametric smoothing estimates of time-varying coefficient models with longitudinal data
• Regression Analysis for a Functional Response
• Regularization and Variable Selection Via the Elastic Net
• Semiparametric and Nonparametric Regression Analysis of Longitudinal Data
• Sparsity and Smoothness Via the Fused Lasso
• The Dantzig selector: statistical estimation when \(p\) is much larger than \(n\). (With discussions and rejoinder).
• The functional nonparametric model and applications to spectrometric data
• Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
• Variable inclusion and shrinkage algorithms

Cited in

(91)

• Penalized and Constrained Optimization: An Application to High-Dimensional Website Advertising
• A novel framework for joint sparse clustering and alignment of functional data
• Smooth and locally sparse estimation for multiple-output functional linear regression
• Sparse clustering of functional data
• Functional Principal Component Regression and Functional Partial Least‐squares Regression: An Overview and a Comparative Study
• An adaptive group Lasso approach for domain selection in functional generalized linear models
• A faster U-statistic for testing independence in the functional linear models
• Sparse functional partial least squares regression with a locally sparse slope function
• Functional linear regression with truncated signatures
• Estimation and testing for partially functional linear errors-in-variables models
• The structured elastic net for quantile regression and support vector classification
• A semiparametric change-point regression model for longitudinal observations
• Functional regression via variational Bayes
• Local wavelet-vaguelette-based functional classification of gene expression data
• Regularised forecasting via smooth-rough partitioning of the regression coefficients
• Identification of local sparsity and variable selection for varying coefficient additive hazards models
• Variable selection in classification for multivariate functional data
• A Functional Information Criterion for Region Selection in Functional Linear Models
• Selection of time instants and intervals with support vector regression for multivariate functional data
• Variable selection in multivariate linear models for functional data via sparse regularization
• Estimation in functional lagged regression
• Interpretable functional principal component analysis
• Time-varying correlation structure estimation and local-feature detection for spatio-temporal data
• Bayesian functional linear regression with sparse step functions
• Adaptive estimation in circular functional linear models
• Interpretable dimension reduction for classifying functional data
• Functional linear regression with points of impact
• Penalized relative error estimation of functional multiplicative regression models with locally sparse properties
• PCA-based estimation for functional linear regression with functional responses
• The functional linear array model
• Learning bounds of ERM principle for sequences of time-dependent samples
• Smooth LASSO estimator for the function-on-function linear regression model
• Truncated estimation in functional generalized linear regression models
• Smoothly adaptively centered ridge estimator
• Functional linear regression for functional response via sparse basis selection
• Linear Regression Models for Functional Data
• Regularized 3D functional regression for brain image data via Haar wavelets
• Robust penalized estimators for functional linear regression
• Estimation in functional linear quantile regression
• Function-on-scalar quantile regression with application to mass spectrometry proteomics data
• Feature selection for functional data
• Interpretable sparse SIR for functional data
• Checking the adequacy of functional linear quantile regression model
• Estimating Truncated Functional Linear Models With a Nested Group Bridge Approach
• On properties of percentile bootstrap confidence intervals for prediction in functional linear regression
• Consistent variable selection for functional regression models
• Heterogeneous spatial dynamical regression in a Hilbert-valued context
• Lasso in Infinite dimension: application to variable selection in functional multivariate linear regression
• Functional linear model with zero-value coefficient function at sub-regions
• Functional logistic regression: a comparison of three methods
• Interval-wise testing for functional data
• Estimator selection and combination in scalar-on-function regression
• Fréchet distance-based cluster analysis for multi-dimensional functional data
• Methods for Scalar‐on‐Function Regression
• \(L_1\)-penalization in functional linear regression with subgaussian design
• Dynamic single-index model for functional data
• Crop Yield Prediction Using Bayesian Spatially Varying Coefficient Models with Functional Predictors
• Scalar-on-function regression for predicting distal outcomes from intensively gathered longitudinal data: interpretability for applied scientists
• Adaptive global testing for functional linear models
• Sparse estimation in functional linear regression
• Resampling techniques for estimating the distribution of descriptive statistics of functional data
• Statistical inference for the slope parameter in functional linear regression
• Simultaneous selection and inference for varying coefficients with zero regions: a soft-thresholding approach
• Locally sparse estimator of generalized varying coefficient model for asynchronous longitudinal data
• On optimal regression trees to detect critical intervals for multivariate functional data
• Posterior concentration for a misspecified Bayesian regression model with functional covariates
• Modeling Functional Time Series and Mixed-Type Predictors With Partially Functional Autoregressions
• Estimating functional single index models with compact support
• Elucidating Age and Sex-Dependent Association Between Frontal EEG Asymmetry and Depression: An Application of Multiple Imputation in Functional Regression
• Time-varying feature selection for longitudinal analysis
• Locally Sparse Function-on-Function Regression
• An informative prior distribution on functions with application to functional regression
• Elastic functional principal component regression
• Hypothesis testing for points of impact in functional linear regression
• Functional mixtures-of-experts
• Functional Group Bridge for Simultaneous Regression and Support Estimation
• Locally sparse and robust partial least squares in scalar-on-function regression
• A mixture of experts regression model for functional response with functional covariates
• Functional data analysis: an introduction and recent developments
• Detecting changes in the functional linear regression model
• A Note on Application of Nesterov’s Method in Solving Lasso-Type Problems
• Functional Data Analysis with Covariate-Dependent Mean and Covariance Structures
• Variable selection in generalized functional linear models
• Adaptive smoothing spline estimator for the function-on-function linear regression model
• Instrumental variable approach to estimating the scalar-on-function regression model with measurement error with application to energy expenditure assessment in childhood obesity
• On some stable linear functional regression estimators based on random projections
• Cox regression models with functional covariates for survival data
• Restricted function‐on‐function linear regression model
• Locally sparse quantile estimation for a partially functional interaction model
• Functional concurrent hidden Markov model
• Sparse functional varying-coefficient mixture regression

Describes a project that uses

Uses Software

• fda (R)
• PDCO
• Fahrmeir

This page was built for publication: Functional linear regression that's interpretable

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q834333)