Transfer Learning under High-dimensional Generalized Linear Models
From MaRDI portal
Publication:115205
DOI10.1080/01621459.2022.2071278arXiv2105.14328OpenAlexW3168767473MaRDI QIDQ115205FDOQ115205
Publication date: 29 May 2021
Published in: Journal of the American Statistical Association (Search for Journal in Brave)
Abstract: In this work, we study the transfer learning problem under high-dimensional generalized linear models (GLMs), which aim to improve the fit on target data by borrowing information from useful source data. Given which sources to transfer, we propose a transfer learning algorithm on GLM, and derive its -estimation error bounds as well as a bound for a prediction error measure. The theoretical analysis shows that when the target and source are sufficiently close to each other, these bounds could be improved over those of the classical penalized estimator using only target data under mild conditions. When we don't know which sources to transfer, an algorithm-free transferable source detection approach is introduced to detect informative sources. The detection consistency is proved under the high-dimensional GLM transfer learning setting. We also propose an algorithm to construct confidence intervals of each coefficient component, and the corresponding theories are provided. Extensive simulations and a real-data experiment verify the effectiveness of our algorithms. We implement the proposed GLM transfer learning algorithms in a new R package glmtrans, which is available on CRAN.
Full work available at URL: https://arxiv.org/abs/2105.14328
Recommendations
- Robust transfer learning of high-dimensional generalized linear model
- Transfer Learning for High-Dimensional Linear Regression: Prediction, Estimation and Minimax Optimality
- Transfer Learning in Large-Scale Gaussian Graphical Models with False Discovery Rate Control
- Generalized transfer subspace learning through low-rank constraint
- scientific article; zbMATH DE number 7370519
- Transfer bounds for linear feature learning
- A theoretical framework for deep transfer learning
- Learning High-Dimensional Generalized Linear Autoregressive Models
- scientific article
Cites Work
- A lasso for hierarchical interactions
- Title not available (Why is that?)
- Title not available (Why is that?)
- High-dimensional graphs and variable selection with the Lasso
- Model Selection and Estimation in Regression with Grouped Variables
- A unified framework for high-dimensional analysis of \(M\)-estimators with decomposable regularizers
- On asymptotically optimal confidence regions and tests for high-dimensional models
- Data shared Lasso: a novel tool to discover uplift
- Regression modelling on stratified data with the lasso
- Adaptive transfer learning
- A no-free-lunch theorem for multitask learning
- Data enriched linear regression
- Transfer learning for nonparametric classification: minimax rate and adaptive classifier
- Transfer Learning for High-Dimensional Linear Regression: Prediction, Estimation and Minimax Optimality
- Transfer Learning in Large-Scale Gaussian Graphical Models with False Discovery Rate Control
Cited In (8)
- Targeting underrepresented populations in precision medicine: a federated transfer learning approach
- Turning the information-sharing dial: efficient inference from different data sources
- Weighted likelihood transfer learning for high-dimensional generalized linear models
- Transfer learning via random forests: a one-shot federated approach
- Transfer Learning with Large-Scale Quantile Regression
- Double debiased transfer learning for adaptive Huber regression
- glmtrans
- Transfer learning for functional mean estimation: phase transition and adaptive algorithms
This page was built for publication: Transfer Learning under High-dimensional Generalized Linear Models
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q115205)
