Transfer Learning under High-dimensional Generalized Linear Models
From MaRDI portal
Abstract: In this work, we study the transfer learning problem under high-dimensional generalized linear models (GLMs), which aim to improve the fit on target data by borrowing information from useful source data. Given which sources to transfer, we propose a transfer learning algorithm on GLM, and derive its -estimation error bounds as well as a bound for a prediction error measure. The theoretical analysis shows that when the target and source are sufficiently close to each other, these bounds could be improved over those of the classical penalized estimator using only target data under mild conditions. When we don't know which sources to transfer, an algorithm-free transferable source detection approach is introduced to detect informative sources. The detection consistency is proved under the high-dimensional GLM transfer learning setting. We also propose an algorithm to construct confidence intervals of each coefficient component, and the corresponding theories are provided. Extensive simulations and a real-data experiment verify the effectiveness of our algorithms. We implement the proposed GLM transfer learning algorithms in a new R package glmtrans, which is available on CRAN.
Recommendations
- Robust transfer learning of high-dimensional generalized linear model
- Transfer Learning for High-Dimensional Linear Regression: Prediction, Estimation and Minimax Optimality
- Transfer Learning in Large-Scale Gaussian Graphical Models with False Discovery Rate Control
- Generalized transfer subspace learning through low-rank constraint
- Domain generalization by marginal transfer learning
- Transfer bounds for linear feature learning
- A theoretical framework for deep transfer learning
- Learning High-Dimensional Generalized Linear Autoregressive Models
- scientific article; zbMATH DE number 6611904
Cites work
- scientific article; zbMATH DE number 47310 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- A lasso for hierarchical interactions
- A no-free-lunch theorem for multitask learning
- A unified framework for high-dimensional analysis of \(M\)-estimators with decomposable regularizers
- Adaptive transfer learning
- Data enriched linear regression
- Data shared Lasso: a novel tool to discover uplift
- High-dimensional graphs and variable selection with the Lasso
- Model Selection and Estimation in Regression with Grouped Variables
- On asymptotically optimal confidence regions and tests for high-dimensional models
- Regression modelling on stratified data with the Lasso
- Transfer Learning for High-Dimensional Linear Regression: Prediction, Estimation and Minimax Optimality
- Transfer Learning in Large-Scale Gaussian Graphical Models with False Discovery Rate Control
- Transfer learning for nonparametric classification: minimax rate and adaptive classifier
Cited in
(8)- Targeting underrepresented populations in precision medicine: a federated transfer learning approach
- Turning the information-sharing dial: efficient inference from different data sources
- Weighted likelihood transfer learning for high-dimensional generalized linear models
- glmtrans
- Transfer learning via random forests: a one-shot federated approach
- Transfer Learning with Large-Scale Quantile Regression
- Double debiased transfer learning for adaptive Huber regression
- Transfer learning for functional mean estimation: phase transition and adaptive algorithms
This page was built for publication: Transfer Learning under High-dimensional Generalized Linear Models
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q115205)
