Supervised learning via the โ€œhubNetโ€ procedure

From MaRDI portal
Publication:4571206

DOI10.5705/SS.202016.0482zbMATH Open1394.62093arXiv1608.05465OpenAlexW2607102394MaRDI QIDQ4571206FDOQ4571206

Leying Guan, Robert Tibshirani, Zhou Fan

Publication date: 6 July 2018

Published in: STATISTICA SINICA (Search for Journal in Brave)

Abstract: We propose a new method for supervised learning. The hubNet procedure fits a hub-based graphical model to the predictors, to estimate the amount of "connection" that each predictor has with other predictors. This yields a set of predictor weights that are then used in a regularized regression such as the lasso or elastic net. The resulting procedure is easy to implement, can sometimes yields higher prediction accuracy that the lasso, and can give insights into the underlying structure of the predictors. HubNet can also be generalized seamlessly to other supervised problems such as regularized logistic regression (and other GLMs), Cox's proportional hazards model, and nonlinear procedures such as random forests and boosting. We prove some recovery results under a specialized model and illustrate the method on real and simulated data.


Full work available at URL: https://arxiv.org/abs/1608.05465






Cited In (1)


Recommendations





This page was built for publication: Supervised learning via the โ€œhubNetโ€ procedure

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4571206)