Boosted nonparametric hazards with time-dependent covariates

DOI10.1214/20-AOS2028zbMATH Open1483.62161arXiv1701.07926MaRDI QIDQ2054480FDOQ2054480

Authors: Donald K. K. Lee, Ningyuan Chen, Hemant Ishwaran 

Publication date: 3 December 2021

Published in: The Annals of Statistics (Search for Journal in Brave)

Abstract: Given functional data from a survival process with time-dependent covariates, we derive a smooth convex representation for its nonparametric log-likelihood functional and obtain its functional gradient. From this, we devise a generic gradient boosting procedure for estimating the hazard function nonparametrically. An illustrative implementation of the procedure using regression trees is described to show how to recover the unknown hazard. The generic estimator is consistent if the model is correctly specified; alternatively, an oracle inequality can be demonstrated for tree-based models. To avoid overfitting, boosting employs several regularization devices. One of them is step-size restriction, but the rationale for this is somewhat mysterious from the viewpoint of consistency. Our work brings some clarity to this issue by revealing that step-size restriction is a mechanism for preventing the curvature of the risk from derailing convergence.

Full work available at URL: https://arxiv.org/abs/1701.07926

Recommendations

• Nonparametric hazard estimation with time-varying discrete covariates
• Nonparametric survival analysis with time-dependent covariate effects: A penalized partial likelihood approach
• Estimating multiplicative and additive hazard functions by kernel methods
• A gradient boosting algorithm for survival analysis via direct optimization of concordance index
• Boosting method for nonlinear transformation models with censored survival data

zbMATH Keywords

functional datasurvival analysisgradient boostingregression treeslikelihood functionalstepsize shrinkage

Mathematics Subject Classification ID

Nonparametric estimation (62G05) Asymptotic properties of nonparametric inference (62G20) Estimation in survival analysis and censored data (62N02) Functional data analysis (62R10)

Cites Work

• Greedy function approximation: A gradient boosting machine.
• Weak convergence and empirical processes. With applications to statistics
• Likelihood Ratio Tests for Model Selection and Non-Nested Hypotheses
• Introductory lectures on convex optimization. A basic course.
• Transformation boosting machines
• Survival ensembles
• Boosting algorithms: regularization, prediction and model fitting
• Boosting with early stopping: convergence and consistency
• Boosting With theL₂Loss
• Prediction Games and Arcing Algorithms
• Boosting additive models using component-wise P-splines
• Nonparametric inference for a family of counting processes
• On the ``degrees of freedom of the lasso
• Regularized Estimation in the Accelerated Failure Time Model with High-Dimensional Covariates
• Population theory for boosting ensembles.
• Additive modelling of functional gradients
• Characterizing \(L_{2}\)Boosting
• 10.1162/1532443041424319
• First-order complete and computationally complete query languages for spatio-temporal databases
• The L₂ Rate of Convergence for Event History Regression with Time‐dependent Covariates

Cited In (4)

• Boosted coefficient models
• Regularisation in discrete survival models: a comparison of Lasso and gradient boosting
• Unbiased Boosting Estimation for Censored Survival Data
• Accelerated failure time models with error-prone response and nonlinear covariates

This page was built for publication: Boosted nonparametric hazards with time-dependent covariates

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2054480)