Regularization parameter selection in indirect regression by residual based bootstrap

DOI10.5705/SS.202018.0160MaRDI QIDQ5134476zbMATH OpenOpenAlexFDO

Authors Nicolai Bissantz, Justin Chown, Holger Dette

Publication date 16 November 2020

Published in STATISTICA SINICA (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1610.08663

zbMATH Keywords

regularizationbandwidth selectioninverse problemssmooth bootstrapindirect regression estimatorresidual-based empirical distribution function

Mathematics Subject Classification ID

Bootstrap, jackknife and other resampling methods (62F40) Statistical ranking and selection procedures (62F07)

Abstract: Residual-based analysis is generally considered a cornerstone of statistical methodology. For a special case of indirect regression, we investigate the residual-based empirical distribution function and provide a uniform expansion of this estimator, which is also shown to be asymptotically most precise. This investigation naturally leads to a completely data-driven technique for selecting a regularization parameter used in our indirect regression function estimator. The resulting methodology is based on a smooth bootstrap of the model residuals. A simulation study demonstrates the effectiveness of our approach.

Recommendations

• Bootstrap of residual processes in regression: to smooth or not to smooth?
• Regularisation parameter selection via bootstrapping
• Residual periodograms for choosing regularization parameters for ill-posed problems
• The choice of smoothing parameter in nonparametric regression through wild bootstrap
• scientific article; zbMATH DE number 1551804

Cites work

• scientific article; zbMATH DE number 4001209 (Why is no real title available?)
• Adaptive hard-thresholding for linear inverse problems
• Approximating data with weighted smoothing splines
• Bootstrapping the mean integrated squared error
• Confidence bands for inverse regression models
• Confidence bands for multivariate and time dependent inverse regression models
• Discrepancy principle for statistical inverse problems with application to conjugate gradient iteration
• Estimating linear functionals of the error distribution in nonparametric regression
• Estimating the error distribution function in semiparametric regression
• General regularization schemes for signal detection in inverse problems
• Introduction to nonparametric estimation
• Locally adaptive image denoising by a statistical multiresolution criterion
• Multivariate density estimation with general flat-top kernels of infinite order
• Multivariate probability density deconvolution for stationary random processes
• Nonparametric statistical inverse problems
• On Estimation of a Probability Density Function and Mode
• On pointwise adaptive nonparametric deconvolution
• On the Estimation of the Probability Density, I
• On the optimal rates of convergence for nonparametric deconvolution problems
• Optimal adaptation for early stopping in statistical inverse problems
• Regularization of some linear ill-posed problems with discretized random noisy data
• Risk hull method and regularization by projections of ill-posed inverse problems
• Sharp adaptation for inverse problems with random noise
• Smooth Residual Bootstrap for Empirical Processes of Non‐parametric Regression Residuals
• Statistical Inverse Estimation in Hilbert Scales
• Statistical inference for inverse problems
• The choice of smoothing parameter in nonparametric regression through wild bootstrap

Cited in

(1)

• The empirical process of residuals from an inverse regression

This page was built for publication: Regularization parameter selection in indirect regression by residual based bootstrap

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5134476)