On the improved rates of convergence for Matérn-type kernel ridge regression with application to calibration of computer models
From MaRDI portal
(Redirected from Publication:5149775)
Hilbert spaces with reproducing kernels (= (proper) functional Hilbert spaces, including de Branges-Rovnyak and other structured spaces) (46E22) Computational methods for problems pertaining to statistics (62-08) Nonparametric regression and quantile regression (62G08) Ridge regression; shrinkage estimators (Lasso) (62J07) Inference from spatial processes (62M30) Random fields; image analysis (62M40)
Abstract: Kernel ridge regression is an important nonparametric method for estimating smooth functions. We introduce a new set of conditions, under which the actual rates of convergence of the kernel ridge regression estimator under both the L_2 norm and the norm of the reproducing kernel Hilbert space exceed the standard minimax rates. An application of this theory leads to a new understanding of the Kennedy-O'Hagan approach for calibrating model parameters of computer simulation. We prove that, under certain conditions, the Kennedy-O'Hagan calibration estimator with a known covariance function converges to the minimizer of the norm of the residual function in the reproducing kernel Hilbert space.
Recommendations
- Kernel ridge vs. principal component regression: minimax bounds and the qualification of regularization operators
- Kernel regression, minimax rates and effective dimensionality: beyond the regular case
- Convergence rates of kernel conjugate gradient for random design regression
- Non-asymptotic error bound for optimal prediction of function-on-function regression by RKHS approach
- Kernel approximation: from regression to interpolation
Cites work
- A theoretical framework for calibration in computer models: parametrization, estimation and convergence properties
- Adjustments to computer models via projected kernel calibration
- An introduction to statistical learning. With applications in R
- Approximation of eigenfunctions in kernel-based spaces
- Bayesian calibration of computer models. (With discussion)
- Convergence rates for multivariate smoothing spline functions
- Distributed learning with regularized least squares
- Efficient calibration for imperfect computer models
- Experiments. Planning, analysis and optimization.
- scientific article; zbMATH DE number 1804115 (Why is no real title available?)
- scientific article; zbMATH DE number 5654889 (Why is no real title available?)
- scientific article; zbMATH DE number 45848 (Why is no real title available?)
- scientific article; zbMATH DE number 2208228 (Why is no real title available?)
- scientific article; zbMATH DE number 962825 (Why is no real title available?)
- Improved error bounds for scattered data interpolation by radial basis functions
- Interpolation of spatial data. Some theory for kriging
- Kernel ridge vs. principal component regression: minimax bounds and the qualification of regularization operators
- Learning theory of distributed spectral algorithms
- Optimal global rates of convergence for nonparametric regression
- Optimal rates for regularization of statistical inverse learning problems
- Prediction based on the Kennedy-O'Hagan calibration model: asymptotic consistency and other properties
- Scaled Gaussian stochastic process for computer model calibration and prediction
- Scattered Data Approximation
- Smoothing spline ANOVA models
- Statistics for high-dimensional data. Methods, theory and applications.
- The design and analysis of computer experiments.
- The reproducing kernel Hilbert space structure of the sample paths of a Gaussian process
- Weak convergence and empirical processes. With applications to statistics
Cited in
(12)- Calibration and prediction for the inexact SIR model
- Kernel ridge vs. principal component regression: minimax bounds and the qualification of regularization operators
- Penalized Projected Kernel Calibration for Computer Models
- Fast Calibration for Computer Models with Massive Physical Observations
- Asymptotic Bounds for Smoothness Parameter Estimates in Gaussian Process Interpolation
- Stacking Designs: Designing Multifidelity Computer Experiments with Target Predictive Accuracy
- The Matérn model: a journey through statistics, numerical analysis and machine learning
- Robust calibration of computer models based on Huber loss
- A review on computer model calibration
- The FA-SAA algorithm for CVaR optimization
- Sobolev Calibration of Imperfect Computer Models
- Selection Bias Adjustment by Functional Transfer Learning via Reproducing Kernel Hilbert Space
This page was built for publication: On the improved rates of convergence for Matérn-type kernel ridge regression with application to calibration of computer models
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5149775)