Gaussian processes and limiting linear models

DOI10.1016/J.CSDA.2008.06.020zbMATH Open1452.62064OpenAlexW2069176726MaRDI QIDQ1023934FDOQ1023934

Authors Robert B. Gramacy, Herbert K. H. Lee 

Publication date 16 June 2009

Published in Computational Statistics and Data Analysis (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/0804.4685

Mathematics Subject Classification ID

Computational methods for problems pertaining to statistics (62-08) Inference from spatial processes (62M30)

Abstract: Gaussian processes retain the linear model either as a special case, or in the limit. We show how this relationship can be exploited when the data are at least partially linear. However from the perspective of the Bayesian posterior, the Gaussian processes which encode the linear model either have probability of nearly zero or are otherwise unattainable without the explicit construction of a prior with the limiting linear model in mind. We develop such a prior, and show that its practical benefits extend well beyond the computational and conceptual simplicity of the linear model. For example, linearity can be extracted on a per-dimension basis, or can be combined with treed partition models to yield a highly efficient nonstationary model. Our approach is demonstrated on synthetic and real datasets of varying linearity and dimensionality.

Recommendations

• scientific article; zbMATH DE number 218695
• Gaussian processes and Gaussian random fields
• scientific article; zbMATH DE number 1054350
• scientific article; zbMATH DE number 3942738
• Gaussian processes with linear operator inequality constraints
• Gaussian process regression in the flat limit
• Advanced Lectures on Machine Learning

Cites Work

• scientific article; zbMATH DE number 3980241 (Why is no real title available?)
• scientific article; zbMATH DE number 52492 (Why is no real title available?)
• scientific article; zbMATH DE number 1313649 (Why is no real title available?)
• scientific article; zbMATH DE number 2161246 (Why is no real title available?)
• scientific article; zbMATH DE number 840151 (Why is no real title available?)
• scientific article; zbMATH DE number 961607 (Why is no real title available?)
• Bagging predictors
• Bayesian calibration of computer models. (With discussion)
• Bayesian treed Gaussian process models with an application to computer modeling
• Bayesian treed models
• Hedonic housing prices and the demand for clean air
• Multivariate adaptive regression splines
• Objective Bayesian Analysis of Spatially Correlated Data
• Practical nonparametric and semiparametric Bayesian statistics
• The design and analysis of computer experiments.

Cited In (16)

• \textit{KrigInv}: an efficient and user-friendly implementation of batch-sequential inversion strategies based on kriging
• Gaussian process modeling with boundary information
• Calibration of computer models with multivariate output
• Sequential design and spatial modeling for portfolio tail risk measurement
• Calibration for computer experiments with binary responses and application to cell adhesion study
• Scaling relationships of Gaussian processes
• Finite-dimensional approximation of Gaussian processes with linear inequality constraints and noisy observations
• Title not available (Why is no real title available?)
• Active learning for efficiently training emulators of computationally expensive mathematical models
• Advanced Lectures on Machine Learning
• Gaussian process regression in the flat limit
• A Partially Linear Model Using a Gaussian Process Prior
• Screening the Discrepancy Function of a Computer Model
• Emulation engines: choice and quantification of uncertainty for complex hydrological models
• Cases for the nugget in modeling computer experiments
• Lectures on Gaussian Processes

Uses Software

• R
• tgp

This page was built for publication: Gaussian processes and limiting linear models

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1023934)