Bayesian manifold regression
From MaRDI portal
Abstract: There is increasing interest in the problem of nonparametric regression with high-dimensional predictors. When the number of predictors is large, one encounters a daunting problem in attempting to estimate a -dimensional surface based on limited data. Fortunately, in many applications, the support of the data is concentrated on a -dimensional subspace with . Manifold learning attempts to estimate this subspace. Our focus is on developing computationally tractable and theoretically supported Bayesian nonparametric regression methods in this context. When the subspace corresponds to a locally-Euclidean compact Riemannian manifold, we show that a Gaussian process regression approach can be applied that leads to the minimax optimal adaptive rate in estimating the regression function under some conditions. The proposed model bypasses the need to estimate the manifold, and can be implemented using standard algorithms for posterior computation in Gaussian processes. Finite sample performance is illustrated in an example data analysis.
Recommendations
Cites work
- scientific article; zbMATH DE number 5654889 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- A tree-based regressor that adapts to intrinsic dimension
- Adaptive Bayesian estimation using a Gaussian random field with inverse gamma bandwidth
- Anisotropic function estimation using multi-bandwidth Gaussian processes
- Bayesian density regression with logistic Gaussian process and subspace projection
- Bayesian monotone regression using Gaussian process projection
- Classification via Bayesian Nonparametric Learning of Affine Subspaces
- Compressive Sensing on Manifolds Using a Nonparametric Mixture of Factor Analyzers: Algorithm and Performance Bounds
- Convergence rates of posterior distributions for non iid observations
- Convergence rates of posterior distributions.
- Information rates of nonparametric Gaussian process methods
- Laplacian Eigenmaps for Dimensionality Reduction and Data Representation
- Latent factor models for density estimation
- Learning and approximation by Gaussians on Riemannian manifolds
- On Local Intrinsic Dimension Estimation and Its Applications
- Optimal global rates of convergence for nonparametric regression
- Rates of contraction for posterior distributions in \(L^{r}\)-metrics, \(1 \leq r \leq \infty\)
- Regularization and Variable Selection Via the Elastic Net
- Sufficient dimension reduction via Bayesian mixture modeling
- The semiparametric Bernstein-von Mises theorem
- Theory of Reproducing Kernels
- Thomas Bayes' walk on manifolds
- Universal algorithms for learning theory. I: Piecewise constant functions.
- Universal algorithms for learning theory. II: Piecewise polynomial functions
- Variable selection for nonparametric Gaussian process priors: Models and computational strategies
Cited in
(37)- Airflow recovery from thoracic and abdominal movements using synchrosqueezing transform and locally stationary Gaussian process regression
- Multi-output regression on the output manifold
- Longitudinal image analysis via path regression on the image manifold
- Solving PDEs on spheres with physics-informed convolutional neural networks
- Diffusion \(K\)-means clustering on manifolds: provable exact recovery via semidefinite relaxations
- Probabilistic integration: a role in statistical computation?
- Variational Bayesian data analysis on manifold
- scientific article; zbMATH DE number 7387621 (Why is no real title available?)
- Anisotropic function estimation using multi-bandwidth Gaussian processes
- scientific article; zbMATH DE number 7625193 (Why is no real title available?)
- Flexible Bayesian dynamic modeling of correlation and covariance matrices
- A diffusion process perspective on posterior contraction rates for parameters
- Extrinsic Gaussian processes for regression and classification on manifolds
- Local linear regression on manifolds and its geometric interpretation
- Minimax-optimal nonparametric regression in high dimensions
- Gaussian process landmarking on manifolds
- Kernel-based system identification with manifold regularization: a Bayesian perspective
- Symmetry tests for manifold-valued random variables
- Sets that maximize probability and a related variational problem
- Bandit and covariate processes, with finite or non-denumerable set of arms
- Probabilistic modelling of general noisy multi-manifold data sets
- High-dimensional intrinsic interpolation using Gaussian process regression and diffusion maps
- Compressed Gaussian process for manifold regression
- Functional regression on the manifold with contamination
- scientific article; zbMATH DE number 7306873 (Why is no real title available?)
- Rates of the strong uniform consistency for the kernel-type regression function estimators with general kernels on manifolds
- Regression on manifolds using data-dependent regularization with applications in computer vision
- Adaptive learning rates for support vector machines working on data with low intrinsic dimension
- A spectral series approach to high-dimensional nonparametric regression
- Intrinsic dimension adaptive partitioning for kernel methods
- scientific article; zbMATH DE number 7387620 (Why is no real title available?)
- Minimax rate of distribution estimation on unknown submanifolds under adversarial losses
- Semi-parametric Bayes regression with network-valued covariates
- Can we trust Bayesian uncertainty quantification from Gaussian process priors with squared exponential covariance kernel?
- Gaussian Process Subspace Prediction for Model Reduction
- Estimation of a regression function on a manifold by fully connected deep neural networks
- Deep nonparametric regression on approximate manifolds: nonasymptotic error bounds with polynomial prefactors
This page was built for publication: Bayesian manifold regression
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q282481)
