Bayesian manifold regression
From MaRDI portal
Abstract: There is increasing interest in the problem of nonparametric regression with high-dimensional predictors. When the number of predictors is large, one encounters a daunting problem in attempting to estimate a -dimensional surface based on limited data. Fortunately, in many applications, the support of the data is concentrated on a -dimensional subspace with . Manifold learning attempts to estimate this subspace. Our focus is on developing computationally tractable and theoretically supported Bayesian nonparametric regression methods in this context. When the subspace corresponds to a locally-Euclidean compact Riemannian manifold, we show that a Gaussian process regression approach can be applied that leads to the minimax optimal adaptive rate in estimating the regression function under some conditions. The proposed model bypasses the need to estimate the manifold, and can be implemented using standard algorithms for posterior computation in Gaussian processes. Finite sample performance is illustrated in an example data analysis.
Recommendations
Cites work
- scientific article; zbMATH DE number 5654889 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- A tree-based regressor that adapts to intrinsic dimension
- Adaptive Bayesian estimation using a Gaussian random field with inverse gamma bandwidth
- Anisotropic function estimation using multi-bandwidth Gaussian processes
- Bayesian density regression with logistic Gaussian process and subspace projection
- Bayesian monotone regression using Gaussian process projection
- Classification via Bayesian Nonparametric Learning of Affine Subspaces
- Compressive Sensing on Manifolds Using a Nonparametric Mixture of Factor Analyzers: Algorithm and Performance Bounds
- Convergence rates of posterior distributions for non iid observations
- Convergence rates of posterior distributions.
- Information rates of nonparametric Gaussian process methods
- Laplacian Eigenmaps for Dimensionality Reduction and Data Representation
- Latent factor models for density estimation
- Learning and approximation by Gaussians on Riemannian manifolds
- On Local Intrinsic Dimension Estimation and Its Applications
- Optimal global rates of convergence for nonparametric regression
- Rates of contraction for posterior distributions in \(L^{r}\)-metrics, \(1 \leq r \leq \infty\)
- Regularization and Variable Selection Via the Elastic Net
- Sufficient dimension reduction via Bayesian mixture modeling
- The semiparametric Bernstein-von Mises theorem
- Theory of Reproducing Kernels
- Thomas Bayes' walk on manifolds
- Universal algorithms for learning theory. I: Piecewise constant functions.
- Universal algorithms for learning theory. II: Piecewise polynomial functions
- Variable selection for nonparametric Gaussian process priors: Models and computational strategies
Cited in
(37)- Extrinsic Gaussian processes for regression and classification on manifolds
- Semi-parametric Bayes regression with network-valued covariates
- Regression on manifolds using data-dependent regularization with applications in computer vision
- Probabilistic integration: a role in statistical computation?
- A diffusion process perspective on posterior contraction rates for parameters
- scientific article; zbMATH DE number 7306873 (Why is no real title available?)
- Anisotropic function estimation using multi-bandwidth Gaussian processes
- Estimation of a regression function on a manifold by fully connected deep neural networks
- Minimax-optimal nonparametric regression in high dimensions
- Bandit and covariate processes, with finite or non-denumerable set of arms
- scientific article; zbMATH DE number 7387621 (Why is no real title available?)
- Deep nonparametric regression on approximate manifolds: nonasymptotic error bounds with polynomial prefactors
- Variational Bayesian data analysis on manifold
- Sets that maximize probability and a related variational problem
- Functional regression on the manifold with contamination
- Can we trust Bayesian uncertainty quantification from Gaussian process priors with squared exponential covariance kernel?
- Kernel-based system identification with manifold regularization: a Bayesian perspective
- Compressed Gaussian process for manifold regression
- Gaussian process landmarking on manifolds
- Airflow recovery from thoracic and abdominal movements using synchrosqueezing transform and locally stationary Gaussian process regression
- Diffusion \(K\)-means clustering on manifolds: provable exact recovery via semidefinite relaxations
- Local linear regression on manifolds and its geometric interpretation
- Multi-output regression on the output manifold
- Longitudinal image analysis via path regression on the image manifold
- Flexible Bayesian dynamic modeling of correlation and covariance matrices
- Minimax rate of distribution estimation on unknown submanifolds under adversarial losses
- Probabilistic modelling of general noisy multi-manifold data sets
- scientific article; zbMATH DE number 7625193 (Why is no real title available?)
- Intrinsic dimension adaptive partitioning for kernel methods
- Solving PDEs on spheres with physics-informed convolutional neural networks
- A spectral series approach to high-dimensional nonparametric regression
- Adaptive learning rates for support vector machines working on data with low intrinsic dimension
- scientific article; zbMATH DE number 7387620 (Why is no real title available?)
- Gaussian Process Subspace Prediction for Model Reduction
- Symmetry tests for manifold-valued random variables
- Rates of the strong uniform consistency for the kernel-type regression function estimators with general kernels on manifolds
- High-dimensional intrinsic interpolation using Gaussian process regression and diffusion maps
This page was built for publication: Bayesian manifold regression
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q282481)
