Data-driven probability concentration and sampling on manifold
From MaRDI portal
Abstract: A new methodology is proposed for generating realizations of a random vector with values in a finite-dimensional Euclidean space that are statistically consistent with a data set of observations of this vector. The probability distribution of this random vector, while a-priori not known, is presumed to be concentrated on an unknown subset of the Euclidean space. A random matrix is introduced whose columns are independent copies of the random vector and for which the number of columns is the number of data points in the data set. The approach is based on the use of (i) the multidimensional kernel-density estimation method for estimating the probability distribution of the random matrix, (ii) a MCMC method for generating realizations for the random matrix, (iii) the diffusion-maps approach for discovering and characterizing the geometry and the structure of the data set, and (iv) a reduced-order representation of the random matrix, which is constructed using the diffusion-maps vectors associated with the first eigenvalues of the transition matrix relative to the given data set. The convergence aspects of the proposed methodology are analyzed and a numerical validation is explored through three applications of increasing complexity. The proposed method is found to be robust to noise levels and data complexity as well as to the intrinsic dimension of data and the size of experimental data sets. Both the methodology and the underlying mathematical framework presented in this paper contribute new capabilities and perspectives at the interface of uncertainty quantification, statistical data analysis, stochastic modeling and associated statistical inverse problems.
Recommendations
- Data driven Dirichlet sampling on manifolds
- Sampling from a Manifold
- Sampling from manifold-restricted distributions using tangent bundle projections
- Monte Carlo on Manifolds: Sampling Densities and Integrating Functions
- Manifold sampling for _1 nonconvex optimization
- Probabilistic modelling of general noisy multi-manifold data sets
- Variational Bayesian data analysis on manifold
- Maximum likelihood estimators on manifolds
- Sampling of Bayesian posteriors with a non-Gaussian probabilistic learning on manifolds from a small dataset
- Density estimation on manifolds with boundary
Cites work
- Basis adaptation in homogeneous chaos spaces
- Construction of probability distributions in high dimension using the maximum entropy principle: Applications to stochastic processes, random fields and random matrices
- Diffusion maps
- Geometric diffusions as a tool for harmonic analysis and structure definition of data: diffusion maps
- Higher-order implicit strong numerical schemes for stochastic differential equations
- scientific article; zbMATH DE number 3176450 (Why is no real title available?)
- scientific article; zbMATH DE number 46732 (Why is no real title available?)
- scientific article; zbMATH DE number 652291 (Why is no real title available?)
- scientific article; zbMATH DE number 1082208 (Why is no real title available?)
- scientific article; zbMATH DE number 1745051 (Why is no real title available?)
- scientific article; zbMATH DE number 1851000 (Why is no real title available?)
- scientific article; zbMATH DE number 822846 (Why is no real title available?)
- scientific article; zbMATH DE number 3046994 (Why is no real title available?)
- Intrinsic modeling of stochastic dynamical systems using empirical geometry
- Introduction to Stochastic Search and Optimization
- Karhunen-Loève expansion revisited for vector-valued random fields: scaling, errors and optimal basis.
- Monte Carlo sampling methods using Markov chains and their applications
- Multivariate density estimation. Theory, practice, and visualization
- Numerical Methods for Second‐Order Stochastic Differential Equations
- Physical Systems with Random Uncertainties: Chaos Representations with Arbitrary Probability Measure
- Polynomial chaos expansion of a multimodal random vector
- Polynomial Chaos in Stochastic Finite Elements
- Principal component analysis.
- Riemann manifold Langevin and Hamiltonian Monte Carlo methods. With discussion and authors' reply
- Slice sampling. (With discussions and rejoinder)
- Stability of regime-switching stochastic differential equations
- Statistical and computational inverse problems.
- Stochastic model and generator for random fields with symmetry properties: application to the mesoscopic modeling of elastic random media
- Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images
- The Monte Carlo Method
- The orthogonal development of non-linear functionals in series of Fourier-Hermite functionals
- Time-domain formulation in computational dynamics for linear viscoelastic media with model uncertainties and stochastic excitation
Cited in
(45)- Data-driven kernel representations for sampling with an unknown block dependence structure under correlation constraints
- Polynomial chaos representation of databases on manifolds
- High-dimensional intrinsic interpolation using Gaussian process regression and diffusion maps
- An inverse micro-mechanical analysis toward the stochastic homogenization of nonlinear random composites
- Identification and sampling of Bayesian posteriors of high-dimensional symmetric positive-definite matrices for data-driven updating of computational models
- Design optimization under uncertainties of a mesoscale implant in biological tissues using a probabilistic learning algorithm
- Data-driven surrogates for high dimensional models using Gaussian process regression on the Grassmann manifold
- Towards blending physics-based numerical simulations and seismic databases using generative adversarial network
- Diffusion maps-aided neural networks for the solution of parametrized PDEs
- Probabilistic modelling of general noisy multi-manifold data sets
- Data driven Dirichlet sampling on manifolds
- Probabilistic learning inference of boundary value problem with uncertainties based on Kullback-Leibler divergence under implicit constraints
- Data-driven uncertainty quantification in computational human head models
- Adaptive method for indirect identification of the statistical properties of random fields in a Bayesian framework
- Sampling of Bayesian posteriors with a non-Gaussian probabilistic learning on manifolds from a small dataset
- Entropy-based closure for probabilistic learning on manifolds
- Probabilistic learning on manifolds constrained by nonlinear partial differential equations for small datasets
- Sampling from manifold-restricted distributions using tangent bundle projections
- Monte Carlo on Manifolds: Sampling Densities and Integrating Functions
- Bayesian adaptation of chaos representations using variational inference and sampling on geodesics
- Normal-bundle bootstrap
- A Metric Space for Point Process Excitations
- A multidimensional random number generating method based on the sample covariance matrix
- Sampling from a Manifold
- GANs and Closures: Micro-Macro Consistency in Multiscale Modeling
- Probabilistic learning on manifolds (PLoM) with partition
- Grassmannian diffusion maps based surrogate modeling via geometric harmonics
- Probabilistic learning and updating of a digital twin for composite material systems
- Updating an uncertain and expensive computational model in structural dynamics based on one single target FRF using a probabilistic learning tool
- Probabilistic-learning-based stochastic surrogate model from small incomplete datasets for nonlinear dynamical systems
- Concurrent multiscale simulations of nonlinear random materials using probabilistic learning
- Probabilistic learning constrained by realizations using a weak formulation of Fourier transform of probability measures
- A micromechanical mean‐field homogenization surrogate for the stochastic multiscale analysis of composite materials failure
- Polynomial-chaos-based conditional statistics for probabilistic learning with heterogeneous data applied to atomic collisions of helium on graphite substrate
- Physics-constrained non-Gaussian probabilistic learning on manifolds
- Diffusion maps-based surrogate modeling: an alternative machine learning approach
- Probabilistic learning for modeling and quantifying model-form uncertainties in nonlinear computational mechanics
- Probabilistic nonconvex constrained optimization with fixed number of function evaluations
- Rigid transformations for stabilized lower dimensional space to support subsurface uncertainty quantification and interpretation
- Uncertainty quantification of graph convolution neural network models of evolving processes
- Polynomial chaos expansions on principal geodesic Grassmannian submanifolds for surrogate modeling and uncertainty quantification
- Transient anisotropic kernel for probabilistic learning on manifolds
- From discrete to continuum: a generalized Euler-Maclaurin framework for scale effects in nanomechanics
- Quantum computer formulation of the FKP-operator eigenvalue problem for probabilistic learning on manifolds
- Enabling probabilistic learning on manifolds through double diffusion maps
This page was built for publication: Data-driven probability concentration and sampling on manifold
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q726929)
