Data-driven probability concentration and sampling on manifold
From MaRDI portal
Abstract: A new methodology is proposed for generating realizations of a random vector with values in a finite-dimensional Euclidean space that are statistically consistent with a data set of observations of this vector. The probability distribution of this random vector, while a-priori not known, is presumed to be concentrated on an unknown subset of the Euclidean space. A random matrix is introduced whose columns are independent copies of the random vector and for which the number of columns is the number of data points in the data set. The approach is based on the use of (i) the multidimensional kernel-density estimation method for estimating the probability distribution of the random matrix, (ii) a MCMC method for generating realizations for the random matrix, (iii) the diffusion-maps approach for discovering and characterizing the geometry and the structure of the data set, and (iv) a reduced-order representation of the random matrix, which is constructed using the diffusion-maps vectors associated with the first eigenvalues of the transition matrix relative to the given data set. The convergence aspects of the proposed methodology are analyzed and a numerical validation is explored through three applications of increasing complexity. The proposed method is found to be robust to noise levels and data complexity as well as to the intrinsic dimension of data and the size of experimental data sets. Both the methodology and the underlying mathematical framework presented in this paper contribute new capabilities and perspectives at the interface of uncertainty quantification, statistical data analysis, stochastic modeling and associated statistical inverse problems.
Recommendations
- Data driven Dirichlet sampling on manifolds
- Sampling from a Manifold
- Sampling from manifold-restricted distributions using tangent bundle projections
- Monte Carlo on Manifolds: Sampling Densities and Integrating Functions
- Manifold sampling for \(\ell_1\) nonconvex optimization
- Probabilistic modelling of general noisy multi-manifold data sets
- Variational Bayesian data analysis on manifold
- Maximum likelihood estimators on manifolds
- Sampling of Bayesian posteriors with a non-Gaussian probabilistic learning on manifolds from a small dataset
- Density estimation on manifolds with boundary
Cites work
- scientific article; zbMATH DE number 3176450 (Why is no real title available?)
- scientific article; zbMATH DE number 46732 (Why is no real title available?)
- scientific article; zbMATH DE number 652291 (Why is no real title available?)
- scientific article; zbMATH DE number 1082208 (Why is no real title available?)
- scientific article; zbMATH DE number 1745051 (Why is no real title available?)
- scientific article; zbMATH DE number 1851000 (Why is no real title available?)
- scientific article; zbMATH DE number 822846 (Why is no real title available?)
- scientific article; zbMATH DE number 3046994 (Why is no real title available?)
- Basis adaptation in homogeneous chaos spaces
- Construction of probability distributions in high dimension using the maximum entropy principle: Applications to stochastic processes, random fields and random matrices
- Diffusion maps
- Geometric diffusions as a tool for harmonic analysis and structure definition of data: diffusion maps
- Higher-order implicit strong numerical schemes for stochastic differential equations
- Intrinsic modeling of stochastic dynamical systems using empirical geometry
- Introduction to Stochastic Search and Optimization
- Karhunen-Loève expansion revisited for vector-valued random fields: scaling, errors and optimal basis.
- Monte Carlo sampling methods using Markov chains and their applications
- Multivariate density estimation. Theory, practice, and visualization
- Numerical Methods for Second‐Order Stochastic Differential Equations
- Physical Systems with Random Uncertainties: Chaos Representations with Arbitrary Probability Measure
- Polynomial Chaos in Stochastic Finite Elements
- Polynomial chaos expansion of a multimodal random vector
- Principal component analysis.
- Riemann manifold Langevin and Hamiltonian Monte Carlo methods. With discussion and authors' reply
- Slice sampling. (With discussions and rejoinder)
- Stability of regime-switching stochastic differential equations
- Statistical and computational inverse problems.
- Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images
- Stochastic model and generator for random fields with symmetry properties: application to the mesoscopic modeling of elastic random media
- The Monte Carlo Method
- The orthogonal development of non-linear functionals in series of Fourier-Hermite functionals
- Time-domain formulation in computational dynamics for linear viscoelastic media with model uncertainties and stochastic excitation
Cited in
(42)- Uncertainty quantification of graph convolution neural network models of evolving processes
- A micromechanical mean‐field homogenization surrogate for the stochastic multiscale analysis of composite materials failure
- Probabilistic learning constrained by realizations using a weak formulation of Fourier transform of probability measures
- Probabilistic learning inference of boundary value problem with uncertainties based on Kullback-Leibler divergence under implicit constraints
- Data-driven uncertainty quantification in computational human head models
- Data-driven kernel representations for sampling with an unknown block dependence structure under correlation constraints
- Probabilistic learning for modeling and quantifying model-form uncertainties in nonlinear computational mechanics
- Probabilistic nonconvex constrained optimization with fixed number of function evaluations
- Data driven Dirichlet sampling on manifolds
- Monte Carlo on Manifolds: Sampling Densities and Integrating Functions
- Physics-constrained non-Gaussian probabilistic learning on manifolds
- Diffusion maps-based surrogate modeling: an alternative machine learning approach
- Design optimization under uncertainties of a mesoscale implant in biological tissues using a probabilistic learning algorithm
- Transient anisotropic kernel for probabilistic learning on manifolds
- Identification and sampling of Bayesian posteriors of high-dimensional symmetric positive-definite matrices for data-driven updating of computational models
- Sampling from a Manifold
- Data-driven surrogates for high dimensional models using Gaussian process regression on the Grassmann manifold
- Probabilistic learning on manifolds (PLoM) with partition
- Towards blending physics-based numerical simulations and seismic databases using generative adversarial network
- Adaptive method for indirect identification of the statistical properties of random fields in a Bayesian framework
- Rigid transformations for stabilized lower dimensional space to support subsurface uncertainty quantification and interpretation
- Probabilistic learning and updating of a digital twin for composite material systems
- Probabilistic modelling of general noisy multi-manifold data sets
- Polynomial chaos representation of databases on manifolds
- Diffusion maps-aided neural networks for the solution of parametrized PDEs
- High-dimensional intrinsic interpolation using Gaussian process regression and diffusion maps
- GANs and Closures: Micro-Macro Consistency in Multiscale Modeling
- Polynomial-chaos-based conditional statistics for probabilistic learning with heterogeneous data applied to atomic collisions of helium on graphite substrate
- Sampling from manifold-restricted distributions using tangent bundle projections
- Polynomial chaos expansions on principal geodesic Grassmannian submanifolds for surrogate modeling and uncertainty quantification
- An inverse micro-mechanical analysis toward the stochastic homogenization of nonlinear random composites
- Concurrent multiscale simulations of nonlinear random materials using probabilistic learning
- Entropy-based closure for probabilistic learning on manifolds
- A Metric Space for Point Process Excitations
- Normal-bundle bootstrap
- Sampling of Bayesian posteriors with a non-Gaussian probabilistic learning on manifolds from a small dataset
- Updating an uncertain and expensive computational model in structural dynamics based on one single target FRF using a probabilistic learning tool
- Probabilistic learning on manifolds constrained by nonlinear partial differential equations for small datasets
- Probabilistic-learning-based stochastic surrogate model from small incomplete datasets for nonlinear dynamical systems
- A multidimensional random number generating method based on the sample covariance matrix
- Bayesian adaptation of chaos representations using variational inference and sampling on geodesics
- Grassmannian diffusion maps based surrogate modeling via geometric harmonics
This page was built for publication: Data-driven probability concentration and sampling on manifold
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q726929)
