Gaussian processes with built-in dimensionality reduction: applications to high-dimensional uncertainty propagation
From MaRDI portal
(Redirected from Publication:726924)
Abstract: The prohibitive cost of performing Uncertainty Quantification (UQ) tasks with a very large number of input parameters can be addressed, if the response exhibits some special structure that can be discovered and exploited. Several physical responses exhibit a special structure known as an active subspace (AS), a linear manifold of the stochastic space characterized by maximal response variation. The idea is that one should first identify this low dimensional manifold, project the high-dimensional input onto it, and then link the projection to the output. In this work, we develop a probabilistic version of AS which is gradient-free and robust to observational noise. Our approach relies on a novel Gaussian process regression with built-in dimensionality reduction with the AS represented as an orthogonal projection matrix that serves as yet another covariance function hyper-parameter to be estimated from the data. To train the model, we design a two-step maximum likelihood optimization procedure that ensures the orthogonality of the projection matrix by exploiting recent results on the Stiefel manifold. The additional benefit of our probabilistic formulation is that it allows us to select the dimensionality of the AS via the Bayesian information criterion. We validate our approach by showing that it can discover the right AS in synthetic examples without gradient information using both noiseless and noisy observations. We demonstrate that our method is able to discover the same AS as the classical approach in a challenging one-hundred-dimensional problem involving an elliptic stochastic partial differential equation with random conductivity. Finally, we use our approach to study the effect of geometric and material uncertainties in the propagation of solitary waves in a one-dimensional granular system.
Recommendations
- Structured Bayesian Gaussian process latent variable model: applications to data-driven dimensionality reduction and high-dimensional inversion
- Some structural approximations for efficient probability propagation in evolving high dimensional Gaussian processes
- Gaussian Process Subspace Prediction for Model Reduction
- scientific article; zbMATH DE number 773968
- Multi-output separable Gaussian process: towards an efficient, fully Bayesian paradigm for uncertainty quantification
- Uncertainty quantification using the nearest neighbor Gaussian process
- Enhanced Gaussian processes and applications
- A scalable approximate Bayesian inference for high-dimensional Gaussian processes
Cites work
- scientific article; zbMATH DE number 3886886 (Why is no real title available?)
- scientific article; zbMATH DE number 1304256 (Why is no real title available?)
- scientific article; zbMATH DE number 1522715 (Why is no real title available?)
- scientific article; zbMATH DE number 2117879 (Why is no real title available?)
- scientific article; zbMATH DE number 961607 (Why is no real title available?)
- A Limited Memory Algorithm for Bound Constrained Optimization
- A Stochastic Collocation Method for Elliptic Partial Differential Equations with Random Input Data
- A feasible method for optimization with orthogonality constraints
- A nonlocal contact formulation for confined granular systems
- A radial basis function method for global optimization
- A taxonomy of global optimization methods based on response surfaces
- ANALYSIS OF VARIANCE-BASED MIXED MULTISCALE FINITE ELEMENT METHOD AND APPLICATIONS IN STOCHASTIC TWO-PHASE FLOWS
- Additive covariance kernels for high-dimensional Gaussian process modeling
- An adaptive ANOVA-based data-driven stochastic method for elliptic PDEs with random coefficient
- An adaptive hierarchical sparse grid collocation algorithm for the solution of stochastic differential equations
- An adaptive high-dimensional stochastic model representation technique for the solution of stochastic partial differential equations
- Bayes-Hermite quadrature
- Bayesian functional ANOVA modeling using Gaussian process prior distributions
- Bayesian learning for neural networks
- Bayesian nonparametric modeling for functional analysis of variance
- Constrained global optimization of expensive black box functions using radial basis functions
- DYNAMIC PROGRAMMING AND LAGRANGE MULTIPLIERS
- Design and analysis of computer experiments. With comments and a rejoinder by the authors
- Efficient collocational approach for parametric uncertainty analysis
- Efficient global optimization of expensive black-box functions
- Efficient implementation of high dimensional model representations
- Equation of state calculations by fast computing machines
- Erratum: Active Subspace Methods in Theory and Practice: Applications to Kriging Surfaces
- Evaluating Derivatives
- Evolutionary Multi-Criterion Optimization
- Free energy computations by minimization of Kullback-Leibler divergence: An efficient adaptive biasing potential method for sparse representations
- General foundations of high-dimensional model representations
- Global sensitivity analysis: The primer
- High dimensional model representations generated from low dimensional data samples. I: mp-cut-HDMR
- High-Order Collocation Methods for Differential Equations with Random Inputs
- High‐dimensional model representation for structural reliability analysis
- Introduction to Stochastic Search and Optimization
- Kernel principal component analysis for stochastic input model generation
- Machine learning. A probabilistic perspective
- Monte Carlo sampling methods using Markov chains and their applications
- Monte Carlo strategies in scientific computing
- Multi-level Monte Carlo finite element method for elliptic PDEs with stochastic coefficients
- Multi-output local Gaussian process regression: applications to uncertainty quantification
- Multi-output separable Gaussian process: towards an efficient, fully Bayesian paradigm for uncertainty quantification
- Multidimensional adaptive relevance vector machines for uncertainty quantification
- Pattern recognition and machine learning.
- Probabilistic Sensitivity Analysis of Complex Models: A Bayesian Approach
- Probability Theory
- Quasi-Monte Carlo finite element methods for a class of elliptic partial differential equations with random coefficients
- Quasi-Monte Carlo integration
- Reversible jump Markov chain Monte Carlo computation and Bayesian model determination
- Riemann manifold Langevin and Hamiltonian Monte Carlo methods. With discussion and authors' reply
- Solution of inverse problems with limited forward solver evaluations: a Bayesian perspective
- The Wiener--Askey Polynomial Chaos for Stochastic Differential Equations
- Uncertainty propagation using infinite mixture of gaussian processes and variational Bayesian inference
- Uncertainty quantification. Theory, implementation, and applications
Cited in
(61)- Deep UQ: learning deep neural network surrogate models for high dimensional uncertainty quantification
- A surrogate assisted adaptive framework for robust topology optimization
- Model order reduction for large-scale structures with local nonlinearities
- Systems of Gaussian process models for directed chains of solvers
- Reduced-load equivalence for Gaussian processes
- Compressive sensing adaptation for polynomial chaos expansions
- Sequential Learning of Active Subspaces
- Learning to solve Bayesian inverse problems: an amortized variational inference approach using Gaussian and flow guides
- Dimension reduction via Gaussian ridge functions
- Efficient reduced-rank methods for Gaussian processes with eigenfunction expansions
- A network model for handling boundary conditions in stochastic partial differential equations
- Collaborative and adaptive Bayesian optimization for bounding variances and probabilities under hybrid uncertainties
- Optimal design for kernel interpolation: applications to uncertainty quantification
- A hybrid polynomial chaos expansion -- Gaussian process regression method for Bayesian uncertainty quantification and sensitivity analysis
- Simulator-free solution of high-dimensional stochastic elliptic partial differential equations using deep neural networks
- Data-driven polynomial ridge approximation using variable projection
- Gradient-based dimension reduction of multivariate vector-valued functions
- Clustered active-subspace based local Gaussian process emulator for high-dimensional and complex computer models
- A generalized active subspace for dimension reduction in mixed aleatory-epistemic uncertainty quantification
- A sample-efficient deep learning method for multivariate uncertainty qualification of acoustic-vibration interaction problems
- Accelerated scale bridging with sparsely approximated Gaussian learning
- Exploiting active subspaces to quantify uncertainty in the numerical simulation of the hyshot II scramjet
- Surrogate modeling for high dimensional uncertainty propagation via deep kernel polynomial chaos expansion
- Bounds optimization of model response moments: a twin-engine Bayesian active learning method
- \texttt{PCE-Net}: high-dimensional surrogate modeling for learning uncertainty
- Additive Multi-Index Gaussian Process Modeling, with Application to Multi-Physics Surrogate Modeling of the Quark-Gluon Plasma
- Dice and slice simulation optimization for high-dimensional discrete problems
- Non-degenerate marginal-likelihood calibration with application to quantum characterization
- Uncertainty quantification for complex systems with very high dimensional response using Grassmann manifold variations
- Bayesian adaptation of chaos representations using variational inference and sampling on geodesics
- High-dimensional nonlinear multi-fidelity model with gradient-free active subspace method
- Active subspace methods in theory and practice: applications to kriging surfaces
- Gaussian quadrature and polynomial approximation for one-dimensional ridge functions
- Symmetry results for decay solutions of elliptic systems in the whole space
- Dimension Reduction for Gaussian Process Emulation: An Application to the Influence of Bathymetry on Tsunami Heights
- Polynomial chaos expansions on principal geodesic Grassmannian submanifolds for surrogate modeling and uncertainty quantification
- Gradient-free construction of active subspaces for dimension reduction in complex models with applications to neutronics
- Active-subspace analysis of exceedance probability for shallow-water waves
- Kernel‐based active subspaces with application to computational fluid dynamics parametric problems using the discontinuous Galerkin method
- Hilbert space methods for reduced-rank Gaussian process regression
- Generalized bounds for active subspaces
- A novel active learning method based on matrix-operation RBF model for high-dimensional reliability analysis
- Variational Bayesian surrogate modelling with application to robust design optimisation
- Multi-view Bayesian optimisation in an input-output reduced space for engineering design
- ANOVA Gaussian process modeling for high-dimensional stochastic computational models
- A survey of unsupervised learning methods for high-dimensional uncertainty quantification in black-box-type problems
- Hierarchical surrogate model with dimensionality reduction technique for high-dimensional uncertainty propagation
- On the influence of over-parameterization in manifold based surrogates and deep neural operators
- Surrogate assisted active subspace and active subspace assisted surrogate -- a new paradigm for high dimensional structural reliability analysis
- Surrogate modeling of high-dimensional problems via data-driven polynomial chaos expansions and sparse partial least square
- On the Deep Active-Subspace Method
- Active subspace of neural networks: structural analysis and universal attacks
- Gaussian Process Subspace Prediction for Model Reduction
- Bayesian neural networks for predicting uncertainty in full-field material response
- A review of recent advances in surrogate models for uncertainty quantification of high-dimensional engineering applications
- A near-stationary subspace for ridge approximation
- Active learning for high-dimensional reliability using matrix-operation anisotropic RBF model embedded with multiscale graph correlation
- Bayesian learning of orthogonal embeddings for multi-fidelity Gaussian processes
- Gradient free active subspace construction using Morris screening elementary effects
- Multi-fidelity cost-aware Bayesian optimization
- An improved sufficient dimension reduction-based kriging modeling method for high-dimensional evaluation-expensive problems
This page was built for publication: Gaussian processes with built-in dimensionality reduction: applications to high-dimensional uncertainty propagation
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q726924)
