Optimal design of validation experiments for the prediction of quantities of interest
From MaRDI portal
Abstract: Numerical predictions of quantities of interest measured within physical systems rely on the use of mathematical models that should be validated, or at best, not invalidated. Model validation usually involves the comparison of experimental data (outputs from the system of interest) and model predictions, both obtained at a specific validation scenario. The design of this validation experiment should be directly relevant to the objective of the model, that of predicting a quantity of interest at a prediction scenario. In this paper, we address two specific issues arising when designing validation experiments. The first issue consists in determining an appropriate validation scenario in cases where the prediction scenario cannot be carried out in a controlled environment. The second issue concerns the selection of observations when the quantity of interest cannot be readily observed. The proposed methodology involves the computation of influence matrices that characterize the response surface of given model functionals. Minimization of the distance between influence matrices allow one for selecting a validation experiment most representative of the prediction scenario. We illustrate our approach on two numerical examples. The first example considers the validation of a simple model based on an ordinary differential equation governing an object in free fall to put in evidence the importance of the choice of the validation experiment. The second numerical experiment focuses on the transport of a pollutant and demonstrates the impact that the choice of the quantity of interest has on the validation experiment to be performed.
Recommendations
- Designing combined physical and computer experiments to maximize prediction accuracy
- Qualitative and quantitative experiment design for phenomenological models - a survey
- A robust optimization approach to experimental design for model discrimination of dynamical systems
- A probabilistic construction of model validation
- scientific article; zbMATH DE number 2153004
Cites work
- A Bayesian framework for adaptive selection, calibration, and validation of coarse-grained models of atomistic systems
- A comprehensive framework for verification, validation, and uncertainty quantification in scientific computing
- A Review of Modern Computational Algorithms for Bayesian Optimal Design
- Active subspace methods in theory and practice: applications to kriging surfaces
- Active subspaces. Emerging ideas for dimension reduction in parameter studies
- Algorithm 1027: NOMAD Version 4: Nonlinear Optimization with the MADS Algorithm
- Asymptotic theory of statistics and probability
- Basics and Trends in Sensitivity Analysis
- Bayesian calibration of computer models. (With discussion)
- Ensemble samplers with affine invariance
- Fast Bayesian experimental design: Laplace-based importance sampling for the expected information gain
- Fast estimation of expected information gains for Bayesian experimental designs based on Laplace approximations
- Global sensitivity indices for nonlinear mathematical models and their Monte Carlo estimates
- scientific article; zbMATH DE number 5043156 (Why is no real title available?)
- Hyper-differential sensitivity analysis for inverse problems constrained by partial differential equations
- Introduction to uncertainty quantification
- Model validation and predictive capability for the thermal challenge problem
- Optimization with PDE Constraints
- Optimum experimental designs, with SAS
- Parameter redundancy and identifiability
- Toward selecting optimal predictive multiscale models
- Uncertainty and information: foundations of generalized information theory.
- Unified form language: a domain-specific language for weak formulations of partial differential equations
Cited in
(2)
This page was built for publication: Optimal design of validation experiments for the prediction of quantities of interest
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6171231)
