Bayesian ODE solvers: the maximum a posteriori estimate
From MaRDI portal
Publication:2058726
Abstract: It has recently been established that the numerical solution of ordinary differential equations can be posed as a nonlinear Bayesian inference problem, which can be approximately solved via Gaussian filtering and smoothing, whenever a Gauss--Markov prior is used. In this paper the class of times differentiable linear time invariant Gauss--Markov priors is considered. A taxonomy of Gaussian estimators is established, with the maximum a posteriori estimate at the top of the hierarchy, which can be computed with the iterated extended Kalman smoother. The remaining three classes are termed explicit, semi-implicit, and implicit, which are in similarity with the classical notions corresponding to conditions on the vector field, under which the filter update produces a local maximum a posteriori estimate. The maximum a posteriori estimate corresponds to an optimal interpolant in the reproducing Hilbert space associated with the prior, which in the present case is equivalent to a Sobolev space of smoothness . Consequently, using methods from scattered data approximation and nonlinear analysis in Sobolev spaces, it is shown that the maximum a posteriori estimate converges to the true solution at a polynomial rate in the fill-distance (maximum step size) subject to mild conditions on the vector field. The methodology developed provides a novel and more natural approach to study the convergence of these estimators than classical methods of convergence analysis. The methods and theoretical results are demonstrated in numerical examples.
Recommendations
- Convergence rates of Gaussian ODE filters
- A probabilistic model for the numerical solution of initial value problems
- Probabilistic solutions to ordinary differential equations as nonlinear Bayesian filtering: a new perspective
- scientific article; zbMATH DE number 802686
- Bayesian analysis of ODEs: solver optimal accuracy and Bayes factors
Cites work
- scientific article; zbMATH DE number 4041188 (Why is no real title available?)
- scientific article; zbMATH DE number 3772046 (Why is no real title available?)
- scientific article; zbMATH DE number 53382 (Why is no real title available?)
- scientific article; zbMATH DE number 192830 (Why is no real title available?)
- scientific article; zbMATH DE number 1017538 (Why is no real title available?)
- scientific article; zbMATH DE number 1796810 (Why is no real title available?)
- scientific article; zbMATH DE number 940566 (Why is no real title available?)
- scientific article; zbMATH DE number 802686 (Why is no real title available?)
- scientific article; zbMATH DE number 2208228 (Why is no real title available?)
- A Correspondence Between Bayesian Estimation on Stochastic Processes and Smoothing by Splines
- A class of approximate solutions to linear operator equations
- A globalization scheme for the generalized Gauss-Newton method
- A modern retrospective on probabilistic numerics
- A probabilistic model for the numerical solution of initial value problems
- A property of multiplication in Sobolev spaces. Some applications
- A role for symmetry in the Bayesian solution of differential equations
- An extension of a bound for functions in Sobolev spaces, with applications to \((m, s)\)-spline interpolation and smoothing
- Applied stochastic differential equations
- Asymptotic analysis of penalized likelihood and related estimators
- Bayesian Probabilistic Numerical Methods
- Bayesian filtering and smoothing
- Bayesian solution uncertainty quantification for differential equations
- Computing integrals involving the matrix exponential
- Convergence analysis of deterministic kernel-based quadrature rules in misspecified settings
- Convergence rates of Gaussian ODE filters
- Discrete-Time Solutions to the Continuous-Time Differential Lyapunov Equation With Applications to Kalman Filtering
- Distributed optimization and statistical learning via the alternating direction method of multipliers
- Error Bounds for Polynomial Spline Interpolation
- Estimation of ordinary differential equation models with discretization error quantification
- Gaussian kernel quadrature at scaled Gauss-Hermite nodes
- Gaussian processes for machine learning.
- Iterated Extended Kalman Smoother-Based Variable Splitting for $L_1$-Regularized State Estimation
- Mathematical foundations of infinite-dimensional statistical models
- Maximum likelihood estimation and uncertainty quantification for Gaussian process approximation of deterministic functions
- Nemitsky operators on Sobolev spaces
- Numerical Methods for Ordinary Differential Equations
- Probabilistic numerics and uncertainty in computations
- Probabilistic solutions to ordinary differential equations as nonlinear Bayesian filtering: a new perspective
- Pushing the Limits of Contemporary Statistics: Contributions in Honor of Jayanta K. Ghosh
- Random time step probabilistic methods for uncertainty quantification in chaotic and geometric numerical integration
- Some results on Tchebycheffian spline functions and stochastic processes
- Statistical analysis of differential equations: introducing probability measures on numerical solutions
- Stochastic differential equations. An introduction with applications.
- Stochastic interpretations and recursive algorithms for spline functions
- Strong convergence rates of probabilistic integrators for ordinary differential equations
- The Iterated Kalman Smoother as a Gauss–Newton Method
- The theory of differential equations. Classical and qualitative
- Vector-valued Lg-splines. I: Interpolating splines
Cited in
(9)- Probabilistic solutions to ordinary differential equations as nonlinear Bayesian filtering: a new perspective
- Bayesian analysis of ODEs: solver optimal accuracy and Bayes factors
- Bayesian numerical methods for nonlinear partial differential equations
- Modelling the discretization error of initial value problems using the Wishart distribution
- A role for symmetry in the Bayesian solution of differential equations
- Convergence rates of Gaussian ODE filters
- Strong convergence rates of probabilistic integrators for ordinary differential equations
- A probabilistic model for the numerical solution of initial value problems
- Bayesian solution uncertainty quantification for differential equations
This page was built for publication: Bayesian ODE solvers: the maximum a posteriori estimate
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2058726)