Rising Above Chaotic Likelihoods
From MaRDI portal
Publication:5269862
Abstract: Berliner (Likelihood and Bayesian prediction for chaotic systems, J. Am. Stat. Assoc. 1991) identified a number of difficulties in using the likelihood function within the Bayesian paradigm which arise both for state estimation and for parameter estimation of chaotic systems. Even when the equations of the system are given, he demonstrated "chaotic likelihood functions" both of initial conditions and of parameter values in the Logistic Map. Chaotic likelihood functions, while ultimately smooth, have such complicated small scale structure as to cast doubt on the possibility of identifying high likelihood states in practice. In this paper, the challenge of chaotic likelihoods is overcome by embedding the observations in a higher dimensional sequence-space; this allows good state estimation with finite computational power. An importance sampling approach is introduced, where Pseudo-orbit Data Assimilation is employed in the sequence-space, first to identify relevant pseudo-orbits and then relevant trajectories. Estimates are identified with likelihoods orders of magnitude higher than those previously identified in the examples given by Berliner. Pseudo-orbit Data Assimilation importance sampler exploits the information both from the model dynamics and from the observations. While sampling from the relevant prior (here, the natural measure) will, of course, eventually yield an accountable sample, given the realistic computational resource this traditional approach would provide no high likelihood points at all. While one of the challenges Berliner posed is overcome, his central conclusion is supported. "Chaotic likelihood functions" for parameter estimation still pose a challenge; this fact helps clarify why physical scientists maintain a strong distinction between the initial condition uncertainty and parameter uncertainty.
Recommendations
- Likelihood and Bayesian Prediction of Chaotic Systems
- The role of the likelihood function in the estimating of chaos models
- Bayesian learning when chaos looms large
- Chaos: A statistical perspective
- Bigger than chaos. Understanding complexity through probability
- Maximum likelihood estimation of stochastic chaos representations from experimental data
- Emergence of randomness from chaos
- Predicting and estimating probability density functions of chaotic systems
Cites work
- scientific article; zbMATH DE number 1782877 (Why is no real title available?)
- scientific article; zbMATH DE number 1866304 (Why is no real title available?)
- Asymptotic inference for dynamical systems observed with error
- Beneath the noise, chaos
- Ensemble forecasting
- Examples of inconsistent Bayes procedures based on observations on dynamical systems
- Exploiting dynamical coherence: a geometric approach to parameter estimation in nonlinear models
- Gradient free descent: Shadowing, and state estimation using limited derivative information
- Indistinguishable states. I: Pefect model scenario.
- Indistinguishable states. II: The imperfect model scenario
- Likelihood and Bayesian Prediction of Chaotic Systems
- Singular vectors and the predictability of weather and climate
- State and parameter estimation in nonlinear systems as an optimal tracking problem
- Statistics for spatio-temporal data
Cited in
(2)
This page was built for publication: Rising Above Chaotic Likelihoods
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5269862)
