Efficient data assimilation for spatiotemporal chaos: a local ensemble transform Kalman filter
From MaRDI portal
Publication:2371202
DOI10.1016/J.PHYSD.2006.11.008zbMATH Open1115.62030arXivphysics/0511236OpenAlexW2160444846MaRDI QIDQ2371202FDOQ2371202
Authors: Brian R. Hunt, Eric J. Kostelich, I. Szunyogh 
Publication date: 29 June 2007
Published in: Physica D (Search for Journal in Brave)
Abstract: Data assimilation is an iterative approach to the problem of estimating the state of a dynamical system using both current and past observations of the system together with a model for the system's time evolution. Rather than solving the problem from scratch each time new observations become available, one uses the model to ``forecast the current state, using a prior state estimate (which incorporates information from past data) as the initial condition, then uses current data to correct the prior forecast to a current state estimate. This Bayesian approach is most effective when the uncertainty in both the observations and in the state estimate, as it evolves over time, are accurately quantified. In this article, we describe a practical method for data assimilation in large, spatiotemporally chaotic systems. The method is a type of ``ensemble Kalman filter, in which the state estimate and its approximate uncertainty are represented at any given time by an ensemble of system states. We discuss both the mathematical basis of this approach and its implementation; our primary emphasis is on ease of use and computational speed rather than improving accuracy over previously published approaches to ensemble Kalman filtering. We include some numerical results demonstrating the efficiency and accuracy of our implementation for assimilating real atmospheric data with the global forecast model used by the U.S. National Weather Service.
Full work available at URL: https://arxiv.org/abs/physics/0511236
Recommendations
- Estimating the state of large spatio-temporally chaotic systems
- Data assimilation algorithms for numerical models
- Local ensemble transform Kalman filter data assimilation system for the global semi-Lagrangian atmospheric model
- The dynamical-stochastic approach in the data assimilation problem
- Efficient nonlinear data-assimilation in geophysical fluid dynamics
Bayesian inference (62F15) Inference from stochastic processes and prediction (62M20) Strange attractors, chaotic dynamics of systems with hyperbolic behavior (37D45) Random dynamical systems (37H99)
Cites Work
Cited In (75)
- An efficient algorithm for stochastic ensemble smoothing
- A Corrector Result for the Wave Equation with High Oscillating Periodic Coefficients
- Ensemble Transform Algorithms for Nonlinear Smoothing Problems
- Stochastic perturbations in the semi-Lagrangian advection algorithm of the SL-AV global atmosphere model
- Kalman-Wavelet Combined Filtering
- Title not available (Why is that?)
- The Discriminative Kalman Filter for Bayesian Filtering with Nonlinear and Nongaussian Observation Models
- Can cancer cells inform us about the tumor microenvironment?
- An efficient data-driven multiscale stochastic reduced order modeling framework for complex systems
- Localization in high-dimensional Monte Carlo filtering
- An ensemble score filter for tracking high-dimensional nonlinear dynamical systems
- Mathematical foundations of hybrid data assimilation from a synchronization perspective
- Large-eddy simulation-based shape optimization for mitigating turbulent wakes of a bluff body using the regularized ensemble Kalman method
- Uniform error bounds of the ensemble transform Kalman filter for chaotic dynamics with multiplicative covariance inflation
- Autodifferentiable ensemble Kalman filters
- Robust data assimilation with noise: applications to cardiac dynamics
- Kalman filter data assimilation: targeting observations and parameter estimation
- Local ensemble transform Kalman filter data assimilation system for the global semi-Lagrangian atmospheric model
- Stochastic perturbation of tendencies and parameters of parameterizations in the global ensemble prediction system based on the SL-AV model
- Efficient nonlinear data-assimilation in geophysical fluid dynamics
- Ensemble data assimilation in the presence of cloud
- Relation between two common localisation methods for the EnKF
- Effective actions for statistical data assimilation
- Simulating surface height and terminus position for marine outlet glaciers using a level set method with data assimilation
- Exploring the need for localization in ensemble data assimilation using a hierarchical ensemble filter
- Ensemble Kalman methods for high-dimensional hierarchical dynamic space-time models
- A shadowing-based inflation scheme for ensemble data assimilation
- Unbiased ensemble square root filters
- Estimating and including observation-error correlations in data assimilation
- A hybrid ensemble transform particle filter for nonlinear and spatially extended dynamical systems
- Data assimilation in a multi-scale model
- A multiresolution ensemble Kalman filter using the wavelet decomposition
- Recent developments combining ensemble smoother and deep generative networks for facies history matching
- Diffusion forecasting model with basis functions from QR-decomposition
- Chaos and weather forecasting: the role of the unstable subspace in predictability and state estimation problems
- An efficient and statistically accurate Lagrangian data assimilation algorithm with applications to discrete element sea ice models
- Filtering nonlinear spatio-temporal chaos with autoregressive linear stochastic models
- An algebraic method for constructing stable and consistent autoregressive filters
- An efficient ensemble Kalman filter implementation via shrinkage covariance matrix estimation: exploiting prior knowledge
- Data assimilation with an extended Kalman filter for impact-produced shock-wave dynamics
- Learning biological dynamics from spatio-temporal data by Gaussian processes
- Using data assimilation to train a hybrid forecast system that combines machine-learning and knowledge-based components
- Batch seismic inversion using the iterative ensemble Kalman smoother
- Formulating the history matching problem with consistent error statistics
- Predictability and identifiability assessment of models for prostate cancer under androgen suppression therapy
- A comparison of nonlinear extensions to the ensemble Kalman filter. Gaussian anamorphosis and two-step ensemble filters
- An ensemble Kalman filter implementation based on the Ledoit and Wolf covariance matrix estimator
- Numerical linear algebra in data assimilation
- A metric tensor approach to data assimilation with adaptive moving meshes
- The Kalman stochastic ensemble filter with transformation of perturbation ensemble
- Balanced data assimilation for highly oscillatory mechanical systems
- Spatial localization for nonlinear dynamical stochastic models for excitable media
- Performance analysis of local ensemble Kalman filter
- Sensitivity of a data-assimilation system for reconstructing three-dimensional cardiac electrical dynamics
- Ensemble data assimilation for hyperbolic systems
- Forecasting turbulent modes with nonparametric diffusion models: learning from noisy data
- Data assimilation in brain tumor models
- Adaptive error covariances estimation methods for ensemble Kalman filters
- Localized error bursts in estimating the state of spatiotemporal chaos
- Filtering skill for turbulent signals for a suite of nonlinear and linear extended Kalman filters
- Inference on high-dimensional implicit dynamic models using a guided intermediate resampling filter
- Robust data assimilation using \(L_1\) and Huber norms
- On temporal scale separation in coupled data assimilation with the ensemble Kalman filter
- Second-order Accurate Ensemble Transform Particle Filters
- Robust vehicle lane keeping control with networked proactive adaptation
- Online learning of both state and dynamics using ensemble Kalman filters
- Mathematical strategies for filtering complex systems: Regularly spaced sparse observations
- Data assimilation as a nonlinear dynamical systems problem: stability and convergence of the prediction-assimilation system
- A local sigma-point unscented Kalman filter for geophysical data assimilation
- Localization and regularization for iterative ensemble smoothers
- A multifidelity ensemble Kalman filter with reduced order control variates
- Transformed and generalized localization for ensemble methods in data assimilation
- Robust ensemble Kalman filter based on exponential cost function
- Analysis of COVID-19 in Japan with extended SEIR model and ensemble Kalman filter
- Data assimilation methods for neuronal state and parameter estimation
Uses Software
This page was built for publication: Efficient data assimilation for spatiotemporal chaos: a local ensemble transform Kalman filter
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2371202)
