Efficient data assimilation for spatiotemporal chaos: a local ensemble transform Kalman filter
From MaRDI portal
Publication:2371202
Abstract: Data assimilation is an iterative approach to the problem of estimating the state of a dynamical system using both current and past observations of the system together with a model for the system's time evolution. Rather than solving the problem from scratch each time new observations become available, one uses the model to ``forecast the current state, using a prior state estimate (which incorporates information from past data) as the initial condition, then uses current data to correct the prior forecast to a current state estimate. This Bayesian approach is most effective when the uncertainty in both the observations and in the state estimate, as it evolves over time, are accurately quantified. In this article, we describe a practical method for data assimilation in large, spatiotemporally chaotic systems. The method is a type of ``ensemble Kalman filter, in which the state estimate and its approximate uncertainty are represented at any given time by an ensemble of system states. We discuss both the mathematical basis of this approach and its implementation; our primary emphasis is on ease of use and computational speed rather than improving accuracy over previously published approaches to ensemble Kalman filtering. We include some numerical results demonstrating the efficiency and accuracy of our implementation for assimilating real atmospheric data with the global forecast model used by the U.S. National Weather Service.
Recommendations
- Estimating the state of large spatio-temporally chaotic systems
- Data assimilation algorithms for numerical models
- Local ensemble transform Kalman filter data assimilation system for the global semi-Lagrangian atmospheric model
- The dynamical-stochastic approach in the data assimilation problem
- Efficient nonlinear data-assimilation in geophysical fluid dynamics
Cites work
Cited in
(91)- Performance analysis of local ensemble Kalman filter
- Localization and regularization for iterative ensemble smoothers
- A multiresolution ensemble Kalman filter using the wavelet decomposition
- Data assimilation methods for neuronal state and parameter estimation
- Ensemble data assimilation for hyperbolic systems
- A shadowing-based inflation scheme for ensemble data assimilation
- Formulating the history matching problem with consistent error statistics
- An efficient ensemble Kalman filter implementation via shrinkage covariance matrix estimation: exploiting prior knowledge
- Batch seismic inversion using the iterative ensemble Kalman smoother
- Balanced data assimilation for highly oscillatory mechanical systems
- Online learning of both state and dynamics using ensemble Kalman filters
- A local sigma-point unscented Kalman filter for geophysical data assimilation
- Analysis of COVID-19 in Japan with extended SEIR model and ensemble Kalman filter
- Stochastic perturbation of tendencies and parameters of parameterizations in the global ensemble prediction system based on the SL-AV model
- Simulating surface height and terminus position for marine outlet glaciers using a level set method with data assimilation
- An efficient and statistically accurate Lagrangian data assimilation algorithm with applications to discrete element sea ice models
- Learning biological dynamics from spatio-temporal data by Gaussian processes
- A comparison of nonlinear extensions to the ensemble Kalman filter. Gaussian anamorphosis and two-step ensemble filters
- A metric tensor approach to data assimilation with adaptive moving meshes
- Predictability and identifiability assessment of models for prostate cancer under androgen suppression therapy
- An ensemble Kalman filter implementation based on the Ledoit and Wolf covariance matrix estimator
- Recent developments combining ensemble smoother and deep generative networks for facies history matching
- Spatial localization for nonlinear dynamical stochastic models for excitable media
- Forecasting turbulent modes with nonparametric diffusion models: learning from noisy data
- Exploring the need for localization in ensemble data assimilation using a hierarchical ensemble filter
- Data assimilation in a multi-scale model
- Transformed and generalized localization for ensemble methods in data assimilation
- Data assimilation in brain tumor models
- Kalman filter data assimilation: targeting observations and parameter estimation
- Chaos and weather forecasting: the role of the unstable subspace in predictability and state estimation problems
- Local ensemble transform Kalman filter data assimilation system for the global semi-Lagrangian atmospheric model
- Estimating and including observation-error correlations in data assimilation
- scientific article; zbMATH DE number 4202180 (Why is no real title available?)
- A Corrector Result for the Wave Equation with High Oscillating Periodic Coefficients
- Adaptive error covariances estimation methods for ensemble Kalman filters
- Effective actions for statistical data assimilation
- Filtering skill for turbulent signals for a suite of nonlinear and linear extended Kalman filters
- Filtering nonlinear spatio-temporal chaos with autoregressive linear stochastic models
- Mathematical foundations of hybrid data assimilation from a synchronization perspective
- Robust data assimilation with noise: applications to cardiac dynamics
- Using data assimilation to train a hybrid forecast system that combines machine-learning and knowledge-based components
- A multifidelity ensemble Kalman filter with reduced order control variates
- The Kalman stochastic ensemble filter with transformation of perturbation ensemble
- An efficient algorithm for stochastic ensemble smoothing
- Autodifferentiable ensemble Kalman filters
- Ensemble Kalman methods for high-dimensional hierarchical dynamic space-time models
- The Discriminative Kalman Filter for Bayesian Filtering with Nonlinear and Nongaussian Observation Models
- Sensitivity of a data-assimilation system for reconstructing three-dimensional cardiac electrical dynamics
- Robust ensemble Kalman filter based on exponential cost function
- Data assimilation as a nonlinear dynamical systems problem: stability and convergence of the prediction-assimilation system
- Ensemble Transform Algorithms for Nonlinear Smoothing Problems
- Localization in high-dimensional Monte Carlo filtering
- Robust data assimilation using \(L_1\) and Huber norms
- Second-order Accurate Ensemble Transform Particle Filters
- Relation between two common localisation methods for the EnKF
- Efficient nonlinear data-assimilation in geophysical fluid dynamics
- Ensemble data assimilation in the presence of cloud
- Localized error bursts in estimating the state of spatiotemporal chaos
- A hybrid ensemble transform particle filter for nonlinear and spatially extended dynamical systems
- Kalman-Wavelet Combined Filtering
- scientific article; zbMATH DE number 7660131 (Why is no real title available?)
- Data assimilation with an extended Kalman filter for impact-produced shock-wave dynamics
- An efficient data-driven multiscale stochastic reduced order modeling framework for complex systems
- Can cancer cells inform us about the tumor microenvironment?
- Robust vehicle lane keeping control with networked proactive adaptation
- Numerical linear algebra in data assimilation
- Stochastic perturbations in the semi-Lagrangian advection algorithm of the SL-AV global atmosphere model
- An ensemble score filter for tracking high-dimensional nonlinear dynamical systems
- Large-eddy simulation-based shape optimization for mitigating turbulent wakes of a bluff body using the regularized ensemble Kalman method
- Uniform error bounds of the ensemble transform Kalman filter for chaotic dynamics with multiplicative covariance inflation
- A robust ensemble time-localization H-infinity filter for chaotic dynamical models
- Learning enhanced ensemble filters
- Robust adaptive meshing, mesh density functions, and nonlocal observations for ensemble based data assimilation
- Enhancement of large-eddy simulations for the prediction of an intake flow rig using sequential data assimilation
- Preserving nonlinear constraints in variational flow filtering data assimilation
- A fast computation method for the matrix inverse square root using the sum of resolvents and batch execution
- State-observation augmented diffusion model for nonlinear assimilation with unknown dynamics
- Data assimilation: from mathematical and statistical foundations to applications. Abstracts from the workshop held February 23--28, 2025
- Ensemble Kalman methods: a mean-field perspective
- Quantitative comparison of variational and sequential data assimilation techniques for one-dimensional initial-value problems of ideal MHD
- Scalable marginalized particle filter to improve state estimation of one-way coupled PDE systems
- Multi-level data assimilation for ocean forecasting using the shallow-water equations
- Ensemble variational Fokker-Planck methods for data assimilation
- Diffusion forecasting model with basis functions from QR-decomposition
- A score-based diffusion model approach for adaptive learning of stochastic partial differential equation solutions
- Ensemble Controlled-Flow Filtering for Implicit Data Assimilation
- An algebraic method for constructing stable and consistent autoregressive filters
- On temporal scale separation in coupled data assimilation with the ensemble Kalman filter
- Inference on high-dimensional implicit dynamic models using a guided intermediate resampling filter
- Mathematical strategies for filtering complex systems: Regularly spaced sparse observations
- Unbiased ensemble square root filters
This page was built for publication: Efficient data assimilation for spatiotemporal chaos: a local ensemble transform Kalman filter
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2371202)
