On-line expectation-maximization algorithm for latent data models
From MaRDI portal
Abstract: In this contribution, we propose a generic online (also sometimes called adaptive or recursive) version of the Expectation-Maximisation (EM) algorithm applicable to latent variable models of independent observations. Compared to the algorithm of Titterington (1984), this approach is more directly connected to the usual EM algorithm and does not rely on integration with respect to the complete data distribution. The resulting algorithm is usually simpler and is shown to achieve convergence to the stationary points of the Kullback-Leibler divergence between the marginal distribution of the observation and the model distribution at the optimal rate, i.e., that of the maximum likelihood estimator. In addition, the proposed approach is also suitable for conditional (or regression) models, as illustrated in the case of the mixture of linear regressions model.
Recommendations
- Online expectation maximization based algorithms for inference in hidden Markov models
- Convergence of a particle-based approximation of the block online expectation maximization algorithm
- Online Learning with Hidden Markov Models
- Advances in Intelligent Data Analysis VI
- Online EM algorithm for mixture with application to Internet traffic modeling
Cites work
- Acceleration of Stochastic Approximation by Averaging
- Almost sure convergence of Titterington's recursive estimator for mixture models
- Convergence rate and averaging of nonlinear two-time-scale stochastic approximation algo\-rithms
- scientific article; zbMATH DE number 3886919 (Why is no real title available?)
- scientific article; zbMATH DE number 3567782 (Why is no real title available?)
- scientific article; zbMATH DE number 739537 (Why is no real title available?)
- scientific article; zbMATH DE number 1059776 (Why is no real title available?)
- New method of stochastic approximation type
- On the convergence properties of the EM algorithm
- Online EM algorithm for mixture with application to Internet traffic modeling
- Recursive EM and SAGE-inspired algorithms with application to DOA estimation
- Stability of Stochastic Approximation under Verifiable Conditions
- Statistical analysis of finite mixture distributions
- Stochastic approximation and its applications
- Tools for statistical inference. Methods for the exploration of posterior distributions and likelihood functions.
- Weak convergence rates for stochastic approximation with application to multiple targets and simulated annealing
Cited in
(70)- Stream-suitable optimization algorithms for some soft-margin support vector machine variants
- An online expectation maximization algorithm for exploring general structure in massive networks
- Online multi-label dependency topic models for text classification
- Online EM for functional data
- Estimating random-intercept models on data streams
- Latent tree models for hierarchical topic detection
- Online expectation maximization based algorithms for inference in hidden Markov models
- Fast incremental expectation maximization for finite-sum optimization: nonasymptotic convergence
- Online inference with multi-modal likelihood functions
- Summary statistics and discrepancy measures for approximate Bayesian computation via surrogate posteriors
- Simulation of foraging behavior using a decision-making agent with Bayesian and inverse Bayesian inference: temporal correlations and power laws in displacement patterns
- Inertial stochastic PALM and applications in machine learning
- Mini-batch learning of exponential family finite mixture models
- Efficient inference in state-space models through adaptive learning in online Monte Carlo expectation maximization
- Properties of the stochastic approximation EM algorithm with mini-batch sampling
- Robust identification of linear ARX models with recursive EM algorithm based on Student's t-distribution
- On-line EM variants for multivariate normal mixture model in background learning and moving foreground detection
- Online EM algorithm for mixture with application to Internet traffic modeling
- Estimating multilevel models on data streams
- Statistical models for deformable templates in image and shape analysis
- On particle methods for parameter estimation in state-space models
- Online algorithm for variance components estimation
- Compressive statistical learning with random feature moments
- Online model selection based on the variational Bayes
- Online k-MLE for mixture modeling with exponential families
- Bag-of-components: an online algorithm for batch learning of mixture models
- An Asynchronous Distributed Expectation Maximization Algorithm for Massive Data: The DEM Algorithm
- Online Learning with Hidden Markov Models
- Posterior weighted reinforcement learning with state uncertainty
- Model-based clustering of high-dimensional data streams with online mixture of probabilistic PCA
- Nonparametric estimation of multivariate elliptic densities via finite mixture sieves
- scientific article; zbMATH DE number 1222290 (Why is no real title available?)
- Convergence of a particle-based approximation of the block online expectation maximization algorithm
- Online but accurate inference for latent variable models with local Gibbs sampling
- On-Line Inference for Hidden Markov Models via Particle Filters
- On-line EM Algorithm for the Normalized Gaussian Network
- Recursive online EM estimation of mixture autoregressions
- Online identification of time-delay jump Markov autoregressive exogenous systems with recursive expectation-maximization algorithm
- Recursive parameter estimation algorithm of the Dirichlet hidden Markov model
- Stochastic multichannel ranking with brain dynamics preferences
- Online learning with (multiple) kernels: a review
- Emergence of optimal decoding of population codes through STDP
- Online learning of single- and multivalued functions with an infinite mixture of linear experts
- Online EM with weight-based forgetting
- Bayesian inference and online learning in Poisson neuronal networks
- Advances in Intelligent Data Analysis VI
- Dynamic Stochastic Blockmodel Regression for Network Data: Application to International Militarized Conflicts
- Scalable estimation strategies based on stochastic approximations: classical results and new insights
- Global implicit function theorems and the online expectation–maximisation algorithm
- Multivariate online regression analysis with heterogeneous streaming data
- A Clustered Gaussian Process Model for Computer Experiments
- Graph prototypical contrastive learning
- Divide-and-conquer Bayesian inference in hidden Markov models
- Stochastic variable metric proximal gradient with variance reduction for non-convex composite optimization
- The limited-memory recursive variational Gaussian approximation (L-RVGA)
- Doubly-online changepoint detection for monitoring health status during sports activities
- Identifiability of discrete input–output hidden Markov models with external signals
- Improvements on scalable stochastic Bayesian inference methods for multivariate Hawkes process
- Recent developments in expectation-maximization methods for analyzing complex data
- Improving tree probability estimation with stochastic optimization and variance reduction
- Scalable magnetic resonance fingerprinting: incremental inference of high-dimensional elliptical mixtures from large data volumes
- Sequential sample average majorization-minimization
- Adaptive unsupervised anomaly detection in variable environment by online expectation maximization
- Robust online identification method for biofabrication processes with multiple unknown disturbances
- A guide to stochastic optimisation for large-scale inverse problems
- Estimation of two-layer Gaussian mixture model for streaming longitudinal data in Bayesian framework
- Distributed online expectation-maximization algorithm for Poisson mixture model
- Accelerated distributed expectation-maximization algorithms for the parameter estimation in multivariate Gaussian mixture models
- Short-term forecasting with optimal transport
- Adaptive sequential Monte Carlo by means of mixture of experts
This page was built for publication: On-line expectation-maximization algorithm for latent data models
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2920258)
