Stochastic approximation and Newton's estimate of a mixing distribution
From MaRDI portal
(Redirected from Publication:908149)
Abstract: Many statistical problems involve mixture models and the need for computationally efficient methods to estimate the mixing distribution has increased dramatically in recent years. Newton [Sankhya Ser. A 64 (2002) 306--322] proposed a fast recursive algorithm for estimating the mixing distribution, which we study as a special case of stochastic approximation (SA). We begin with a review of SA, some recent statistical applications, and the theory necessary for analysis of a SA algorithm, which includes Lyapunov functions and ODE stability theory. Then standard SA results are used to prove consistency of Newton's estimate in the case of a finite mixture. We also propose a modification of Newton's algorithm that allows for estimation of an additional unknown parameter in the model, and prove its consistency.
Recommendations
- Convergence and consistency of Newton's algorithm for estimating mixing distribution
- The stochastic approximation method for estimation of a distribution function
- scientific article; zbMATH DE number 3963027
- Stochastic approximation
- Algorithmic Learning Theory
- scientific article; zbMATH DE number 4216077
- Approximation de newton pour les équations différentielles stochastiques
- Approximating random variables by stochastic integrals
Cites work
- A mixture model approach for the analysis of microarray gene expression data.
- A recursive algorithm for nonparametric analysis with missing data
- A Stochastic Approximation Method
- Adaptive Markov Chain Monte Carlo through Regeneration
- An adaptive Metropolis algorithm
- An exploration of aspects of Bayesian multiple testing
- Bayesian nonparametrics
- Consistency and identifiability revisited
- Consistency of a recursive estimate of mixing distributions
- Convergence and consistency of Newton's algorithm for estimating mixing distribution
- Convergence of a stochastic approximation version of the EM algorithm
- Empirical Bayes Analysis of a Microarray Experiment
- Entropies and rates of convergence for maximum likelihood and Bayes estimation for mixtures of normal densities.
- Equi-energy sampler with applications in statistical inference and statistical mechanics
- scientific article; zbMATH DE number 3519671 (Why is no real title available?)
- scientific article; zbMATH DE number 3553601 (Why is no real title available?)
- scientific article; zbMATH DE number 3567782 (Why is no real title available?)
- scientific article; zbMATH DE number 1219005 (Why is no real title available?)
- scientific article; zbMATH DE number 1972910 (Why is no real title available?)
- scientific article; zbMATH DE number 2117879 (Why is no real title available?)
- I-divergence geometry of probability distributions and minimization problems
- Identifiability of Finite Mixtures
- Mixture models: theory, geometry and applications
- Nonparametric Bayesian Estimation of Positive False Discovery Rates
- Nonparametric hierarchical Bayes via sequential imputations
- On a nonparametric recursive estimator of the mixing distribution
- On the optimal rates of convergence for nonparametric deconvolution problems
- Posterior consistency of Dirichlet mixtures in density estimation
- Stability by Liapunov's direct method. With applications
- Stability of Stochastic Approximation under Verifiable Conditions
- Stochastic Approximation in Monte Carlo Computation
- The consistency of posterior distributions in nonparametric problems
- The Empirical Bayes Approach to Statistical Decision Problems
Cited in
(25)- Convergence of an iterative algorithm to the nonparametric MLE of a mixing distribution
- A semiparametric scale-mixture regression model and predictive recursion maximum likelihood
- An exact predictive recursion for Bayesian nonparametric analysis of incomplete data
- Asymptotic properties of predictive recursion: robustness and rate of convergence
- A survey of nonparametric mixing density estimation via the predictive recursion algorithm
- Estimating a mixing distribution on the sphere using predictive recursion
- Hyperparameter Estimation Using Stochastic Approximation with Application to Population Pharmacokinetics
- Convergence rate for predictive recursion estimation of finite mixtures
- A class of measure-valued Markov chains and Bayesian nonparametrics
- On recursive Bayesian predictive distributions
- An Approximate Bayesian Marginal Likelihood Approach for Estimating Finite Mixtures
- A Laplace transform inversion method for probability distribution functions
- On two fast algorithms for estimating the mixing distribution in mixture models
- An efficient stochastic Newton algorithm for parameter estimation in logistic regressions
- Asymptotically optimal nonparametric empirical Bayes via predictive recursion
- Convergence and consistency of Newton's algorithm for estimating mixing distribution
- Algorithmic Learning Theory
- Revisiting consistency of a recursive estimator of mixing distributions
- Computationally efficient variational-like approximations of possibilistic inferential models
- Dirichlet compound negative multinomial mixture models and applications
- Anytime-valid and asymptotically efficient inference driven by predictive recursion
- Recursive nonparametric predictive for a discrete regression model
- Quasi-Bayes empirical Bayes: a sequential approach to the Poisson compound decision problem
- Consistency of a recursive estimate of mixing distributions
- Dempster-Shafer theory and statistical inference with weak beliefs
This page was built for publication: Stochastic approximation and Newton's estimate of a mixing distribution
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q908149)
