A Global Stochastic Optimization Particle Filter Algorithm
From MaRDI portal
Publication:6344760
DOI10.1093/BIOMET/ASAB067arXiv2007.04803WikidataQ115582914 ScholiaQ115582914MaRDI QIDQ6344760FDOQ6344760
Authors: Mathieu Gerber, Randal Douc 
Publication date: 9 July 2020
Abstract: We introduce a new online algorithm for expected log-likelihood maximization in situations where the objective function is multi-modal and/or has saddle points, that we term G-PFSO. The key element underpinning G-PFSO is a probability distribution which (a) is shown to concentrate on the target parameter value as the sample size increases and (b) can be efficiently estimated by means of a standard particle filter algorithm. This distribution depends on a learning rate, where the faster the learning rate the quicker it concentrates on the desired element of the search space, but the less likely G-PFSO is to escape from a local optimum of the objective function. In order to achieve a fast convergence rate with a slow learning rate, G-PFSO exploits the acceleration property of averaging, well-known in the stochastic gradient literature. Considering several challenging estimation problems, the numerical experiments show that, with high probability, G-PFSO successfully finds the highest mode of the objective function and converges to its global maximizer at the optimal rate. While the focus of this work is expected log-likelihood maximization, the proposed methodology and its theory apply more generally for optimizing a function defined through an expectation.
This page was built for publication: A Global Stochastic Optimization Particle Filter Algorithm
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6344760)
