Log-linear convergence and divergence of the scale-invariant \((1+1)\)-ES in noisy environments (Q633840)

From MaRDI portal
scientific article
Language Label Description Also known as
English
Log-linear convergence and divergence of the scale-invariant \((1+1)\)-ES in noisy environments
scientific article

    Statements

    Log-linear convergence and divergence of the scale-invariant \((1+1)\)-ES in noisy environments (English)
    0 references
    0 references
    0 references
    0 references
    0 references
    30 March 2011
    0 references
    This paper investigates a certain class of noisy problems which use the so-called multiplicative noise, where the noiseless objective function is perturbed by the multiplication with a noise term. The objective of this paper is to address the question of how the properties of the noise distribution relate to convergence or divergence of the \((1+1)\)-ES (evolution strategies). The authors provide a mathematical analysis of the convergence of a \((1+1)\)-ES on unimodal spherical objective functions in the presence of multiplicative noise, prove that for a positive expected value of the noisy objective function, convergence or divergence happens depending on the infimum of the support of the noise. Moreover, they investigate convergence rates and show that log-linear convergence is preserved in presence of noise. These results are an extension of the results presented in [\textit{D. V. Arnold} and \textit{H.-G. Beyer}, Comput. Optim. Appl. 24, No. 1, 135--159 (2003; Zbl 1035.90110)].
    0 references
    0 references
    0 references
    0 references
    0 references
    0 references
    0 references
    0 references
    numerical optimization
    0 references
    noisy optimization
    0 references
    stochastic optimization algorithms
    0 references
    evolution strategies
    0 references
    convergence
    0 references
    convergence rates
    0 references
    Markov chains
    0 references
    Borel-Cantelli lemma
    0 references
    0 references
    0 references