Newton-based stochastic optimization using q-Gaussian smoothed functional algorithms
From MaRDI portal
Publication:472587
DOI10.1016/J.AUTOMATICA.2014.08.021zbMATH Open1301.93109arXiv1311.2296OpenAlexW2026180980MaRDI QIDQ472587FDOQ472587
Authors: Debarghya Ghoshdastidar, Ambedkar Dukkipati, Shalabh Bhatnagar 
Publication date: 19 November 2014
Published in: Automatica (Search for Journal in Brave)
Abstract: We present the first q-Gaussian smoothed functional (SF) estimator of the Hessian and the first Newton-based stochastic optimization algorithm that estimates both the Hessian and the gradient of the objective function using q-Gaussian perturbations. Our algorithm requires only two system simulations (regardless of the parameter dimension) and estimates both the gradient and the Hessian at each update epoch using these. We also present a proof of convergence of the proposed algorithm. In a related recent work (Ghoshdastidar et al., 2013), we presented gradient SF algorithms based on the q-Gaussian perturbations. Our work extends prior work on smoothed functional algorithms by generalizing the class of perturbation distributions as most distributions reported in the literature for which SF algorithms are known to work and turn out to be special cases of the q-Gaussian distribution. Besides studying the convergence properties of our algorithm analytically, we also show the results of several numerical simulations on a model of a queuing network, that illustrate the significance of the proposed method. In particular, we observe that our algorithm performs better in most cases, over a wide range of q-values, in comparison to Newton SF algorithms with the Gaussian (Bhatnagar, 2007) and Cauchy perturbations, as well as the gradient q-Gaussian SF algorithms (Ghoshdastidar et al., 2013).
Full work available at URL: https://arxiv.org/abs/1311.2296
Recommendations
- Quasi-Newton smoothed functional algorithms for unconstrained and constrained simulation optimization
- Adaptive Newton-based multivariate smoothed functional algorithms for simulation optimization
- Smoothed functional algorithms for stochastic optimization using \(q\)-Gaussian distributions
- scientific article; zbMATH DE number 4185529
- Simultaneous perturbation Newton algorithms for simulation optimization
Stochastic programming (90C15) Time-scale analysis and singular perturbations in control/observation systems (93C70)
Cites Work
- Title not available (Why is that?)
- A Newton-Raphson version of the multivariate Robbins-Monro procedure
- Stochastic approximation methods for constrained and unconstrained systems
- A Stochastic Approximation Method
- Title not available (Why is that?)
- Title not available (Why is that?)
- Adaptive stochastic approximation by the simultaneous perturbation method
- Multivariate stochastic approximation using a simultaneous perturbation gradient approximation
- Stochastic Estimation of the Maximum of a Regression Function
- Title not available (Why is that?)
- Stochastic recursive algorithms for optimization. Simultaneous perturbation methods
- Adaptive Newton-based multivariate smoothed functional algorithms for simulation optimization
- Nondifferentiable optimization via smooth approximation: General analytical approach
- Convergence of a class of random search algorithms
- Estimation of the derivative of a stationary measure with respect to a control parameter
- Newton-based stochastic optimization using \(q\)-Gaussian smoothed functional algorithms
- A two Timescale Stochastic Approximation Scheme for Simulation-Based Parametric Optimization
- Smoothed functional algorithms for stochastic optimization using \(q\)-Gaussian distributions
Cited In (5)
- Adaptive Newton-based multivariate smoothed functional algorithms for simulation optimization
- Projection theorems and estimating equations for power-law models
- Quasi-Newton smoothed functional algorithms for unconstrained and constrained simulation optimization
- Newton-based stochastic optimization using \(q\)-Gaussian smoothed functional algorithms
- Smoothed functional algorithms for stochastic optimization using \(q\)-Gaussian distributions
This page was built for publication: Newton-based stochastic optimization using \(q\)-Gaussian smoothed functional algorithms
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q472587)
