A Stochastic Approximation Method
From MaRDI portal
Publication:5825431
DOI10.1214/aoms/1177729586zbMath0054.05901OpenAlexW1994616650WikidataQ56431135 ScholiaQ56431135MaRDI QIDQ5825431
Publication date: 1951
Published in: The Annals of Mathematical Statistics (Search for Journal in Brave)
Full work available at URL: https://doi.org/10.1214/aoms/1177729586
Related Items (only showing first 100 items - show all)
A probabilistic generative model for semi-supervised training of coarse-grained surrogates and enforcing physical constraints through virtual observables ⋮ Stochastic gradient descent for semilinear elliptic equations with uncertainties ⋮ Accelerating mini-batch SARAH by step size rules ⋮ An empirical study into finding optima in stochastic optimization of neural networks ⋮ Relative entropy minimization over Hilbert spaces via Robbins-Monro ⋮ Sequential changepoint detection in neural networks with checkpoints ⋮ An adaptive Hessian approximated stochastic gradient MCMC method ⋮ An online conjugate gradient algorithm for large-scale data analysis in machine learning ⋮ Hamiltonian Markov chain Monte Carlo for partitioned sample spaces with application to Bayesian deep neural nets ⋮ Convergence of stochastic proximal gradient algorithm ⋮ Stochastic approximation on Riemannian manifolds ⋮ Analysis of biased stochastic gradient descent using sequential semidefinite programs ⋮ Distributed stochastic gradient tracking methods ⋮ Dynamic stochastic approximation for multi-stage stochastic optimization ⋮ Concentration inequalities for additive functionals: a martingale approach ⋮ A neural network-based framework for financial model calibration ⋮ Resolving learning rates adaptively by locating stochastic non-negative associated gradient projection points using line searches ⋮ Momentum and stochastic momentum for stochastic gradient, Newton, proximal point and subspace descent methods ⋮ Stochastic proximal gradient methods for nonconvex problems in Hilbert spaces ⋮ Stability bounds and almost sure convergence of improved particle swarm optimization methods ⋮ Gas storage valuation in incomplete markets ⋮ Convergence rates for optimised adaptive importance samplers ⋮ Attacker-defender model against quantal response adversaries for cyber security in logistics management: an introductory study ⋮ A unified convergence analysis of stochastic Bregman proximal gradient and extragradient methods ⋮ Preferential attachment with location-based choice: degree distribution in the noncondensation phase ⋮ A selective overview of deep learning ⋮ Stochastic approximation: from statistical origin to big-data, multidisciplinary applications ⋮ Conservative set valued fields, automatic differentiation, stochastic gradient methods and deep learning ⋮ Stochastic quasi-gradient methods: variance reduction via Jacobian sketching ⋮ Asymptotic distribution and convergence rates of stochastic algorithms for entropic optimal transportation between probability measures ⋮ A survey of nonparametric mixing density estimation via the predictive recursion algorithm ⋮ Stochastic approximation algorithms for superquantiles estimation ⋮ Data-driven algorithm selection and tuning in optimization and signal processing ⋮ On the convergence of stochastic approximations under a subgeometric ergodic Markov dynamic ⋮ Fast and safe: accelerated gradient methods with optimality certificates and underestimate sequences ⋮ Fastest rates for stochastic mirror descent methods ⋮ Inexact stochastic subgradient projection method for stochastic equilibrium problems with nonmonotone bifunctions: application to expected risk minimization in machine learning ⋮ On the analysis of variance-reduced and randomized projection variants of single projection schemes for monotone stochastic variational inequality problems ⋮ Surrogate optimization of deep neural networks for groundwater predictions ⋮ Incremental without replacement sampling in nonconvex optimization ⋮ Variance-based single-call proximal extragradient algorithms for stochastic mixed variational inequalities ⋮ A stochastic primal-dual method for optimization with conditional value at risk constraints ⋮ Brain tumor classification in MRI image using convolutional neural network ⋮ Interpolation of sparse high-dimensional data ⋮ Material optimization of tri-directional functionally graded plates by using deep neural network and isogeometric multimesh design approach ⋮ Variance-based subgradient extragradient method for stochastic variational inequality problems ⋮ Nonlinear Kaczmarz algorithms and their convergence ⋮ Concentration bounds for temporal difference learning with linear function approximation: the case of batch data and uniform sampling ⋮ Infinite-dimensional gradient-based descent for alpha-divergence minimisation ⋮ Stochastic DCA for minimizing a large sum of DC functions with application to multi-class logistic regression ⋮ Stochastic generalized gradient methods for training nonconvex nonsmooth neural networks ⋮ Efficient stochastic optimisation by unadjusted Langevin Monte Carlo. Application to maximum marginal likelihood and empirical Bayesian estimation ⋮ Analysis of stochastic gradient descent in continuous time ⋮ Fast incremental expectation maximization for finite-sum optimization: nonasymptotic convergence ⋮ Ensemble slice sampling. Parallel, black-box and gradient-free inference for correlated \& multimodal distributions ⋮ Exact confidence limits compatible with the result of a sequential trial ⋮ Gibbs posterior inference on multivariate quantiles ⋮ NPTC-net: narrow-band parallel transport convolutional neural networks on point clouds ⋮ A comprehensive and systematic look up into deep learning based object detection techniques: a review ⋮ Updating variational Bayes: fast sequential posterior inference ⋮ The recursive variational Gaussian approximation (R-VGA) ⋮ Revisiting the ODE method for recursive algorithms: fast convergence using quasi stochastic approximation ⋮ Finding best approximation pairs for two intersections of closed convex sets ⋮ On the mean field limit of the random batch method for interacting particle systems ⋮ Nonparametric recursive regression estimation on Riemannian manifolds ⋮ Inverse reinforcement learning in contextual MDPs ⋮ ProcData: an R package for process data analysis ⋮ Noise-induced degeneration in online learning ⋮ A regularized stochastic subgradient projection method for an optimal control problem in a stochastic partial differential equation ⋮ Mapping interstellar dust with Gaussian processes ⋮ On the local convergence of a stochastic semismooth Newton method for nonsmooth nonconvex optimization ⋮ Parallel-and-stream accelerator for computationally fast supervised learning ⋮ Dimension independent excess risk by stochastic gradient descent ⋮ Variable metric proximal stochastic variance reduced gradient methods for nonconvex nonsmooth optimization ⋮ A fast stochastic approximation-based subgradient extragradient algorithm with variance reduction for solving stochastic variational inequality problems ⋮ SRKCD: a stabilized Runge-Kutta method for stochastic optimization ⋮ Stopping criteria for, and strong convergence of, stochastic gradient descent on Bottou-Curtis-Nocedal functions ⋮ Estimating a mixing distribution on the sphere using predictive recursion ⋮ High-performance statistical computing in the computing environments of the 2020s ⋮ Fundamental design principles for reinforcement learning algorithms ⋮ SABRINA: a stochastic subspace majorization-minimization algorithm ⋮ Constructing unbiased gradient estimators with finite variance for conditional stochastic optimization ⋮ Robbins-Monro algorithm with \(\psi\)-mixing random errors ⋮ Finite-sample analysis of nonlinear stochastic approximation with applications in reinforcement learning ⋮ On the convergence of a block-coordinate incremental gradient method ⋮ Fast Bayesian inference on spectral analysis of multivariate stationary time series ⋮ Matrices -- compensating the loss of anschauung ⋮ An adaptive Polyak heavy-ball method ⋮ A stochastic Nesterov's smoothing accelerated method for general nonsmooth constrained stochastic composite convex optimization ⋮ Computation for latent variable model estimation: a unified stochastic proximal framework ⋮ A stochastic gradient algorithm with momentum terms for optimal control problems governed by a convection-diffusion equation with random diffusivity ⋮ A subsampling approach for Bayesian model selection ⋮ Schwarz waveform relaxation-learning for advection-diffusion-reaction equations ⋮ Variational inference with vine copulas: an efficient approach for Bayesian computer model calibration ⋮ A stochastic first-order trust-region method with inexact restoration for finite-sum minimization ⋮ On stochastic accelerated gradient with convergence rate ⋮ Self-adaptive physics-informed neural networks ⋮ Two-stage linear decision rules for multi-stage stochastic programming ⋮ Accelerating variance-reduced stochastic gradient methods ⋮ A hybrid stochastic optimization framework for composite nonconvex optimization
This page was built for publication: A Stochastic Approximation Method
