Minibatch forward-backward-forward methods for solving stochastic variational inequalities
From MaRDI portal
Publication:5084485
Abstract: We develop a new stochastic algorithm with variance reduction for solving pseudo-monotone stochastic variational inequalities. Our method builds on Tseng's forward-backward-forward (FBF) algorithm, which is known in the deterministic literature to be a valuable alternative to Korpelevich's extragradient method when solving variational inequalities over a convex and closed set governed by pseudo-monotone, Lipschitz continuous operators. The main computational advantage of Tseng's algorithm is that it relies only on a single projection step and two independent queries of a stochastic oracle. Our algorithm incorporates a variance reduction mechanism and leads to almost sure (a.s.) convergence to an optimal solution. To the best of our knowledge, this is the first stochastic look-ahead algorithm achieving this by using only a single projection at each iteration..
Recommendations
- scientific article; zbMATH DE number 7652675
- A fast stochastic approximation-based subgradient extragradient algorithm with variance reduction for solving stochastic variational inequality problems
- New first-order algorithms for stochastic variational inequalities
- Stochastic projection gradient algorithm for stochastic variational inequalities
- Solving variational inequalities with stochastic mirror-prox algorithm
Cites work
- scientific article; zbMATH DE number 3534286 (Why is no real title available?)
- scientific article; zbMATH DE number 1043533 (Why is no real title available?)
- scientific article; zbMATH DE number 2107836 (Why is no real title available?)
- A Modified Forward-Backward Splitting Method for Maximal Monotone Mappings
- A New Projection Method for Variational Inequality Problems
- Asymptotic Theory for Solutions in Statistical Estimation and Stochastic Programming
- Distributed computation of equilibria in monotone Nash games via iterative regularization techniques
- Distributed optimization and statistical learning via the alternating direction method of multipliers
- Extragradient Method with Variance Reduction for Stochastic Variational Inequalities
- Finite-Dimensional Variational Inequalities and Complementarity Problems
- Fractional Programming for Communication Systems—Part I: Power Control and Beamforming
- Learning in games with continuous action sets and unknown payoff functions
- Lectures on Stochastic Programming
- On perturbed proximal gradient algorithms
- On smoothing, regularization, and averaging in stochastic approximation methods for stochastic variational inequality problems
- On the convergence properties of non-Euclidean extragradient methods for variational inequalities with generalized monotone operators
- On variance reduction for stochastic smooth convex optimization with multiplicative noise
- Optimal stochastic extragradient schemes for pseudomonotone stochastic variational inequality problems and their variants
- Optimization methods for large-scale machine learning
- Probability theory. An analytic view.
- Pseudo-monotone complementarity problems in Hilbert space
- Solving variational inequalities with stochastic mirror-prox algorithm
- Stochastic Approximation Approaches to the Stochastic Variational Inequality Problem
- Stochastic accelerated alternating direction method of multipliers with importance sampling
- Stochastic algorithms
- Stochastic forward-backward splitting for monotone inclusions
- Stochastic mirror descent dynamics and their convergence in monotone variational inequalities
- Stochastic quasi-Fejér block-coordinate fixed point iterations with random sweeping
Cited in
(17)- New first-order algorithms for stochastic variational inequalities
- Two fast variance-reduced proximal gradient algorithms for SMVIPs -- stochastic mixed variational inequality problems with suitable applications to stochastic network games and traffic assignment problems
- Variance-based modified backward-forward algorithm with line search for stochastic variational inequality problems and its applications
- Improved variance reduction extragradient method with line search for stochastic variational inequalities
- An accelerated stochastic extragradient-like algorithm with new stepsize rules for stochastic variational inequalities
- Variable sample-size optimistic mirror descent algorithm for stochastic mixed variational inequalities
- A fast stochastic approximation-based subgradient extragradient algorithm with variance reduction for solving stochastic variational inequality problems
- Smooth monotone stochastic variational inequalities and saddle point problems: a survey
- Stochastic relaxed inertial forward-backward-forward splitting for monotone inclusions in Hilbert spaces
- scientific article; zbMATH DE number 7652675 (Why is no real title available?)
- Modified Stochastic Extragradient Methods for Stochastic Variational Inequality
- Two steps at a time-taking GAN training in stride with Tseng's method
- Stochastic projective splitting
- Variable sample-size operator extrapolation algorithm for stochastic mixed variational inequalities
- A stochastic projection and contraction algorithm with inertial effects for stochastic variational inequalities
- A stochastic Bregman golden ratio algorithm for non-Lipschitz stochastic mixed variational inequalities with application to resource share problems
- Optimal analysis of method with batching for monotone stochastic finite-sum variational inequalities
This page was built for publication: Minibatch forward-backward-forward methods for solving stochastic variational inequalities
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5084485)
