ARock: An Algorithmic Framework for Asynchronous Parallel Coordinate Updates
From MaRDI portal
Publication:2821779
DOI10.1137/15M1024950zbMath1350.49041arXiv1506.02396MaRDI QIDQ2821779
Zhimin Peng, Ming Yan, Wotao Yin, Yang-yang Xu
Publication date: 23 September 2016
Published in: SIAM Journal on Scientific Computing (Search for Journal in Brave)
Full work available at URL: https://arxiv.org/abs/1506.02396
65K05: Numerical mathematical programming methods
90C25: Convex programming
90C26: Nonconvex programming, global optimization
90C30: Nonlinear programming
65K10: Numerical optimization and variational techniques
49M05: Numerical methods based on necessary conditions
47J25: Iterative procedures involving nonlinear operators
49M37: Numerical methods based on nonlinear programming
47H10: Fixed-point theorems
93A14: Decentralized systems
47H09: Contraction-type mappings, nonexpansive mappings, (A)-proper mappings, etc.
65B99: Acceleration of convergence in numerical analysis
Related Items
Perturbed Iterate Analysis for Asynchronous Stochastic Optimization, Hybrid Jacobian and Gauss--Seidel Proximal Block Coordinate Update Methods for Linearly Constrained Convex Programming, Distributed Deterministic Asynchronous Algorithms in Time-Varying Graphs Through Dykstra Splitting, Convergence Theorems and Convergence Rates for the General Inertial Krasnosel’skiǐ–Mann Algorithm, Distributed Learning with Sparse Communications by Identification, Asynchronous Optimization over Weakly Coupled Renewal Systems, Scalable Asynchronous Domain Decomposition Solvers, A Distributed Flexible Delay-Tolerant Proximal Gradient Algorithm, Parallelizable Algorithms for Optimization Problems with Orthogonality Constraints, Cyclic Coordinate-Update Algorithms for Fixed-Point Problems: Analysis and Applications, Redundancy Techniques for Straggler Mitigation in Distributed Optimization and Learning, ARock, Randomized progressive hedging methods for multi-stage stochastic programming, On unbounded delays in asynchronous parallel fixed-point algorithms, Asynchronous parallel primal-dual block coordinate update methods for affinely constrained convex programs, Global convergence of ADMM in nonconvex nonsmooth optimization, Accelerated primal-dual proximal block coordinate updating methods for constrained convex optimization, Proximal primal-dual best approximation algorithm with memory, An asynchronous distributed and scalable generalized Nash equilibrium seeking algorithm for strongly monotone games, A stochastic subspace approach to gradient-free optimization in high dimensions, Risk-averse stochastic programming and distributionally robust optimization via operator splitting, Asynchronous parallel algorithms for nonconvex optimization, Asynchronous level bundle methods, Asynchronous distributed voltage control in active distribution networks, Primal-dual block-proximal splitting for a class of non-convex problems, Partition-based multi-agent optimization in the presence of lossy and asynchronous communication, Markov chain block coordinate descent, An inertial parallel and asynchronous forward-backward iteration for distributed convex optimization, Block-proximal methods with spatially adapted acceleration, On the convergence of asynchronous parallel iteration with unbounded delays, Asynchronous sequential inertial iterations for common fixed points problems with an application to linear systems
Uses Software
Cites Work
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers
- Parallel coordinate descent methods for big data optimization
- A primal-dual splitting method for convex optimization involving Lipschitzian, proximable and linear composite terms
- Parallel asynchronous iterations for the solution of a 3D continuous flow electrophoresis problem
- Asynchronous finite-difference schemes for partial differential equations
- Some aspects of parallel and distributed iterative algorithms - a survey
- Ergodic convergence to a zero of the sum of monotone operators in Hilbert space
- Some convergence results for asynchronous algorithms
- Asynchronous weighted additive Schwarz methods
- Asynchronous multisplitting methods for nonlinear fixed point problems
- On asynchronous iterations
- Coordinate-friendly structures, algorithms and applications
- A splitting algorithm for dual monotone inclusions involving cocoercive operators
- Construction of fixed points of demicompact mappings in Hilbert space
- Chaotic relaxation
- On the Convergence of Decentralized Gradient Descent
- Efficiency of Coordinate Descent Methods on Huge-Scale Optimization Problems
- Asynchronous Stochastic Coordinate Descent: Parallelism and Convergence Properties
- Evolution equations for maximal monotone operators: asymptotic analysis in continuous and discrete time
- Revisiting Asynchronous Linear Solvers
- Distributed asynchronous computation of fixed points
- Splitting Algorithms for the Sum of Two Nonlinear Operators
- On the Rate of Convergence of a Partially Asynchronous Gradient Projection Algorithm
- Asynchronous Iterative Methods for Multiprocessors
- Implicit-Explicit Parallel Asynchronous Solver of Parabolic PDEs
- Convergence rate analysis of an asynchronous space decomposition method for convex Minimization
- Improved asynchronous parallel optimization analysis for stochastic incremental methods
- Distributed Subgradient Methods for Multi-Agent Optimization
- Partially Asynchronous, Parallel Algorithms for Network Flow and Other Problems
- Convergence Rate Analysis of Several Splitting Schemes
- Self Equivalence of the Alternating Direction Method of Multipliers
- Faster Convergence Rates of Relaxed Peaceman-Rachford and ADMM Under Regularity Assumptions
- Stochastic Quasi-Fejér Block-Coordinate Fixed Point Iterations with Random Sweeping
- An Asynchronous Parallel Stochastic Coordinate Descent Algorithm
- Weak convergence of the sequence of successive approximations for nonexpansive mappings
- A case study in programming for parallel-processors
- Convex analysis and monotone operator theory in Hilbert spaces
