Fast Distributed Gradient Methods

DOI10.1109/TAC.2014.2298712zbMath1360.90292arXiv1112.2972MaRDI QIDQ2983161

João Xavier, Dušan Jakovetić, José M. F. Moura

Publication date: 16 May 2017

Published in: IEEE Transactions on Automatic Control (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1112.2972

Mathematics Subject Classification ID

Deterministic network models in operations research (90B10) Methods of reduced gradient type (90C52) Distributed algorithms (68W15)

Related Items (68)

A distributed algorithm for efficiently solving linear equations and its applications (special issue JCW) ⋮ Optimal Algorithms for Non-Smooth Distributed Optimization in Networks ⋮ GADMM: Fast and Communication Efficient Framework for Distributed Machine Learning ⋮ Reprint of ``A distributed algorithm for efficiently solving linear equations and its applications (Special issue JCW) ⋮ Primal-dual algorithm for distributed constrained optimization ⋮ Decentralized gradient algorithm for solution of a linear equation ⋮ Asymptotic convergence of a distributed weighted least squares algorithm for networked systems with vector node variables ⋮ Distributed Variable Sample-Size Gradient-Response and Best-Response Schemes for Stochastic Nash Equilibrium Problems ⋮ Composite optimization for the resource allocation problem ⋮ A distributed conjugate gradient online learning method over networks ⋮ Continuous distributed algorithms for solving linear equations in finite time ⋮ Surrogate-based distributed optimisation for expensive black-box functions ⋮ Distributed constraint-coupled optimization via primal decomposition over random time-varying graphs ⋮ Differentially private distributed optimization for multi-agent systems via the augmented Lagrangian algorithm ⋮ Improving the convergence of distributed gradient descent via inexact average consensus ⋮ Exponential convergence of a distributed algorithm for solving linear algebraic equations ⋮ Convergence rate analysis of distributed optimization with projected subgradient algorithm ⋮ Regularized dual gradient distributed method for constrained convex optimization over unbalanced directed graphs ⋮ Tracking-ADMM for distributed constraint-coupled optimization ⋮ An accelerated exact distributed first-order algorithm for optimization over directed networks ⋮ A stochastic averaging gradient algorithm with multi‐step communication for distributed optimization ⋮ Primal-dual \(\varepsilon\)-subgradient method for distributed optimization ⋮ Model aggregation for doubly divided data with large size and large dimension ⋮ Multi-cluster distributed optimization via random sleep strategy ⋮ Linear convergence rate analysis of a class of exact first-order distributed methods for weight-balanced time-varying networks and uncoordinated step sizes ⋮ A decentralized smoothing quadratic regularization algorithm for composite consensus optimization with non-Lipschitz singularities ⋮ Distributed nonconvex constrained optimization over time-varying digraphs ⋮ Linear convergence of distributed estimation with constraints and communication delays ⋮ DIMIX: Diminishing Mixing for Sloppy Agents ⋮ EFIX: exact fixed point methods for distributed optimization ⋮ Achieving Geometric Convergence for Distributed Optimization Over Time-Varying Graphs ⋮ Golden ratio proximal gradient ADMM for distributed composite convex optimization ⋮ Distributed stochastic gradient tracking methods with momentum acceleration for non-convex optimization ⋮ Decentralized algorithms for distributed integer programming problems with a coupling cardinality constraint ⋮ Towards accelerated rates for distributed optimization over time-varying networks ⋮ Recent theoretical advances in decentralized distributed convex optimization ⋮ Distributed adaptive dynamic programming for data-driven optimal control ⋮ Stochastic sub-gradient algorithm for distributed optimization with random sleep scheme ⋮ Revisiting EXTRA for Smooth Distributed Optimization ⋮ An Arrow-Hurwicz-Uzawa type flow as least squares solver for network linear equations ⋮ Distributed consensus-based multi-agent convex optimization via gradient tracking technique ⋮ Convergence of distributed gradient-tracking-based optimization algorithms with random graphs ⋮ Decentralized Consensus Algorithm with Delayed and Stochastic Gradients ⋮ Distributed learning for random vector functional-link networks ⋮ Distributed stochastic gradient tracking methods ⋮ A distributed algorithm for solving mixed equilibrium problems ⋮ Distributed approximate Newton algorithms and weight design for constrained optimization ⋮ Exact spectral-like gradient method for distributed optimization ⋮ On the linear convergence of two decentralized algorithms ⋮ Augmented Lagrange algorithms for distributed optimization over multi-agent networks via edge-based method ⋮ Distributed and consensus optimization for non-smooth image reconstruction ⋮ Communication-efficient algorithms for decentralized and stochastic optimization ⋮ On the Convergence of Decentralized Gradient Descent ⋮ On Convergence Rate of Distributed Stochastic Gradient Algorithm for Convex Optimization with Inequality Constraints ⋮ Distributed Subgradient-Free Stochastic Optimization Algorithm for Nonsmooth Convex Functions over Time-Varying Networks ⋮ Distributed gradient tracking methods with finite data rates ⋮ A multi-scale method for distributed convex optimization with constraints ⋮ Asynchronous Algorithms for Computing Equilibrium Prices in a Capital Asset Pricing Model ⋮ Geometrical convergence rate for distributed optimization with time-varying directed graphs and uncoordinated step-sizes ⋮ Primal-dual stochastic distributed algorithm for constrained convex optimization ⋮ EXTRA: An Exact First-Order Algorithm for Decentralized Consensus Optimization ⋮ An accelerated distributed gradient method with local memory ⋮ Surplus-based accelerated algorithms for distributed optimization over directed networks ⋮ Unnamed Item ⋮ On the convergence of exact distributed generalisation and acceleration algorithm for convex optimisation ⋮ Distributed primal-dual optimisation method with uncoordinated time-varying step-sizes ⋮ Distributed optimization with inexact oracle ⋮ Newton-like Method with Diagonal Correction for Distributed Optimization

This page was built for publication: Fast Distributed Gradient Methods