Distributed asynchronous deterministic and stochastic gradient optimization algorithms

DOI10.1109/TAC.1986.1104412zbMath0602.90120MaRDI QIDQ3738944

Michael Athans, Dimitri P. Bertsekas, John N. Tsitsiklis

Publication date: 1986

Published in: IEEE Transactions on Automatic Control (Search for Journal in Brave)

zbMATH Keywords

convergenceasynchronous distributed computationdeterministic and stochastic gradient-like algorithms

Mathematics Subject Classification ID

Analysis of algorithms and problem complexity (68Q25) Numerical mathematical programming methods (65K05) Nonlinear programming (90C30) Numerical methods based on nonlinear programming (49M37)

Related Items (only showing first 100 items - show all)

Node and network resistance to bribery in multi-agent systems ⋮ Delay-dependent consensus criteria for fractional-order Takagi-Sugeno fuzzy multi-agent systems with time delay ⋮ Stopping rules for optimization algorithms based on stochastic approximation ⋮ Modal consensus, synchronization and formation control with distributed endogenous internal models ⋮ A stochastic successive minimization method for nonsmooth nonconvex optimization with applications to transceiver design in wireless communication networks ⋮ Agreeing in networks: unmatched disturbances, algebraic constraints and optimality ⋮ Adaptive backstepping for distributed optimization ⋮ Robust synchronization of coprime factor perturbed networks ⋮ A distributed simultaneous perturbation approach for large-scale dynamic optimization problems ⋮ Consensus-based modeling using distributed feature construction with ILP ⋮ Asynchronous algorithms in non-cooperative games ⋮ Relaxation techniques and asynchronous algorithms for on-line computation of non-cooperative equilibria ⋮ Asymptotic properties of dual averaging algorithm for constrained distributed stochastic optimization ⋮ Consensus based overlapping decentralized estimation with missing observations and communication faults ⋮ Leader-following consensus of multi-agent systems with jointly connected topology using distributed adaptive protocols ⋮ Optimal scaling of a gradient method for distributed resource allocation ⋮ Scaling the size of a formation using relative position feedback ⋮ A cooperative optimization algorithm inspired by chaos-order transition ⋮ Stochastic mirror descent method for distributed multi-agent optimization ⋮ A unitary distributed subgradient method for multi-agent optimization with different coupling sources ⋮ On robustness of the Robbins-Monro method for parallel processing ⋮ Stochastic consensus over noisy networks with Markovian and arbitrary switches ⋮ Spread of (mis)information in social networks ⋮ A new approach to average consensus problems with multiple time-delays and jointly-connected topologies ⋮ Regularized dual gradient distributed method for constrained convex optimization over unbalanced directed graphs ⋮ Dual decomposition for multi-agent distributed optimization with coupling constraints ⋮ Randomized optimal consensus of multi-agent systems ⋮ Nonlinear robustified stochastic consensus seeking ⋮ Distributed stochastic subgradient projection algorithms for convex optimization ⋮ On multi-agent self-tuning consensus ⋮ Consensus-based decentralized real-time identification of large-scale systems ⋮ On primitivity of sets of matrices ⋮ Convergence of max-min consensus algorithms ⋮ Network flows that solve least squares for linear equations ⋮ Asynchronous parallel algorithms for nonconvex optimization ⋮ Asynchronous level bundle methods ⋮ Adaptive cooperative tracking control of higher-order nonlinear systems with unknown dynamics ⋮ Distributed multi-agent optimization with state-dependent communication ⋮ Consensus of second-order discrete-time multi-agent systems with fixed topology ⋮ Continuous-time consensus with discrete-time communications ⋮ Consensus of a group of mobile agents in three dimensions ⋮ Local voting protocol for decentralized load balancing of network with switched topology and noise in measurements ⋮ Consensus for black-box nonlinear agents using optimistic optimization ⋮ Maximizing the coverage of roadmap graph for optimal motion planning ⋮ Consensus control for leader-following multi-agent systems with measurement noises ⋮ Distributed robust \(H_\infty \) consensus control in directed networks of agents with time-delay ⋮ Consensus of multi-agent systems via hybrid impulsive protocols with time-delay ⋮ Consensus rate regulation for general linear multi-agent systems under directed topology ⋮ Accelerating the distributed Kaczmarz algorithm by strong over-relaxation ⋮ Making noise: emergent stochasticity in collective motion ⋮ Stochastic consensus seeking with communication delays ⋮ Optimal distributed linear averaging ⋮ Dobrushin's ergodicity coefficient for Markov operators on cones ⋮ An Arrow-Hurwicz-Uzawa type flow as least squares solver for network linear equations ⋮ Distributed optimization over directed graphs with row stochasticity and constraint regularity ⋮ Distributed consensus-based multi-agent convex optimization via gradient tracking technique ⋮ Fully asynchronous stochastic coordinate descent: a tight lower bound on the parallelism achieving linear speedup ⋮ Problems and methods of network control ⋮ Analysis of distributed consensus protocols with multi-equilibria under time-delays ⋮ Tight estimates for convergence of some non-stationary consensus algorithms ⋮ The landscape of empirical risk for nonconvex losses ⋮ Consensus of fractional-order multi-agent systems with input time delay ⋮ Consensus of discrete-time multi-agent systems with transmission nonlinearity ⋮ Asynchronous iterative sub-structuring methods ⋮ A decentralized strategy for generalized Nash equilibrium with linear coupling constraints ⋮ Mean square average-consensus under measurement noises and fixed topologies: necessary and sufficient conditions ⋮ Four encounters with system identification ⋮ A control-theoretic approach to disseminating values and overcoming malicious links in wireless networks ⋮ On control of strong consensus for networked agents with noisy observations ⋮ Opinion dynamics and learning in social networks ⋮ Self-tuning average consensus in complex networks ⋮ Synchronization of multi-agent systems without connectivity assumptions ⋮ Gradient-free method for nonsmooth distributed optimization ⋮ Stochastic approximation on Riemannian manifolds ⋮ Distributed stochastic gradient tracking methods ⋮ Adaptive fast consensus algorithm for distributed sensor fusion ⋮ Asymptotic properties of consensus-type algorithms for networked systems with regime-switching topologies ⋮ Convergence rate for consensus with delays ⋮ Dynamics of opinions with social biases ⋮ Cyclic stochastic approximation with disturbance on input in the parameter tracking problem based on a multiagent algorithm ⋮ A study on distributed optimization over large-scale networked systems ⋮ On the mathematics of emergence ⋮ Distributed linear regression by averaging ⋮ Consensus in asynchronous multiagent systems. I: Asynchronous consensus models ⋮ Consensus protocols for discrete-time multi-agent systems with time-varying delays ⋮ Communication-efficient algorithms for decentralized and stochastic optimization ⋮ Reaching a consensus via Krause mean processes in multi-agent systems: quadratic stochastic operators ⋮ Stochastic approximation search algorithms with randomization at the input ⋮ Global target aggregation and state agreement of nonlinear multi-agent systems with switching topologies ⋮ Asynchronous networked aggregative games ⋮ Multi-agent control: a graph-theoretic perspective ⋮ A multi-scale method for distributed convex optimization with constraints ⋮ Distributed supply chain management using ant colony optimization ⋮ Surplus-based accelerated algorithms for distributed optimization over directed networks ⋮ Opinion dynamics in social networks with stubborn agents: equilibrium and convergence rate ⋮ Dynamic coupling design for nonlinear output agreement and time-varying flow control ⋮ Error bounds and convergence analysis of feasible descent methods: A general approach ⋮ Some aspects of parallel and distributed iterative algorithms - a survey ⋮ A resilient continuous-time consensus method using a switching topology ⋮ Distributed optimization for uncertain Euler-Lagrange systems with local and relative measurements

This page was built for publication: Distributed asynchronous deterministic and stochastic gradient optimization algorithms