Distributed asynchronous deterministic and stochastic gradient optimization algorithms
From MaRDI portal
Publication:3738944
DOI10.1109/TAC.1986.1104412zbMath0602.90120MaRDI QIDQ3738944
Michael Athans, Dimitri P. Bertsekas, John N. Tsitsiklis
Publication date: 1986
Published in: IEEE Transactions on Automatic Control (Search for Journal in Brave)
convergenceasynchronous distributed computationdeterministic and stochastic gradient-like algorithms
Analysis of algorithms and problem complexity (68Q25) Numerical mathematical programming methods (65K05) Nonlinear programming (90C30) Numerical methods based on nonlinear programming (49M37)
Related Items
Node and network resistance to bribery in multi-agent systems, Delay-dependent consensus criteria for fractional-order Takagi-Sugeno fuzzy multi-agent systems with time delay, Stopping rules for optimization algorithms based on stochastic approximation, Modal consensus, synchronization and formation control with distributed endogenous internal models, A stochastic successive minimization method for nonsmooth nonconvex optimization with applications to transceiver design in wireless communication networks, Agreeing in networks: unmatched disturbances, algebraic constraints and optimality, Adaptive backstepping for distributed optimization, Robust synchronization of coprime factor perturbed networks, A distributed simultaneous perturbation approach for large-scale dynamic optimization problems, Consensus-based modeling using distributed feature construction with ILP, Asynchronous algorithms in non-cooperative games, Relaxation techniques and asynchronous algorithms for on-line computation of non-cooperative equilibria, Asymptotic properties of dual averaging algorithm for constrained distributed stochastic optimization, Consensus based overlapping decentralized estimation with missing observations and communication faults, Leader-following consensus of multi-agent systems with jointly connected topology using distributed adaptive protocols, Optimal scaling of a gradient method for distributed resource allocation, Scaling the size of a formation using relative position feedback, A cooperative optimization algorithm inspired by chaos-order transition, Stochastic mirror descent method for distributed multi-agent optimization, A unitary distributed subgradient method for multi-agent optimization with different coupling sources, On robustness of the Robbins-Monro method for parallel processing, Stochastic consensus over noisy networks with Markovian and arbitrary switches, Spread of (mis)information in social networks, A new approach to average consensus problems with multiple time-delays and jointly-connected topologies, Regularized dual gradient distributed method for constrained convex optimization over unbalanced directed graphs, Dual decomposition for multi-agent distributed optimization with coupling constraints, Randomized optimal consensus of multi-agent systems, Nonlinear robustified stochastic consensus seeking, Distributed stochastic subgradient projection algorithms for convex optimization, On multi-agent self-tuning consensus, Consensus-based decentralized real-time identification of large-scale systems, On primitivity of sets of matrices, Convergence of max-min consensus algorithms, Network flows that solve least squares for linear equations, Asynchronous parallel algorithms for nonconvex optimization, Asynchronous level bundle methods, Adaptive cooperative tracking control of higher-order nonlinear systems with unknown dynamics, Distributed multi-agent optimization with state-dependent communication, Consensus of second-order discrete-time multi-agent systems with fixed topology, Continuous-time consensus with discrete-time communications, Consensus of a group of mobile agents in three dimensions, Local voting protocol for decentralized load balancing of network with switched topology and noise in measurements, Consensus for black-box nonlinear agents using optimistic optimization, Maximizing the coverage of roadmap graph for optimal motion planning, Consensus control for leader-following multi-agent systems with measurement noises, Distributed robust \(H_\infty \) consensus control in directed networks of agents with time-delay, Consensus of multi-agent systems via hybrid impulsive protocols with time-delay, Consensus rate regulation for general linear multi-agent systems under directed topology, Accelerating the distributed Kaczmarz algorithm by strong over-relaxation, Making noise: emergent stochasticity in collective motion, Stochastic consensus seeking with communication delays, Optimal distributed linear averaging, Dobrushin's ergodicity coefficient for Markov operators on cones, An Arrow-Hurwicz-Uzawa type flow as least squares solver for network linear equations, Distributed optimization over directed graphs with row stochasticity and constraint regularity, Distributed consensus-based multi-agent convex optimization via gradient tracking technique, Fully asynchronous stochastic coordinate descent: a tight lower bound on the parallelism achieving linear speedup, Problems and methods of network control, Analysis of distributed consensus protocols with multi-equilibria under time-delays, Tight estimates for convergence of some non-stationary consensus algorithms, The landscape of empirical risk for nonconvex losses, Consensus of fractional-order multi-agent systems with input time delay, Consensus of discrete-time multi-agent systems with transmission nonlinearity, Asynchronous iterative sub-structuring methods, A decentralized strategy for generalized Nash equilibrium with linear coupling constraints, Mean square average-consensus under measurement noises and fixed topologies: necessary and sufficient conditions, Four encounters with system identification, A control-theoretic approach to disseminating values and overcoming malicious links in wireless networks, On control of strong consensus for networked agents with noisy observations, Opinion dynamics and learning in social networks, Self-tuning average consensus in complex networks, Synchronization of multi-agent systems without connectivity assumptions, Gradient-free method for nonsmooth distributed optimization, Stochastic approximation on Riemannian manifolds, Distributed stochastic gradient tracking methods, Adaptive fast consensus algorithm for distributed sensor fusion, Asymptotic properties of consensus-type algorithms for networked systems with regime-switching topologies, Convergence rate for consensus with delays, Dynamics of opinions with social biases, Cyclic stochastic approximation with disturbance on input in the parameter tracking problem based on a multiagent algorithm, A study on distributed optimization over large-scale networked systems, On the mathematics of emergence, Distributed linear regression by averaging, Consensus in asynchronous multiagent systems. I: Asynchronous consensus models, Consensus protocols for discrete-time multi-agent systems with time-varying delays, Communication-efficient algorithms for decentralized and stochastic optimization, Reaching a consensus via Krause mean processes in multi-agent systems: quadratic stochastic operators, Stochastic approximation search algorithms with randomization at the input, Global target aggregation and state agreement of nonlinear multi-agent systems with switching topologies, Asynchronous networked aggregative games, Multi-agent control: a graph-theoretic perspective, A multi-scale method for distributed convex optimization with constraints, Distributed supply chain management using ant colony optimization, Surplus-based accelerated algorithms for distributed optimization over directed networks, Opinion dynamics in social networks with stubborn agents: equilibrium and convergence rate, Dynamic coupling design for nonlinear output agreement and time-varying flow control, Error bounds and convergence analysis of feasible descent methods: A general approach, Some aspects of parallel and distributed iterative algorithms - a survey, A resilient continuous-time consensus method using a switching topology, Distributed optimization for uncertain Euler-Lagrange systems with local and relative measurements, Some Limit Properties of Markov Chains Induced by Recursive Stochastic Algorithms, Diffusive Influence Systems, Graph-Dependent Implicit Regularisation for Distributed Stochastic Subgradient Descent, Robust Asynchronous Stochastic Gradient-Push: Asymptotically Optimal and Network-Independent Performance for Strongly Convex Functions, Data Collection in Population Protocols with Non-uniformly Random Scheduler, Stochastic Approximation Based Consensus Dynamics over Markovian Networks, On the Divergence of Decentralized Nonconvex Optimization, Distributed smooth optimisation with event-triggered proportional-integral algorithms, Network Synchronization with Convexity, Analysis and Design of Optimization Algorithms via Integral Quadratic Constraints, On backward product of stochastic matrices, Approximate consensus in the dynamic stochastic network with incomplete information and measurement delays, Distributed Stochastic Approximation with Local Projections, Deployment algorithms for a power-constrained mobile sensor network, Multi-vehicle coordination for double-integrator dynamics under fixed undirected/directed interaction in a sampled-data setting, Unnamed Item, Distributed optimization for a class of uncertain MIMO nonlinear multi-agent systems with arbitrary relative degree, Reach a nonlinear consensus for MAS via doubly stochastic quadratic operators, Leader-following multiple unmanned underwater vehicles consensus control under the fixed and switching topologies with unmeasurable disturbances, A new Zeno-free event-triggered scheme for robust distributed optimal coordination, Subgradient averaging for multi-agent optimisation with different constraint sets, Behaviors of networks with antagonistic interactions and switching topologies, Optimizing the convergence rate of the quantum consensus: a discrete-time model, Wolfowitz’s theorem and consensus algorithms in Hadamard spaces, Multiagent Systems with Compasses, Perturbed Iterate Analysis for Asynchronous Stochastic Optimization, Distributed semi-supervised support vector machines, \(H_{\infty}\) Type Control for Multi-Agent Systems Subject to Stochastic State Dependent Noise, A continuous-time neurodynamic approach and its discretization for distributed convex optimization over multi-agent systems, Krause mean processes generated by cubic stochastic diagonally primitive matrices, Quantized event-triggered communication based multi-agent system for distributed resource allocation optimization, Mean-Field Approximations for Stochastic Population Processes with Heterogeneous Interactions, Traversing the Schrödinger bridge strait: Robert Fortet's marvelous proof redux, Optimizing Opinions with Stubborn Agents, An asynchronous subgradient-proximal method for solving additive convex optimization problems, Scaling up stochastic gradient descent for non-convex optimisation, A distributed proximal gradient method with time-varying delays for solving additive convex optimizations, A Distributed Boyle--Dykstra--Han Scheme, Graph Topology Invariant Gradient and Sampling Complexity for Decentralized and Stochastic Optimization, A decentralized smoothing quadratic regularization algorithm for composite consensus optimization with non-Lipschitz singularities, Distributed Algorithms with Finite Data Rates that Solve Linear Equations, Krause mean processes generated by cubic stochastic matrices IV: off-diagonally uniformly positive nonautonomous cubic stochastic matrices, Applications of quadratic stochastic operators to nonlinear consensus problems, Linear Time Average Consensus and Distributed Optimization on Fixed Graphs, Distributed consensus-based multi-agent temporal-difference learning, A Unified Framework for Continuous-Time Unconstrained Distributed Optimization, On the stability of asynchronous iterative processes, Fixed‐time distributed optimization for multi‐agent systems with external disturbances over directed networks, Achieving Geometric Convergence for Distributed Optimization Over Time-Varying Graphs, Localization and approximations for distributed non-convex optimization, Convergence and stability analysis for iterative dynamics with application to compartmental networks: a trajectory distance based Lyapunov approach, Convergence of random sleep algorithms for optimal consensus, Consensus of high-order multi-agent systems with switching topologies, Notes on averaging over acyclic digraphs and discrete coverage control, Synchronizing linear systems via partial-state coupling, Recent advances in optimization and game theoretic control for networked systems, Generalised gossip-based subgradient method for distributed optimisation, A graph-theoretic approach on optimizing informed-node selection in multi-agent tracking control, Multi-agent flocking under topological interactions, Eigenvector Computation and Community Detection in Asynchronous Gossip Models, Revisiting EXTRA for Smooth Distributed Optimization, Convergence of a class of multi-agent systems in probabilistic framework, Asymptotic optimality for consensus-type stochastic approximation algorithms using iterate averaging, Global Convergence Rate of Proximal Incremental Aggregated Gradient Methods, Unnamed Item, Results in cooperative control and implicit consensus, Flocking in noisy environments, Sampled-data discrete-time coordination algorithms for double-integrator dynamics under dynamic directed interaction, Synchronization of Networked Lagrangian Systems, Output Synchronization of Nonlinear Systems with Relative Degree One, Stochastic approximation algorithms: overview and recent trends., Noise-to-State Exponentially Stable Distributed Convex Optimization on Weight-Balanced Digraphs, Parallel and bootstrapped stochastic approximation, Uniform Consensus among Self-driven Particles, Nonlinear Gossip, Network Consensus in the Wasserstein Metric Space of Probability Measures, A robust multi-batch L-BFGS method for machine learning, On the Convergence of Decentralized Gradient Descent, ON THE CRITICAL EXPONENT FOR FLOCKS UNDER HIERARCHICAL LEADERSHIP, Distributed optimisation of a logistic system and its suppliers using ant colonies, On Symmetric Continuum Opinion Dynamics, Stochastic Control Liaisons: Richard Sinkhorn Meets Gaspard Monge on a Schrödinger Bridge, An Uncertainty-Weighted Asynchronous ADMM Method for Parallel PDE Parameter Estimation, Asynchronous Algorithms for Computing Equilibrium Prices in a Capital Asset Pricing Model, Computing over Unreliable Communication Networks, On W.P.1 Convergence of A Parallel Stochastic Approximation Algorithm, Positive contraction mappings for classical and quantum Schrödinger systems, General resilient consensus algorithms, Adaptive online distributed optimization in dynamic environments, A Kaczmarz Algorithm for Solving Tree Based Distributed Systems of Equations, Distributed Stochastic Optimization with Large Delays, On the convergence of exact distributed generalisation and acceleration algorithm for convex optimisation, Detecting Bots and Assessing Their Impact in Social Networks
