Some methods of speeding up the convergence of iteration methods

DOI10.1016/0041-5553(64)90137-5zbMath0147.35301OpenAlexW1988720110MaRDI QIDQ5525645

Boris T. Polyak

Publication date: 1967

Published in: USSR Computational Mathematics and Mathematical Physics (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1016/0041-5553(64)90137-5

zbMATH Keywords

numerical analysis

Related Items

Accelerated Gradient Descent Methods for the Uniaxially Constrained Landau-de Gennes Model, Convex-Concave Backtracking for Inertial Bregman Proximal Gradient Algorithms in Nonconvex Optimization, Asymptotic behaviour of a dynamical system governed by non-monotone potential and non-potential operators, Inertial algorithm with self-adaptive step size for split common null point and common fixed point problems for multivalued mappings in Banach spaces, An inertial projection and contraction method with a line search technique for variational inequality and fixed point problems, Strong convergence theorems for solving pseudo-monotone variational inequality problems and applications, A new self-adaptive algorithm for solving pseudomonotone variational inequality problems in Hilbert spaces, New First-Order Algorithms for Stochastic Variational Inequalities, A relaxed CQ algorithm involving the alternated inertial technique for the multiple-sets split feasibility problem, Approximation of solutions of the split minimization problem with multiple output sets and common fixed point problems in real Banach spaces, Viscosity and inertial algorithms for the split common fixed point problem with applications to compressed sensing, Convergence analysis of new inertial method for the split common null point problem, The rate of convergence of optimization algorithms obtained via discretizations of heavy ball dynamical systems for convex optimization problems, Adaptive and Implicit Regularization for Matrix Completion, A double projection algorithm with inertial effects for solving split feasibility problems and applications to image restoration, Convex minimization problems based on an accelerated fixed point algorithm with applications to image restoration problems, Strong convergent inertial Tseng’s extragradient method for solving non-Lipschitz quasimonotone variational inequalities in Banach spaces, Reflected three-operator splitting method for monotone inclusion problem, Linear Convergence for Quasi-Variational Inequalities with Inertial Projection-Type Method, Two New Inertial Algorithms for Solving Variational Inequalities in Reflexive Banach Spaces, Improved inertial extragradient methods for solving pseudo-monotone variational inequalities, Improving “Fast Iterative Shrinkage-Thresholding Algorithm”: Faster, Smarter, and Greedier, Adaptivity of Stochastic Gradient Methods for Nonconvex Optimization, An inertial extragradient method for iteratively solving equilibrium problems in real Hilbert spaces, Differentially Private Accelerated Optimization Algorithms, Generalized relaxed inertial method with regularization for solving split feasibility problems in real Hilbert spaces, An iterative algorithm with inertial technique for solving the split common null point problem in Banach spaces, A Diffusion Approximation Theory of Momentum Stochastic Gradient Descent in Nonconvex Optimization, An inertial non-monotonic self-adaptive iterative algorithm for solving equilibrium problems, Accelerated inertial subgradient extragradient algorithms with non-monotonic step sizes for equilibrium problems and fixed point problems, Inertial Extragradient Method for Solving Variational Inequality and Fixed Point Problems of a Bregman Demigeneralized Mapping in a Reflexive Banach Spaces, New Self-Adaptive Algorithms and Inertial Self-Adaptive Algorithms for the Split Variational Inclusion Problems in Hilbert Space, A new iterative method with alternated inertia for the split feasibility problem, A hierarchical variational inequality problem for generalized demimetric mappings with applications, Scheduled Restart Momentum for Accelerated Stochastic Gradient Descent, Convergence Rates of the Heavy Ball Method for Quasi-strongly Convex Optimization, From the Ravine Method to the Nesterov Method and Vice Versa: A Dynamical System Perspective, Unnamed Item, RidgeSketch: A Fast Sketching Based Solver for Large Scale Ridge Regression, Unnamed Item, Efficient and Reliable Overlay Networks for Decentralized Federated Learning, Unnamed Item, Unnamed Item, Unnamed Item, Unnamed Item, Convergence rate of a relaxed inertial proximal algorithm for convex minimization, Finite Convergence of Proximal-Gradient Inertial Algorithms Combining Dry Friction with Hessian-Driven Damping, A subgradient extragradient algorithm with inertial effects for solving strongly pseudomonotone variational inequalities, Multiscale Analysis of Accelerated Gradient Methods, Unnamed Item, Unnamed Item, Inertial approximation method for split variational inclusion problem in Banach spaces, Unnamed Item, Unnamed Item, Unnamed Item, A primal-dual optimization strategy for elliptic partial differential equations, Unnamed Item, Unnamed Item, Proximal extrapolated gradient methods for variational inequalities, Unnamed Item, Mann-type algorithms for variational inequality problems and fixed point problems, Strong convergence of inertial Mann algorithms for solving hierarchical fixed point problems, Optimization Methods for Large-Scale Machine Learning, Unnamed Item, Distributed Newton Methods for Deep Neural Networks, Unnamed Item, On inertial proximal algorithm for split variational inclusion problems, Modified extragradient algorithms for solving equilibrium problems, Second-Order Dynamics with Hessian-Driven Damping for Linearly Constrained Convex Minimization, Unnamed Item, Decay estimate for the solution of the evolutionary damped $p$-Laplace equation, Modified Inertial Algorithms for a Class of Split Feasibility Problems and Fixed Point Problems in Hilbert Spaces, Inertial Variable Metric Techniques for the Inexact Forward--Backward Algorithm, Convergence Rate Analysis of Inertial Krasnoselskii–Mann Type Iteration with Applications, Wasserstein Dictionary Learning: Optimal Transport-Based Unsupervised Nonlinear Dictionary Learning, Analysis of Optimization Algorithms via Integral Quadratic Constraints: Nonstrongly Convex Problems, Peak effects in stable linear difference equations, Convergence Theorems and Convergence Rates for the General Inertial Krasnosel’skiǐ–Mann Algorithm, A viscosity-proximal gradient method with inertial extrapolation for solving certain minimization problems in Hilbert space, Gradient Descent Finds the Cubic-Regularized Nonconvex Newton Step, Fast Proximal Methods via Time Scaling of Damped Inertial Dynamics, An Inertial Newton Algorithm for Deep Learning, Modified inertial subgradient extragradient method with self adaptive stepsize for solving monotone variational inequality and fixed point problems, Adaptive FISTA for Nonconvex Optimization, Variational Image Regularization with Euler's Elastica Using a Discrete Gradient Scheme, New algorithms for the split variational inclusion problems and application to split feasibility problems, The Connections Between Lyapunov Functions for Some Optimization Algorithms and Differential Equations, Unnamed Item, Weak and strong convergence of inertial Tseng's extragradient algorithms for solving variational inequality problems, Inertial accelerated algorithms for the split common fixed-point problem of directed operators, Unnamed Item, Unnamed Item, Unnamed Item, Implicit Regularization and Momentum Algorithms in Nonlinearly Parameterized Adaptive Control and Prediction, Dual Variable Inertial Accelerated Algorithm for Split System of Null Point Equality Problems, Learning over No-Preferred and Preferred Sequence of Items for Robust Recommendation, A Second Order Dynamical System and Its Discretization for Strongly Pseudo-monotone Variational Inequalities, Unnamed Item, Hausdorff dimension, heavy tails, and generalization in neural networks*, Inertial viscosity forward–backward splitting algorithm for monotone inclusions and its application to image restoration problems, Research on three-step accelerated gradient algorithm in deep learning, Relaxed inertial methods for solving the split monotone variational inclusion problem beyond co-coerciveness, Inertial splitting algorithms for nonlinear operators of pseudocontractive and accretive types, Iterative algorithm with self-adaptive step size for approximating the common solution of variational inequality and fixed point problems, An inertial extragradient algorithm for split problems in Hilbert spaces, An inertial method for split equality common \(f, g\)-fixed point problems of \(f, g\)-pseudocontractive mappings in reflexive real Banach spaces, Accelerated differential inclusion for convex optimization, Inertial relaxed CQ algorithm for split feasibility problems with non-Lipschitz gradient operators, An inertial viscosity algorithm for solving monotone variational inclusion and common fixed point problems of strict pseudocontractions, A numerical damped oscillator approach to constrained Schrödinger equations, Unnamed Item, An alternated inertial general splitting method with linearization for the split feasibility problem, Two inertial-type algorithms for solving the split feasibility problem, Unnamed Item, Unnamed Item, Multi-step inertial strictly contractive PRSM algorithms for convex programming problems with applications, Likelihood landscape and maximum likelihood estimation for the discrete orbit recovery model, An inertial spectral CG projection method based on the memoryless BFGS update, Accelerated dynamics with dry friction via time scaling and averaging of doubly nonlinear evolution equations, An accelerated exact distributed first-order algorithm for optimization over directed networks, An inertial method for solutions of split equality inclusion problems, Inertial primal-dual dynamics with damping and scaling for linearly constrained convex optimization problems, Relaxed inertial Tseng extragradient method for variational inequality and fixed point problems, New inertial modification of regularized algorithms for solving split variational inclusion problem, Stochastic momentum methods for non-convex learning without bounded assumptions, Dynamical inertial extragradient techniques for solving equilibrium and fixed-point problems in real Hilbert spaces, Inertial-based extragradient algorithm for approximating a common solution of split-equilibrium problems and fixed-point problems of nonexpansive semigroups, A relaxed inertial and viscosity method for split feasibility problem and applications to image recovery, A mini-batch stochastic conjugate gradient algorithm with variance reduction, An improved inertial projection method for solving convex constrained monotone nonlinear equations with applications, Fast continuous dynamics inside the graph of subdifferentials of nonsmooth convex functions, An ordinary differential equation for modeling Halpern fixed-point Algorithm, A modified subgradient extragradient algorithm-type for solving quasimonotone variational inequality problems with applications, A novel network architecture combining central-peripheral deviation with image-based convolutional neural networks for diffusion tensor imaging studies, Convergence of the Momentum Method for Semialgebraic Functions with Locally Lipschitz Gradients, On optimization of coherent and incoherent controls for two-level quantum systems, Novel projection neurodynamic approaches for constrained convex optimization, A family of three-term conjugate gradient projection methods with a restart procedure and their relaxed-inertial extensions for the constrained nonlinear pseudo-monotone equations with applications, A distributed accelerated optimization algorithm over time‐varying directed graphs with uncoordinated step‐sizes, Inertial extrapolation method with regularization for solving a new class of bilevel problem in real Hilbert spaces, M-IHS: an accelerated randomized preconditioning method avoiding costly matrix decompositions, Perturbation Resilience of Self-Adaptive Step-Size Algorithms for Solving Split Variational Inclusion Problems and their Applications, Nonlinear forward-backward splitting with momentum correction, On some novel methods for solving the generalized Fermat-Torricelli problem in Hilbert spaces, Strong Convergence of Trajectories via Inertial Dynamics Combining Hessian-Driven Damping and Tikhonov Regularization for General Convex Minimizations, Double inertial parameters forward-backward splitting method: Applications to compressed sensing, image processing, and SCAD penalty problems, A speed restart scheme for a dynamics with Hessian-driven damping, Friction-adaptive descent: a family of dynamics-based optimization methods, Iterative methods for solving variational inequality problems with a double-hierarchical structure in Hilbert spaces, Two-step inertial forward-reflected-backward splitting based algorithm for nonconvex mixed variational inequalities, Inertial accelerated steepest descent algorithm for generalized split common fixed point problems, Accelerated sparse recovery via gradient descent with nonlinear conjugate gradient momentum, Learning proper orthogonal decomposition of complex dynamics using heavy-ball neural ODEs, Double inertial proximal gradient algorithms for convex optimization problems and applications, A Tseng-type algorithm for approximating zeros of monotone inclusion and \(J\)-fixed-point problems with applications, Equilibrium seeking and optimal selection algorithms in peer-to-peer energy markets, Optimal state manipulation for a two-qubit system driven by coherent and incoherent controls, Unnamed Item, A robust control approach to asymptotic optimality of the heavy ball method for optimization of quadratic functions, Deterministic neural networks optimization from a continuous and energy point of view, Fast gradient method for low-rank matrix estimation, The Benders by batch algorithm: design and stabilization of an enhanced algorithm to solve multicut Benders reformulation of two-stage stochastic programs, Direct nonlinear acceleration, A Systematic Approach to Lyapunov Analyses of Continuous-Time Models in Convex Optimization, Relaxed viscosity-type iterative methods with application to compressed sensing, An inertial projection and contraction method for solving bilevel quasimonotone variational inequality problems, Novel inertial methods for fixed point problems in reflexive Banach spaces with applications, Finding a common solution of variational inequality and fixed point problems using subgradient extragradient techniques, No-regret dynamics in the Fenchel game: a unified framework for algorithmic convex optimization, Uniform-in-time propagation of chaos for kinetic mean field Langevin dynamics, Unnamed Item, Unnamed Item, Unnamed Item, Unnamed Item, Unnamed Item, Unnamed Item, Unnamed Item, Subsampled Hessian Newton Methods for Supervised Learning, Accelerated hybrid and shrinking projection methods for variational inequality problems, Inertial methods for fixed point problems and zero point problems of the sum of two monotone mappings, Unnamed Item, Proximal type algorithms involving linesearch and inertial technique for split variational inclusion problem in hilbert spaces with applications, Quantum entropic regularization of matrix-valued optimal transport, Generalized Momentum-Based Methods: A Hamiltonian Perspective, Conformal symplectic and relativistic optimization, ON THE STRONG CONVERGENCE OF A PROJECTION-BASED ALGORITHM IN HILBERT SPACES, ACCELERATED PROJECTION-BASED FORWARD-BACKWARD SPLITTING ALGORITHMS FOR MONOTONE INCLUSION PROBLEMS, Modified Popov's explicit iterative algorithms for solving pseudomonotone equilibrium problems, Inexact SARAH algorithm for stochastic optimization, Weak convergence for variational inequalities with inertial-type method, Multiply Accelerated Value Iteration for NonSymmetric Affine Fixed Point Problems and Application to Markov Decision Processes, Distributed Stochastic Inertial-Accelerated Methods with Delayed Derivatives for Nonconvex Problems, Fast convex optimization via a third-order in time evolution equation, An Adaptive Gradient Method with Energy and Momentum, Self-Adaptive Inertial Projection and Contraction Algorithm for Monotone Variational Inequality, Weak and strong convergence results for the modified Noor iteration of three quasi-nonexpansive multivalued mappings in Hilbert spaces, Scaled, Inexact, and Adaptive Generalized FISTA for Strongly Convex Optimization, Three novel inertial explicit Tseng's extragradient methods for solving pseudomonotone variational inequalities, Viscosity approximation method for solving variational inequality problem in real Banach spaces, Modified Tseng's extragradient algorithms for variational inequality problems, An inertial Popov's method for solving pseudomonotone variational inequalities, Some developments in general variational inequalities, Solving a split feasibility problem by the strong convergence of two projection algorithms in Hilbert spaces, Steepest descent with momentum for quadratic functions is a version of the conjugate gradient method, An inertial-like proximal algorithm for equilibrium problems, Local convergence of the heavy-ball method and iPiano for non-convex optimization, Optimized first-order methods for smooth convex minimization, Algorithms of inertial mirror descent in convex problems of stochastic optimization, Speeding up the convergence of the Polyak's heavy ball algorithm, Inertial algorithm for approximating a common fixed point for a countable family of relatively nonexpansive maps, An adaptive three-term conjugate gradient method based on self-scaling memoryless BFGS matrix, Bounded perturbation resilience of extragradient-type methods and their applications, Convergence analysis for the proximal split feasibility problem using an inertial extrapolation term method, An inertial method for solving split common fixed point problems, A strong convergence result involving an inertial forward-backward algorithm for monotone inclusions, iPiasco: inertial proximal algorithm for strongly convex optimization, An efficient primal-dual method for the obstacle problem, Simultaneous and semi-alternating projection algorithms for solving split equality problems, Stochastic heavy ball, An inertial type iterative method with Armijo linesearch for nonmonotone equilibrium problems, A modified inertial shrinking projection method for solving inclusion problems and quasi-nonexpansive multivalued mappings, An inertial forward-backward splitting method for solving combination of equilibrium problems and inclusion problems, Regularized and inertial algorithms for common fixed points of nonlinear operators, Inertial subgradient extragradient algorithms with line-search process for solving variational inequality problems and fixed point problems, Iterative method with inertial for variational inequalities in Hilbert spaces, Stochastic gradient descent with Polyak's learning rate, Preconditioned accelerated gradient descent methods for locally Lipschitz smooth objectives with applications to the solution of nonlinear PDEs, An inertial forward-backward splitting method for solving inclusion problems in Hilbert spaces, Modified proximal-like extragradient methods for two classes of equilibrium problems in Hilbert spaces with applications, A proximal difference-of-convex algorithm with extrapolation, On the convergence analysis of the optimized gradient method, Inertial alternating generalized forward-backward splitting for image colorization, A finite element/operator-splitting method for the numerical solution of the two dimensional elliptic Monge-Ampère equation, A self-adaptive projection method with an inertial technique for split feasibility problems in Banach spaces with applications to image restoration problems, A self adaptive inertial subgradient extragradient algorithm for variational inequality and common fixed point of multivalued mappings in Hilbert spaces, Selection dynamics for deep neural networks, Convergence analysis of an inertial accelerated iterative algorithm for solving split variational inequality problem, Local and global convergence of a general inertial proximal splitting scheme for minimizing composite functions, Accelerating two projection methods via perturbations with application to intensity-modulated radiation therapy, Convergence rates of an inertial gradient descent algorithm under growth and flatness conditions, Inertial proximal gradient methods with Bregman regularization for a class of nonconvex optimization problems, A novel inertial projection and contraction method for solving pseudomonotone variational inequality problems, On the interplay between acceleration and identification for the proximal gradient algorithm, Momentum and stochastic momentum for stochastic gradient, Newton, proximal point and subspace descent methods, Modified inertial subgradient extragradient method in reflexive Banach spaces, Convergence of stochastic gradient descent in deep neural network, Modified subgradient extragradient method for variational inequality problems, Inertial shrinking projection algorithm with self-adaptive step size for split generalized equilibrium and fixed point problems for a countable family of nonexpansive multivalued mappings, Asymptotic stabilization of inertial gradient dynamics with time-dependent viscosity, Planning capacity and safety stocks in a serial production-distribution system with multiple products, Asymptotic analysis of a structure-preserving integrator for damped Hamiltonian systems, Bounds for the tracking error of first-order online optimization methods, Inertial iterative schemes for d-accretive mappings in Banach spaces and curvature systems, Asymptotic behavior of gradient-like dynamical systems involving inertia and multiscale aspects, Inertial relaxed \textit{CQ} algorithms for solving a split feasibility problem in Hilbert spaces, An inertial iterative algorithm with strong convergence for solving modified split feasibility problem in Banach spaces, A unified algorithm for solving split generalized mixed equilibrium problem, and for finding fixed point of nonspreading mapping in Hilbert spaces, A selective overview of deep learning, New convergence results for inertial Krasnoselskii-Mann iterations in Hilbert spaces with applications, Strong convergence inertial projection algorithm with self-adaptive step size rule for pseudomonotone variational inequalities in Hilbert spaces, Strong convergence of an inertial algorithm for maximal monotone inclusions with applications, An inertial extrapolation method for solving generalized split feasibility problems in real Hilbert spaces, An iterative algorithm for solving variational inequality, generalized mixed equilibrium, convex minimization and zeros problems for a class of nonexpansive-type mappings, Self adaptive inertial extragradient algorithms for solving bilevel pseudomonotone variational inequality problems, New inertial relaxed method for solving split feasibilities, Continuous Newton-like inertial dynamics for monotone inclusions, Relaxed forward-backward splitting methods for solving variational inclusions and applications, Inertial iterative algorithms for common solution of variational inequality and system of variational inequalities problems, Convergence of relaxed inertial subgradient extragradient methods for quasimonotone variational inequality problems, Convergence of a splitting inertial proximal method for monotone operators, Inertial-viscosity-type algorithms for solving generalized equilibrium and fixed point problems in Hilbert spaces, Variational inequality over the set of common solutions of a system of bilevel variational inequality problem with applications, Variation diminishing linear time-invariant systems, An inertial iterative method for split generalized vector mixed equilibrium and fixed point problems., Strong convergence of alternated inertial \(CQ\) relaxed method with application in signal recovery, A simple extrapolation method for clustered eigenvalues, Weak convergence of explicit extragradient algorithms for solving equilibrium problems, Damped inertial dynamics with vanishing Tikhonov regularization: strong asymptotic convergence towards the minimum norm solution, New inertial proximal gradient methods for unconstrained convex optimization problems, Strong convergence of an inertial projection and contraction method with self adaptive stepsize for pseudomonotone variational inequalities and fixed point problems, A piecewise conservative method for unconstrained convex optimization, Two projection-based methods for bilevel pseudomonotone variational inequalities involving non-Lipschitz operators, Iterative pre-conditioning for expediting the distributed gradient-descent method: the case of linear least-squares problem, Reinforcement learning and stochastic optimisation, Weak and strong convergence of inertial algorithms for solving split common fixed point problems, An accelerated viscosity forward-backward splitting algorithm with the linesearch process for convex minimization problems, Convergence analysis of a general inertial projection-type method for solving pseudomonotone equilibrium problems with applications, On convergence and complexity analysis of an accelerated forward-backward algorithm with linesearch technique for convex minimization problems and applications to data prediction and classification, A method with inertial extrapolation step for convex constrained monotone equations, A strongly convergent algorithm for solving common variational inclusion with application to image recovery problems, Two adaptive modified subgradient extragradient methods for bilevel pseudomonotone variational inequalities with applications, A self adaptive inertial algorithm for solving split variational inclusion and fixed point problems with applications, Inertial viscosity-type iterative method for solving inclusion problems with applications, Learning-based adaptive control with an accelerated iterative adaptive law, Stochastic heavy-ball method for constrained stochastic optimization problems, How does momentum benefit deep neural networks architecture design? A few case studies, Application of a new accelerated algorithm to regression problems, Stochastic relaxed inertial forward-backward-forward splitting for monotone inclusions in Hilbert spaces, A dynamical view of nonlinear conjugate gradient methods with applications to FFT-based computational micromechanics, Randomized Douglas–Rachford Methods for Linear Systems: Improved Accuracy and Efficiency, Convergence analysis for solving equilibrium problems and split feasibility problems in Hilbert spaces, Byzantine-robust loopless stochastic variance-reduced gradient, Heavy-ball-based optimal thresholding algorithms for sparse linear inverse problems, A self adaptive method for solving a class of bilevel variational inequalities with split variational inequality and composed fixed point problem constraints in Hilbert spaces, Heavy-ball-based hard thresholding algorithms for sparse signal recovery, An inertial alternating minimization with Bregman distance for a class of nonconvex and nonsmooth problems, An improved relaxed inertial projection algorithm for solving the minimum-norm solution of variational inequality and fixed point problems, Faster Deterministic Pseudoinverse-Free Block Extension of Motzkin Method for Large Consistent Linear Systems, Fast hybrid iterative schemes for solving variational inclusion problems, Convergence analysis of modified inertial forward–backward splitting scheme with applications, Alternated inertial algorithms for split feasibility problems, A proximal subgradient algorithm with extrapolation for structured nonconvex nonsmooth problems, A modified forward‐backward splitting methods for the sum of two monotone operators with applications to breast cancer prediction, Weak and strong convergence of a modified double inertial projection algorithm for solving variational inequality problems, Inertial Newton algorithms avoiding strict saddle points, Nested alternating minimization with FISTA for non-convex and non-smooth optimization problems, Theoretical analysis of Adam using hyperparameters close to one without Lipschitz smoothness, Modified inertial projection method for solving pseudomonotone variational inequalities with non-Lipschitz in Hilbert spaces, First order inertial optimization algorithms with threshold effects associated with dry friction, A strongly convergent viscosity-type inertial algorithm with self adaptive stepsize for solving split variational inclusion problems in Hilbert spaces, On Proximal Algorithms with Inertial Effects Beyond Monotonicity, An Inertial-Like Algorithm for Solving Common Fixed Point Problems of a Family of Continuous Pseudocontractive Mappings, A new projection-type method with nondecreasing adaptive step-sizes for pseudo-monotone variational inequalities, A Convergence Study of SGD-Type Methods for Stochastic Optimization, Uniting Nesterov and heavy ball methods for uniform global asymptotic stability of the set of minimizers, Viscosity Iterative Algorithm {Accelerated extragradient algorithm for equilibrium and fixed point problems for countable family of certain multi-valued mappings], Connections between numerical algorithms for PDEs and neural networks, Inertial self-adaptive parallel extragradient-type method for common solution of variational inequality problems, New hybrid inertial CQ projection algorithms with line-search process for the split feasibility problem, An inertial-viscosity algorithm for solving split generalized equilibrium problem and a system of demimetric mappings in Hilbert spaces, A modified inertial Halpern method for solving split monotone variational inclusion problems in Banach spaces, Multi-step inertial forward-backward-half forward algorithm for solving monotone inclusion, Second order self-adaptive dynamical system for sparse signal reconstruction and applications to image recovery, Accelerated doubly stochastic gradient descent for tensor CP decomposition, The heavy ball method regularized by Tikhonov term. Simultaneous convergence of values and trajectories, Convergence of inertial dynamics driven by sums of potential and nonpotential operators with implicit Newton-like damping, A forward-backward algorithm with different inertial terms for structured non-convex minimization problems, An extrapolated proximal iteratively reweighted method for nonconvex composite optimization problems, Principled analyses and design of first-order methods with inexact proximal operators, An alternating structure-adapted Bregman proximal gradient descent algorithm for constrained nonconvex nonsmooth optimization problems and its inertial variant, Time rescaling of a primal-dual dynamical system with asymptotically vanishing damping, Accelerated gradient methods combining Tikhonov regularization with geometric damping driven by the Hessian, Categorical foundations of gradient-based learning, Convergence of gradient algorithms for nonconvex \(C^{1+ \alpha}\) cost functions, On split monotone variational inclusion problem with multiple output sets with fixed point constraints, An inertial Popov extragradient projection algorithm for solving multi-valued variational inequality problems, Smoothing fast proximal gradient algorithm for the relaxation of matrix rank regularization problem, First-order methods for convex optimization, Adaptive extragradient methods for solving variational inequalities in real Hilbert spaces, Inertial hybrid gradient method with adaptive step size for variational inequality and fixed point problems of multivalued mappings in Banach spaces, A locally optimal preconditioned Newton-Schur method for symmetric elliptic eigenvalue problems, Inertial algorithm for solving split inclusion problem in Banach spaces, From Halpern's fixed-point iterations to Nesterov's accelerated interpretations for root-finding problems, Strong convergence of inertial extragradient algorithms for solving variational inequalities and fixed point problems, An inertial subgradient-extragradient algorithm for solving pseudomonotone variational inequalities, An Asymptotic Analysis of Random Partition Based Minibatch Momentum Methods for Linear Regression Models, Image restorations using a modified relaxed inertial technique for generalized split feasibility problems, Optimal friction matrix for underdamped Langevin sampling, An inertial method for a solution of split equality of monotone inclusion and the f$$ f $$‐fixed point problems in Banach spaces, A new class of inertial algorithms with monotonic step sizes for solving fixed point and variational inequalities, Solving quasimonotone and non-monotone variational inequalities, A partially inertial customized Douglas-Rachford splitting method for a class of structured optimization problems, Two-step inertial forward-reflected-anchored-backward splitting algorithm for solving monotone inclusion problems, An inertial iterative algorithm for approximating common solutions to split equalities of some nonlinear optimization problems, A stochastic projection and contraction algorithm with inertial effects for stochastic variational inequalities, Continuous Newton-like Methods Featuring Inertia and Variable Mass, A second order primal-dual dynamical system for a convex-concave bilinear saddle point problem, Relaxed double inertial Tseng's extragradient method for solving non-Lipschitz split monotone variational inclusion problems with fixed point constraints, Stochastic variational inference for GARCH models, An inertial accelerated outer quadratic approximation method for split feasibility problem with application to elastic net, Strong convergent algorithm for finding minimum-norm solutions of quasimonotone variational inequalities with fixed point constraint and application, Estimation and inference by stochastic optimization, Weak convergence of inertial proximal algorithms with self adaptive stepsize for solving multivalued variational inequalities, An inertial subgradient extragradient algorithm for modified variational inclusion problem and mixed equilibrium problem in real Hilbert space, Relaxed single projection methods for solving bilevel variational inequality problems in Hilbert spaces, A multi step inertial algorithm for approximating a common solution of split generalized mixed equilibrium and minimization problems, An accelerated forward-backward-half forward splitting algorithm for monotone inclusion with applications to image restoration, Open issues and recent advances in DC programming and DCA, SGEM: stochastic gradient with energy and momentum, Unnamed Item, Unnamed Item, Recent Theoretical Advances in Non-Convex Optimization, Fast convex optimization via inertial dynamics combining viscous and Hessian-driven damping with time rescaling, Convergence analysis and applications of the inertial algorithm solving inclusion problems, An inertial based forward-backward algorithm for monotone inclusion problems and split mixed equilibrium problems in Hilbert spaces, Inertial extragradient algorithms with non-monotone stepsizes for pseudomonotone variational inequalities and applications, Computing dynamic user equilibrium on large-scale networks without knowing global parameters, New inertial projection methods for solving multivalued variational inequality problems beyond monotonicity, An accelerated minimal gradient method with momentum for strictly convex quadratic optimization, An accelerated forward-backward algorithm with a new linesearch for convex minimization problems and its applications, Some new classes of general quasi variational inequalities, First-order optimization algorithms via inertial systems with Hessian driven damping, First-order inertial algorithms involving dry friction damping, Strong convergence of a self-adaptive inertial Tseng's extragradient method for pseudomonotone variational inequalities and fixed point problems, An inertial-type algorithm for approximation of solutions of Hammerstein integral inclusions in Hilbert spaces, Fast convergence of dynamical ADMM via time scaling of damped inertial dynamics, Convergence analysis of two-step inertial Douglas-Rachford algorithm and application, Viscosity-type inertial extragradient algorithms for solving variational inequality problems and fixed point problems, An inertial Bregman generalized alternating direction method of multipliers for nonconvex optimization, A fast proximal iteratively reweighted nuclear norm algorithm for nonconvex low-rank matrix minimization problems, Inertial stochastic PALM and applications in machine learning, Two strongly convergent methods governed by pseudo-monotone bi-function in a real Hilbert space with applications, An alternated inertial method for pseudomonotone variational inequalities in Hilbert spaces, Two optimization approaches for solving split variational inclusion problems with applications, Inertial iterative method with self-adaptive step size for finite family of split monotone variational inclusion and fixed point problems in Banach spaces, Strong convergence results for quasimonotone variational inequalities, Sampling Kaczmarz-Motzkin method for linear feasibility problems: generalization and acceleration, An extended inertial Halpern-type ball-relaxed \(CQ\) algorithm for multiple-sets split feasibility problem, An inertial self-adaptive algorithm for the generalized split common null point problem in Hilbert spaces, A new self-adaptive accelerated method for generalized split system of common fixed-point problem of averaged mappings, Applications of accelerated computational methods for quasi-nonexpansive operators to optimization problems, The inertial iterative extragradient methods for solving pseudomonotone equilibrium programming in Hilbert spaces, Convergence analysis of the shrinking approximants for fixed point problem and generalized split common null point problem, An accelerated common fixed point algorithm for a countable family of \(G\)-nonexpansive mappings with applications to image recovery, Approximation method for monotone inclusion problems in real Banach spaces with applications, Convergence analysis of new construction explicit methods for solving equilibrium programming and fixed point problems, Revisiting subgradient extragradient methods for solving variational inequalities, Relaxed inertial methods for solving split variational inequality problems without product space formulation, Discrete dynamical system approaches for Boolean polynomial optimization, Fast inertial dynamic algorithm with smoothing method for nonsmooth convex optimization, An inertial extragradient algorithm for equilibrium and generalized split null point problems, An inertially constructed forward-backward splitting algorithm in Hilbert spaces, Solving common nonmonotone equilibrium problems using an inertial parallel hybrid algorithm with Armijo line search with applications to image recovery, An inertial parallel algorithm for a finite family of \(G\)-nonexpansive mappings with application to the diffusion problem, A parallel Tseng's splitting method for solving common variational inclusion applied to signal recovery problems, Image restorations using an inertial parallel hybrid algorithm with Armijo linesearch for nonmonotone equilibrium problems, Iterative method with inertial terms for nonexpansive mappings: applications to compressed sensing, Strong convergence of an extragradient-like algorithm involving pseudo-monotone mappings, Analytical convergence regions of accelerated gradient descent in nonconvex optimization under regularity condition, Strong convergence analysis of common variational inclusion problems involving an inertial parallel monotone hybrid method for a novel application to image restoration, The extragradient algorithm with inertial effects extended to equilibrium problems, An explicit extragradient algorithm for solving variational inequalities, ASD+M: automatic parameter tuning in stochastic optimization and on-line learning, A regularization interpretation of the proximal point method for weakly convex functions, New strong convergence theorem of the inertial projection and contraction method for variational inequality problems, An efficient projection-type method for monotone variational inequalities in Hilbert spaces, A gradient-type algorithm with backward inertial steps associated to a nonconvex minimization problem, Preserving differential privacy in deep neural networks with relevance-based adaptive noise imposition, Convergence rate of inertial proximal algorithms with general extrapolation and proximal coefficients, Application of new strongly convergent iterative methods to split equality problems, A strong convergence theorem for Tseng's extragradient method for solving variational inequality problems, A hybrid inertial algorithm for approximating solution of convex feasibility problems with applications, Efficient first-order methods for convex minimization: a constructive approach, Golden ratio algorithms for variational inequalities, Two modifications of the inertial Tseng extragradient method with self-adaptive step size for solving monotone variational inequality problems, Fast and simple Bregman projection methods for solving variational inequalities and related problems in Banach spaces, A double extrapolation primal-dual algorithm for saddle point problems, Shrinking projection methods for accelerating relaxed inertial Tseng-type algorithm with applications, Accelerated hybrid methods for solving pseudomonotone equilibrium problems, How can machine learning and optimization help each other better?, An algorithm for the split feasible problem and image restoration, Algorithm for overcoming the curse of dimensionality for state-dependent Hamilton-Jacobi equations, A new strong convergence for solving split variational inclusion problems, Inertial-type algorithm for solving split common fixed point problems in Banach spaces, Global and linear convergence of alternated inertial methods for split feasibility problems, Self adaptive inertial relaxed \(CQ\) algorithms for solving split feasibility problem with multiple output sets, Projection method with inertial step for nonlinear equations: application to signal recovery, Inertial proximal incremental aggregated gradient method with linear convergence guarantees, Convergence results of two-step inertial proximal point algorithm, An inertial proximal partially symmetric ADMM-based algorithm for linearly constrained multi-block nonconvex optimization problems with applications, Convergence rates of first- and higher-order dynamics for solving linear ill-posed problems, SRKCD: a stabilized Runge-Kutta method for stochastic optimization, Multi-inertial parallel hybrid projection algorithm for generalized split null point problems, Understanding the acceleration phenomenon via high-resolution differential equations, From differential equation solvers to accelerated first-order methods for convex optimization, Convergence rates for the heavy-ball continuous dynamics for non-convex optimization, under Polyak-Łojasiewicz condition, Two-step inertial Bregman alternating minimization algorithm for nonconvex and nonsmooth problems, Convergence rates of damped inerial dynamics from multi-degree-of-freedom system, An inertial Halpern-type algorithm involving monotone operators on real Banach spaces with application to image recovery problems, Viscosity modification with parallel inertial two steps forward-backward splitting methods for inclusion problems applied to signal recovery, Three novel two-step proximal-like methods for solving equilibrium and fixed point problems in real Hilbert spaces, Image restoration by advanced parallel inertial forward-backward splitting methods, An adaptive Polyak heavy-ball method, A stochastic gradient algorithm with momentum terms for optimal control problems governed by a convection-diffusion equation with random diffusivity, On the convergence analysis of aggregated heavy-ball method, A fast continuous time approach with time scaling for nonsmooth convex optimization, Inertial accelerated SGD algorithms for solving large-scale lower-rank tensor CP decomposition problems, Fast inertial extragradient algorithms for solving non-Lipschitzian equilibrium problems without monotonicity condition in real Hilbert spaces, Generating Nesterov's accelerated gradient algorithm by using optimal control theory for optimization, An inertial Mann forward-backward splitting algorithm of variational inclusion problems and its applications, Viscosity \(S\)-iteration method with inertial technique and self-adaptive step size for split variational inclusion, equilibrium and fixed point problems, An inertial semi-forward-reflected-backward splitting and its application, A secant-based Nesterov method for convex functions, A General Inertial Proximal Point Algorithm for Mixed Variational Inequality Problem, An inertial S-iteration process, Global optimization issues in deep network regression: an overview, Inertial Proximal Alternating Linearized Minimization (iPALM) for Nonconvex and Nonsmooth Problems, Optimisation and asymptotic stability, Strong convergence of self-adaptive inertial algorithms for solving split variational inclusion problems with applications, An engineering interpretation of Nesterov's convex minimization algorithm and time integration: application to optimal fiber orientation, Inertial extragradient type method for mixed variational inequalities without monotonicity, An improved inertial extragradient subgradient method for solving split variational inequality problems, Accelerated non-monotonic explicit proximal-type method for solving equilibrium programming with convex constraints and its applications, A new inertial-projection algorithm for approximating common solution of variational inequality and fixed point problems of multivalued mappings, Analysis of two versions of relaxed inertial algorithms with Bregman divergences for solving variational inequalities, A novel algorithm for generalized split common null point problem with applications, General inertial proximal gradient method for a class of nonconvex nonsmooth optimization problems, Iteratively reweighted \(\ell _1\) algorithms with extrapolation, A new inertial-based method for solving pseudomonotone operator equations with application, Inertial algorithms for a system of equilibrium problems and fixed point problems, Quasi-Nonexpansive Iterations on the Affine Hull of Orbits: From Mann's Mean Value Algorithm to Inertial Methods, MiKM: multi-step inertial Krasnosel'skiǐ-Mann algorithm and its applications, Asynchronous sequential inertial iterations for common fixed points problems with an application to linear systems, Inertial splitting methods without prior constants for solving variational inclusions of two operators, Second-order flows for computing the ground states of rotating Bose-Einstein condensates, New inertial forward-backward algorithm for convex minimization with applications, Convergence rates of the heavy-ball method under the Łojasiewicz property, An algorithm for split equilibrium and fixed-point problems using inertial extragradient techniques, An accelerated variant of the projection based parallel hybrid algorithm for split null point problems, A novel algorithm for approximating common solution of a system of monotone inclusion problems and common fixed point problem, Inertial Mann-type iterative method for solving split monotone variational inclusion problem with applications, Mean curvature flow for generating discrete surfaces with piecewise constant mean curvatures, Activity Identification and Local Linear Convergence of Forward--Backward-type Methods, A closed-form bound on the asymptotic linear convergence of iterative methods via fixed point analysis, Discriminative Bayesian filtering lends momentum to the stochastic Newton method for minimizing log-convex functions, A novel accelerated extragradient algorithm to solve pseudomonotone variational inequalities, Optimal convergence rates for damped inertial gradient dynamics with flat geometries, An inertial proximal point method for difference of maximal monotone vector fields in Hadamard manifolds, An abstract convergence framework with application to inertial inexact forward-backward methods, A smoothing proximal gradient algorithm with extrapolation for the relaxation of \({\ell_0}\) regularization problem, Fast convergence of inertial gradient dynamics with multiscale aspects, Halting time is predictable for large models: a universality property and average-case analysis, Convergence Rates of Inertial Forward-Backward Algorithms, An inertial subgradient extragradient method with Armijo type step size for pseudomonotone variational inequalities with non-Lipschitz operators in Banach spaces, Spectral test for exponential stability, A modified inertial three-term conjugate gradient projection method for constrained nonlinear equations with applications in compressed sensing, Memory gradient method for multiobjective optimization, Unnamed Item, Unnamed Item, Unnamed Item, Unnamed Item, A generic online acceleration scheme for optimization algorithms via relaxation and inertia, Unifying Abstract Inexact Convergence Theorems and Block Coordinate Variable Metric iPiano, Coercing machine learning to output physically accurate results, Non-monotone Behavior of the Heavy Ball Method, Parallel Optimization Techniques for Machine Learning, Convergence Rates of Damped Inertial Dynamics under Geometric Conditions and Perturbations, Improved convergence rates and trajectory convergence for primal-dual dynamical systems with vanishing damping, An extension of the second order dynamical system that models Nesterov's convex gradient method, A review of nonlinear FFT-based computational homogenization methods, Inertial methods for finding minimum-norm solutions of the split variational inequality problem beyond monotonicity, Accelerated proximal point method for maximally monotone operators, Convergence rates for an inertial algorithm of gradient type associated to a smooth non-convex minimization, Effect of shrinking projection and CQ-methods on two inertial forward-backward algorithms for solving variational inclusion problems, A general inertial projected gradient method for variational inequality problems, An algorithm for approximating solutions of variational inequality and split fixed point problems with applications, A strongly convergent Mann-type inertial algorithm for solving split variational inclusion problems, Modified hybrid projection methods with SP iterations for quasi-nonexpansive multivalued mappings in Hilbert spaces, Performance of first-order methods for smooth convex minimization: a novel approach, Inertial extragradient algorithms for strongly pseudomonotone variational inequalities, An inertial algorithm for DC programming, A new inertial double-projection method for solving variational inequalities, Transient response in matrix discrete-time linear systems, Self-adaptive algorithms with inertial effects for solving the split problem of the demicontractive operators, Dynamic search trajectory methods for global optimization, A neural network approach to efficient valuation of large portfolios of variable annuities, A stochastic inertial forward–backward splitting algorithm for multivariate monotone inclusions, On dissipative symplectic integration with applications to gradient-based optimization, Convergence Rates of Inertial Primal-Dual Dynamical Methods for Separable Convex Optimization Problems, A parameterized three-operator splitting algorithm and its expansion, Inertial projection-type methods for solving quasi-variational inequalities in real Hilbert spaces, Accelerated variational PDEs for efficient solution of regularized inversion problems, Inertial proximal strictly contractive peaceman-Rachford splitting method with an indefinite term for convex optimization, A Gauss-Seidel type inertial proximal alternating linearized minimization for a class of nonconvex optimization problems, Bayesian Deep Net GLM and GLMM, An FFT-based fast gradient method for elastic and inelastic unit cell homogenization problems, Fast implicit solvers for phase-field fracture problems on heterogeneous microstructures, Shrinking projection methods involving inertial forward-backward splitting methods for inclusion problems, Relaxed CQ algorithms involving the inertial technique for multiple-sets split feasibility problems, Inertial forward-backward splitting method in Banach spaces with application to compressed sensing., Über mehrstufige Iterationsverfahren und die Lösung der Hammersteinschen Gleichung, Harder, Better, Faster, Stronger Convergence Rates for Least-Squares Regression, An inertial parallel and asynchronous forward-backward iteration for distributed convex optimization, Convergence analysis of projection method for variational inequalities, On polarization-based schemes for the FFT-based computational homogenization of inelastic materials, A general double-proximal gradient algorithm for d.c. programming, Accelerated subgradient extragradient methods for variational inequality problems, Reckoning solution of split common fixed point problems by using inertial self-adaptive algorithms, PDE acceleration: a convergence rate analysis and applications to obstacle problems, Convergence of a relaxed inertial forward-backward algorithm for structured monotone inclusions, Shadow Douglas-Rachford splitting for monotone inclusions, On damped second-order gradient systems