Inertial stochastic PALM and applications in machine learning

DOI10.1007/s43670-022-00021-xzbMath1487.65065arXiv2005.02204OpenAlexW4224304123MaRDI QIDQ2143164

Johannes Hertrich, Gabriele Drauschke

Publication date: 31 May 2022

Published in: Sampling Theory, Signal Processing, and Data Analysis (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/2005.02204

zbMATH Keywords

stochastic optimizationvariance reductionnon-convex optimizationproximity operatorstochastic PALM

Mathematics Subject Classification ID

Artificial neural networks and deep learning (68T07) Numerical mathematical programming methods (65K05) Nonconvex programming, global optimization (90C26) Stochastic programming (90C15) Random operators and equations (aspects of stochastic analysis) (60H25)

Related Items (1)

Inertial accelerated SGD algorithms for solving large-scale lower-rank tensor CP decomposition problems

Uses Software

• Adam
• mftoolbox

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Proximal alternating linearized minimization for nonconvex and nonsmooth problems
• Parseval proximal neural networks
• On the convergence of the proximal algorithm for nonsmooth functions involving analytic features
• On semi- and subanalytic geometry
• Spatially constrained Student's \(t\)-distribution based mixture model for robust image segmentation
• A first-order primal-dual algorithm for convex problems with applications to imaging
• Total variation with overlapping group sparsity for deblurring images under Cauchy noise
• Alternatives to the EM algorithm for ML estimation of location, scatter matrix, and degree of freedom of the Student \(t\) distribution
• Convolutional proximal neural networks and plug-and-play algorithms
• On-Line Expectation–Maximization Algorithm for latent Data Models
• Block Stochastic Gradient Iteration for Convex and Nonconvex Optimization
• Proximal Alternating Minimization and Projection Methods for Nonconvex Problems: An Approach Based on the Kurdyka-Łojasiewicz Inequality
• Inertial Proximal Alternating Linearized Minimization (iPALM) for Nonconvex and Nonsmooth Problems
• Large-Scale Machine Learning with Stochastic Gradient Descent
• Evaluating Derivatives
• Variational Analysis
• Stochastic Primal-Dual Hybrid Gradient Algorithm with Arbitrary Sampling and Imaging Applications
• Multivariate Myriad Filters Based on Parameter Estimation of Student-$t$ Distributions
• Learning representations by back-propagating errors
• Functions of Matrices
• Some methods of speeding up the convergence of iteration methods

This page was built for publication: Inertial stochastic PALM and applications in machine learning