Deep neural network structures solving variational inequalities
From MaRDI portal
Abstract: Motivated by structures that appear in deep neural networks, we investigate nonlinear composite models alternating proximity and affine operators defined on different spaces. We first show that a wide range of activation operators used in neural networks are actually proximity operators. We then establish conditions for the averagedness of the proposed composite constructs and investigate their asymptotic properties. It is shown that the limit of the resulting process solves a variational inequality which, in general, does not derive from a minimization problem.
Recommendations
- Solving complementarity and variational inequalities problems using neural networks
- Notes on a neural network approach to inverse variational inequalities
- Neural networks for a class of linearly constrained linear variational inequalities
- A neural network for monotone variational inequalities with linear constraints
- scientific article; zbMATH DE number 6453467
Cites work
- A dynamical system associated with the fixed points set of a nonexpansive operator
- A logical calculus of the ideas immanent in nervous activity
- A new projection method for finding the closest point in the intersection of convex sets
- A primal-dual splitting method for convex optimization involving Lipschitzian, proximable and linear composite terms
- Approximation by superpositions of a sigmoidal function
- Backward-forward algorithms for structured monotone inclusions in Hilbert spaces
- Compositions and convex combinations of averaged nonexpansive operators
- Convergence properties of dynamic string-averaging projection methods in the presence of perturbations
- Convergence rate analysis for averaged fixed point iterations in common fixed point problems
- Convex Analysis
- Convex analysis and monotone operator theory in Hilbert spaces
- scientific article; zbMATH DE number 3671159 (Why is no real title available?)
- scientific article; zbMATH DE number 51537 (Why is no real title available?)
- scientific article; zbMATH DE number 806611 (Why is no real title available?)
- scientific article; zbMATH DE number 3359250 (Why is no real title available?)
- Iterative methods for fixed point problems in Hilbert spaces
- Krasnoselski-Mann Iterations in Normed Spaces
- Linear and strong convergence of algorithms involving averaged nonexpansive operators
- Monotone operator theory in convex optimization
- Monotone Operators and the Proximal Point Algorithm
- New Douglas-Rachford algorithmic structures and their convergence analyses
- Nonexpansiveness of a linearized augmented Lagrangian operator for hierarchical convex optimization
- On Projection Algorithms for Solving Convex Feasibility Problems
- On the Convergence of the Products of Firmly Nonexpansive Mappings
- On the Douglas-Rachford splitting method and the proximal point algorithm for maximal monotone operators
- Proximal Thresholding Algorithm for Minimization over Orthonormal Bases
- Sharp convergence rates for averaged nonexpansive maps
- Signal Recovery by Proximal Forward-Backward Splitting
- Solving monotone inclusions via compositions of nonexpansive averaged operators
- The forward-backward algorithm and the normal problem
- There is no variational characterization of the cycles in the method of periodic projections
- Universal approximation bounds for superpositions of a sigmoidal function
Cited in
(34)- Deep neural networks and mixed integer linear optimization
- Deep neural networks motivated by partial differential equations
- Reconstruction of functions from prescribed proximal points
- On -firmly nonexpansive operators in r-uniformly convex spaces
- Synthesis of recurrent neural dynamics for monotone inclusion with application to Bayesian inference
- Frame soft shrinkage operators are proximity operators
- Deep solution operators for variational inequalities via proximal neural networks
- Designing rotationally invariant neural networks from PDEs and variational methods
- Convolutional proximal neural networks and plug-and-play algorithms
- Analysis of two versions of relaxed inertial algorithms with Bregman divergences for solving variational inequalities
- Convergence of proximal gradient algorithm in the presence of adjoint mismatch
- Attouch--Théra Duality, Generalized Cycles, and Gap Vectors
- A variational inequality model for the construction of signals from inconsistent nonlinear equations
- Lipschitz Certificates for Layered Network Structures Driven by Averaged Activation Operators
- Regularization theory of the analytic deep prior approach
- An Augmented Lagrangian Deep Learning Method for Variational Problems with Essential Boundary Conditions
- Wasserstein-based projections with applications to inverse problems
- A Deep Learning Method for Elliptic Hemivariational Inequalities
- Multivariate Monotone Inclusions in Saddle Form
- Data-driven nonsmooth optimization
- Learning maximally monotone operators for image recovery
- Connections between numerical algorithms for PDEs and neural networks
- Resolvent and proximal compositions
- Convergence Results for Primal-Dual Algorithms in the Presence of Adjoint Mismatch
- The use of physics-informed neural network approach to image restoration via nonlinear PDE tools
- Designing stable neural networks using convex analysis and ODEs
- On dynamical system modeling of learned primal-dual with a linear operator \(\mathcal{K}\): stability and convergence properties
- The geometry of monotone operator splitting methods
- Plug and Play splitting techniques for Poisson image restoration
- Almost-surely convergent randomly activated monotone operator splitting methods
- Stability bounds for the unfolded forward-backward algorithm
- On projective stochastic-gradient type methods for solving large scale systems of nonlinear ill-posed equations: applications to machine learning
- Parseval proximal neural networks
- Variational models for signal processing with graph neural networks
This page was built for publication: Deep neural network structures solving variational inequalities
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2194605)
