Re-examination of Bregman functions and new properties of their divergences
From MaRDI portal
(Redirected from Publication:4613995)
Bregman divergenceBregman functiongaugenegative Boltzmann-Gibbs-Shannon entropynegative Burg entropynegative Havrda-Charvát-Tsallis entropynegative iterated log entropyrelative uniform convexitystrongly convexuniformly convex
Convexity of real functions of several variables, generalizations (26B25) Applications of functional analysis in optimization, convex analysis, mathematical programming, economics (46N10) Nonlinear functional analysis (46T99) Applications of operator theory in optimization, convex analysis, mathematical programming, economics (47N10) Numerical methods based on nonlinear programming (49M37) Convex functions and convex programs in convex geometry (52A41) Computational aspects related to convexity (52B55) Real-valued functions on manifolds (58C05) Convex programming (90C25) Nonlinear programming (90C30)
Abstract: The Bregman divergence (Bregman distance, Bregman measure of distance) is a certain useful substitute for a distance, obtained from a well-chosen function (the "Bregman function"). Bregman functions and divergences have been extensively investigated during the last decades and have found applications in optimization, operations research, information theory, nonlinear analysis, machine learning and more. This paper re-examines various aspects related to the theory of Bregman functions and divergences. In particular, it presents many sufficient conditions which allow the construction of Bregman functions in a general setting and introduces new Bregman functions (such as a negative iterated log entropy). Moreover, it sheds new light on several known Bregman functions such as quadratic entropies, the negative Havrda-Charv'at-Tsallis entropy, and the negative Boltzmann-Gibbs-Shannon entropy, and it shows that the negative Burg entropy, which is not a Bregman function according to the classical theory but nevertheless is known to have "Bregmanian properties", can, by our re-examination of the theory, be considered as a Bregman function. Our analysis yields several by-products of independent interest such as the introduction of the concept of relative uniform convexity (a certain generalization of uniform convexity), new properties of uniformly and strongly convex functions, and results in Banach space theory.
Recommendations
Cites work
- A descent lemma beyond Lipschitz gradient continuity: first-order methods revisited and applications
- A Generalized Proximal Point Algorithm for the Variational Inequality Problem in a Hilbert Space
- A Mathematical Theory of Communication
- A proximal point method for the variational inequality problem in Banach spaces
- A relaxed version of Bregman's method for convex programming
- A telescopic Bregmanian proximal gradient method without the global Lipschitz continuity assumption
- An algorithm for maximum entropy image reconstruction from noisy data
- An inexact hybrid generalized proximal point algorithm and some new results on the theory of Bregman functions
- An interior point method with Bregman functions for the variational inequality problem with paramonotone operators
- An iterative row-action method for interval convex programming
- Approximate iterations in Bregman-function-based proximal algorithms
- Asymptotic Behavior of Relatively Nonexpansive Operators in Banach Spaces
- Bregman distances, totally convex functions, and a method for solving operator equations in Banach spaces
- Bregman Iterative Algorithms for \ell₁-Minimization with Applications to Compressed Sensing
- Bregman Monotone Optimization Algorithms
- Bregman Voronoi diagrams
- Clustering with Bregman divergences.
- Computationally feasible high-resolution minimum-distance procedures which extend the maximum-entropy method
- Construction of best Bregman approximations in reflexive Banach spaces
- Constructions of uniformly convex functions
- Convergence Analysis of a Proximal-Like Minimization Algorithm Using Bregman Functions
- Convergence of a proximal-like algorithm in the presence of computational errors
- Convergence of Bregman projection methods for solving consistent convex feasibility problems in reflexive Banach spaces
- Convergence to fixed points of inexact orbits of Bregman-monotone and of nonexpansive operators in Banach spaces
- Convex Analysis
- Convex analysis and monotone operator theory in Hilbert spaces
- Convex functions, monotone operators and differentiability.
- Dual convergence of the proximal point method with Bregman distances for linear programming
- Enlargement of monotone operators with applications to variational inequalities
- Entropic Proximal Mappings with Applications to Nonlinear Programming
- ESSENTIAL SMOOTHNESS, ESSENTIAL STRICT CONVEXITY, AND LEGENDRE FUNCTIONS IN BANACH SPACES
- Families of alpha-, beta- and gamma-divergences: flexible and robust measures of similarities
- Fixed points of polarity type operators
- Forward-backward splitting with Bregman distances
- Functional analysis, Sobolev spaces and partial differential equations
- General entropy criteria for inverse problems, with applications to data compression, pattern classification, and cluster analysis
- Geometrical background of metric fixed point theory
- scientific article; zbMATH DE number 5903950 (Why is no real title available?)
- scientific article; zbMATH DE number 1807400 (Why is no real title available?)
- scientific article; zbMATH DE number 5957421 (Why is no real title available?)
- scientific article; zbMATH DE number 3137662 (Why is no real title available?)
- scientific article; zbMATH DE number 3872359 (Why is no real title available?)
- scientific article; zbMATH DE number 3901504 (Why is no real title available?)
- scientific article; zbMATH DE number 3717984 (Why is no real title available?)
- scientific article; zbMATH DE number 3772323 (Why is no real title available?)
- scientific article; zbMATH DE number 3790208 (Why is no real title available?)
- scientific article; zbMATH DE number 51872 (Why is no real title available?)
- scientific article; zbMATH DE number 125936 (Why is no real title available?)
- scientific article; zbMATH DE number 3574390 (Why is no real title available?)
- scientific article; zbMATH DE number 1046019 (Why is no real title available?)
- scientific article; zbMATH DE number 1968250 (Why is no real title available?)
- scientific article; zbMATH DE number 1968261 (Why is no real title available?)
- scientific article; zbMATH DE number 2147674 (Why is no real title available?)
- scientific article; zbMATH DE number 1382772 (Why is no real title available?)
- scientific article; zbMATH DE number 2116058 (Why is no real title available?)
- scientific article; zbMATH DE number 932419 (Why is no real title available?)
- scientific article; zbMATH DE number 1393068 (Why is no real title available?)
- scientific article; zbMATH DE number 3249557 (Why is no real title available?)
- scientific article; zbMATH DE number 3284914 (Why is no real title available?)
- scientific article; zbMATH DE number 3296905 (Why is no real title available?)
- scientific article; zbMATH DE number 4184947 (Why is no real title available?)
- scientific article; zbMATH DE number 3092812 (Why is no real title available?)
- Information gain within nonextensive thermostatistics
- Information Geometry of U-Boost and Bregman Divergence
- Introduction to Nonextensive Statistical Mechanics
- Introductory lectures on convex optimization. A basic course.
- Iterations of paracontractions and firmaly nonexpansive operators with applications to feasibility and optimization
- Klee sets and Chebyshev centers for the right Bregman distance
- Logistic regression, AdaBoost and Bregman distances
- Mirror descent and nonlinear projected subgradient methods for convex optimization.
- Nonextensive statistical mechanics and its applications. Papers from the IMS winter school on statistical mechanics: nonextensive generalization of Boltzmann-Gibbs statistical mechanics and its applications, Okazaki, Japan, February 15--18, 1999
- Notes on maximum-entropy processing (Corresp.)
- On dual convergence of the generalized proximal point method with Bregman distances
- On inexact generalized proximal methods with a weakened error tolerance criterion
- On Information and Sufficiency
- On the Optimality of Conditional Expectation as a Bregman Predictor
- On uniformly convex functionals
- On uniformly convex functions
- Optimization of Burg's entropy over linear constraints
- Optimization of “\log x” Entropy over Linear Equality Constraints
- Possible generalization of Boltzmann-Gibbs statistics.
- Proximal Minimization Methods with Generalized Bregman Functions
- Rescaling and stepsize selection in proximal methods using separable generalized distances
- Solutions to inexact resolvent inclusion problems with applications to nonlinear analysis and optimization
- Some properties of generalized proximal point methods for quadratic and linear programming
- Structured prediction, dual extragradient and Bregman projections
- The Bregman distance without the Bregman function. II
- The non-existence of smooth demand in general Banach spaces
- The ordered subsets mirror descent optimization method with applications to tomography
- Totally convex functions for fixed points computation and infinite dimensional optimization
- Two Strong Convergence Theorems for a Proximal Method in Reflexive Banach Spaces
- Two strong convergence theorems for Bregman strongly nonexpansive operators in reflexive Banach spaces
- Uniformly convex functions on Banach spaces
- Why least squares and maximum entropy? An axiomatic approach to inference for linear inverse problems
Cited in
(88)- Metrics defined by Bregman divergences
- Metrics defined by Bregman divergences. II
- Some new flexibilizations of Bregman divergences and their asymptotics
- Bregman divergences from comparative convexity
- On the shrinking projection method for the split feasibility problem in Banach spaces
- A Tseng extragradient method for solving variational inequality problems in Banach spaces
- Upper and lower bounds for the Bregman divergence
- Weak and strong convergence Bregman extragradient schemes for solving pseudo-monotone and non-Lipschitz variational inequalities
- Convergence analysis for variational inequalities and fixed point problems in reflexive Banach spaces
- A strong convergence theorem for solving an equilibrium problem and a fixed point problem using the Bregman distance
- Extragradient algorithm for solving pseudomonotone equilibrium problem with Bregman distance in reflexive Banach spaces
- A convergence theorem for solving generalized mixed equilibrium problems and finding fixed points of a weak Bregman relatively nonexpansive mappings in Banach spaces
- A strong convergence theorem for quasi-equilibrium problems in Banach spaces
- Extragradient and extrapolation methods with generalized Bregman distances for saddle point problems
- Inertial self-adaptive Bregman projection method for finite family of variational inequality problems in reflexive Banach spaces
- A strong convergence algorithm for solving pseudomonotone variational inequalities with a single projection
- A strong convergence theorem for solving pseudo-monotone variational inequalities using projection methods
- Fast and simple Bregman projection methods for solving variational inequalities and related problems in Banach spaces
- A novel kernelized total Bregman divergence-based fuzzy clustering with local information for image segmentation
- A strong convergence theorem for a finite family of Bregman demimetric mappings in a Banach space under a new shrinking projection method
- Approximation of a common \(f\)-fixed point of \(f\)-pseudocontractive mappings in Banach spaces
- A Halpern-type iteration method for Bregman nonspreading mapping and monotone operators in reflexive Banach spaces
- The Bregman chord divergence
- A telescopic Bregmanian proximal gradient method without the global Lipschitz continuity assumption
- On the rate of convergence of iterated Bregman projections and of the alternating algorithm
- On the joint convexity of the Bregman divergence of matrices
- Entropy on spin factors
- Solving a general split equality problem without prior knowledge of operator norms in Banach spaces
- Joint and separate convexity of the Bregman distance.
- Bregman and Burbea-Rao divergence for matrices
- The information geometry of Bregman divergences and some applications in multi-expert reasoning
- Regular self-proximal distances are Bregman
- Functional Bregman Divergence and Bayesian Estimation of Distributions
- scientific article; zbMATH DE number 1968261 (Why is no real title available?)
- Some Hermite-Hadamard type inequalities for harmonically extended s-convex functions
- Quasiconvex Jensen divergences and quasiconvex Bregman divergences
- A Bregman subgradient extragradient method with self-adaptive technique for solving variational inequalities in reflexive Banach spaces
- Two New Inertial Algorithms for Solving Variational Inequalities in Reflexive Banach Spaces
- Strong convergence of a generalized forward–backward splitting method in reflexive Banach spaces
- The Generalized Bregman Distance
- A note on the approximate symmetry of Bregman distances
- Bregman divergence and density integration
- An inertial method for split equality common \(f, g\)-fixed point problems of \(f, g\)-pseudocontractive mappings in reflexive real Banach spaces
- Mann-type algorithms for solving the monotone inclusion problem and the fixed point problem in reflexive Banach spaces
- A strong convergence theorem under a new shrinking projection method for nonlinear mappings in reflexive Banach spaces
- Convergence rates for nonlinear inverse problems of parameter identification using Bregman distances
- Convergence analysis of a new Bregman extragradient method for solving fixed point problems and variational inequality problems in reflexive Banach spaces
- Strong convergence theorem for a new Bregman extragradient method with a different line-search process for solving variational inequality problems in reflexive Banach spaces
- Novel inertial methods for fixed point problems in reflexive Banach spaces with applications
- Strong Convergence Theorem Obtained by a Generalized Projections Method for Solving an Equilibrium Problem and Fixed Point Problems
- A strongly convergent algorithm for solving multiple set split equality equilibrium and fixed point problems in Banach spaces
- Accelerated Bregman projection rules for pseudomonotone variational inequalities and common fixed point problems
- Approximating common elements of fixed points of Bregman totally quasi-asymptotically nonexpansive mappings and solutions of a system of generalized mixed equilibrium problems in reflexive Banach spaces
- The method of randomized Bregman projections for stochastic feasibility problems
- A modified inertial Halpern method for solving split monotone variational inclusion problems in Banach spaces
- Inertial‐like Bregman projection method for solving systems of variational inequalities
- A Bregman–Kaczmarz method for nonlinear systems of equations
- One-step Bregman projection methods for solving variational inequalities in reflexive Banach spaces
- Strong convergence theorem of a new modified Bregman extragradient method to solve fixed point problems and variational inequality problems in general reflexive Banach spaces
- Convergence theorem for fixed point and split generalized variational inclusion problems with multiple output sets in Banach spaces
- An inertial-like Tseng's extragradient method for solving pseudomonotone variational inequalities in reflexive Banach spaces
- Approximating solutions of monotone variational inclusion, equilibrium and fixed point problems of certain nonlinear mappings in Banach spaces
- On triple-adaptive projection method for bilevel split variational inequalities with CFPP constraint of finite Bregman relatively demicontractions in Banach spaces
- On the Bregman-proximal iterative algorithm for the monotone inclusion problem in Banach spaces
- An inertial method for solving split equality quasimonotone minty variational inequality problems in reflexive Banach spaces
- A mirror inertial forward-reflected-backward splitting: convergence analysis beyond convexity and Lipschitz smoothness
- On split equality monotone variational inclusion and fixed point problems in reflexive Banach spaces
- An improved subgradient extragradient self-adaptive algorithm based on the golden ratio technique for variational inequality problems in Banach spaces
- Dual-inertial extragradient rule for pseudomonotonic variational inequalities with split cfpp constraint with multiple output sets
- New algorithms for solving pseudo-monotone variational inequalities in Banach spaces
- Estimating mean and variance of random coefficients in stochastic variational problems using second-order methods
- Sequential splitting algorithms with Bregman distance for solving equilibrium problems
- Global convergence of block Bregman proximal iteratively reweighted algorithm with extrapolation
- On quasi-inertial double extragradient-type iterations for variational inequalities and Bregman relatively asymptotically nonexpansive mapping
- Mirror frameworks for relatively Lipschitz and monotone-like variational inequalities
- Adaptive double-inertial projection rules for variational inequalities and CFPPs of finite Bregman relative demicontractions and asymptotical nonexpansivity operators
- On Quasi-Inertial Double Extragradient-Type Iterations for Variational Inequalities with CFPP Constraint Involving Bregman Relatively Asymptotically Nonexpansive Mapping
- A new modified Halpern-type splitting algorithm for solving monotone inclusion problems in reflexive Banach spaces
- Self-adaptive inertial subgradient-like extragradient method for bilevel split pseudomonotone variational inequality with CFPP constraint in Banach spaces
- A variational rationality perspective on the quasi-equilibrium problem: climbing the goal ladder
- Backward inertial modification of the Bregman golden ratio algorithm for solving variational inequalities
- Bregman projections and parallel linesearch algorithms for multiple-sets problems
- A Bregman regularized proximal point method for solving equilibrium problems on Hadamard manifolds
- General inertial smoothing Bregman proximal gradient algorithms for group capped-_1 regularized minimization
- Inertial Bregman proximal iteratively reweighted algorithms for a class of nonconvex nonsmooth regularized problems
- A strong convergence theorem for approximation of a zero of the sum of two maximal monotone mappings in Banach spaces
- Compositions and convex combinations of Bregman weakly relatively nonexpansive operators in reflexive Banach spaces
- Klee sets and Chebyshev centers for the right Bregman distance
This page was built for publication: Re-examination of Bregman functions and new properties of their divergences
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4613995)
