Submodular functions: from discrete to continuous domains
From MaRDI portal
Abstract: Submodular set-functions have many applications in combinatorial optimization, as they can be minimized and approximately maximized in polynomial time. A key element in many of the algorithms and analyses is the possibility of extending the submodular set-function to a convex function, which opens up tools from convex optimization. Submodularity goes beyond set-functions and has naturally been considered for problems with multiple labels or for functions defined on continuous domains, where it corresponds essentially to cross second-derivatives being nonpositive. In this paper, we show that most results relating submodularity and convexity for set-functions can be extended to all submodular functions. In particular, (a) we naturally define a continuous extension in a set of probability measures, (b) show that the extension is convex if and only if the original function is submodular, (c) prove that the problem of minimizing a submodular function is equivalent to a typically non-smooth convex optimization problem, and (d) propose another convex optimization problem with better computational properties (e.g., a smooth dual problem). Most of these extensions from the set-function situation are obtained by drawing links with the theory of multi-marginal optimal transport, which provides also a new interpretation of existing results for set-functions. We then provide practical algorithms to minimize generic submodular functions on discrete domains, with associated convergence rates.
Recommendations
Cites work
- scientific article; zbMATH DE number 3904328 (Why is no real title available?)
- scientific article; zbMATH DE number 49698 (Why is no real title available?)
- scientific article; zbMATH DE number 1953186 (Why is no real title available?)
- scientific article; zbMATH DE number 2066995 (Why is no real title available?)
- scientific article; zbMATH DE number 2107836 (Why is no real title available?)
- scientific article; zbMATH DE number 3228674 (Why is no real title available?)
- scientific article; zbMATH DE number 3099866 (Why is no real title available?)
- A combinatorial algorithm minimizing submodular functions in strongly polynomial time.
- A faster strongly polynomial time algorithm for submodular function minimization
- Active set algorithms for isotonic regression; a unifying framework
- An Inequality for Rearrangements
- An analysis of approximations for maximizing submodular set functions—I
- Approximate Primal Solutions and Rate Analysis for Dual Subgradient Methods
- Classes of orderings of measures and related correlation inequalities. I. Multivariate totally positive distributions
- Combinatorial optimization. Polyhedra and efficiency (3 volumes)
- Convex analysis and nonlinear optimization. Theory and examples.
- Convex optimization in infinite dimensional spaces
- Duality between subgradient and conditional gradient methods
- Exact solutions of some nonconvex quadratic optimization problems via SDP and SOCP relaxa\-tions
- Finding the nearest point in A polytope
- Global solutions of variational models with convex regularization
- Iterative hard thresholding for compressed sensing
- Learning with submodular functions: a convex optimization perspective
- Machine learning. A probabilistic perspective
- Maximizing Non-monotone Submodular Functions
- Minimizing a Submodular Function on a Lattice
- Monotone Comparative Statics
- Nondifferentiable optimization and polynomial problems
- Notes on L-/M-convex functions and the separation theorems
- On total variation minimization and surface evolution using parametric maximum flows
- Optimal Transport
- Optimal approximation for the submodular welfare problem in the value oracle model
- Optimal transport for applied mathematicians. Calculus of variations, PDEs, and modeling
- Submodular functions and optimization.
- Submodular spectral functions of principal submatrices of a Hermitian matrix, extensions and applications
- The smooth-Lasso and other \(\ell _{1}+\ell _{2}\)-penalized methods
- Theory of capacities
- Two algorithms for maximizing a separable concave function over a polymatroid feasible region
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
Cited in
(22)- Robust submodular minimization with applications to cooperative modeling
- Stochastic block-coordinate gradient projection algorithms for submodular maximization
- Dependence in elliptical partial correlation graphs
- Near-optimal Approximate Discrete and Continuous Submodular Function Minimization
- Distributionally Robust Linear and Discrete Optimization with Marginals
- Non-convex isotonic regression via the Myersonian approach
- Robust budget allocation via continuous submodular functions
- \(2 \times 2\)-convexifications for convex quadratic optimization with indicator variables
- Stochastic conditional gradient++: (Non)convex minimization and continuous submodular maximization
- An optimization problem for continuous submodular functions
- The boundaries of submodular functions
- Learning with submodular functions: a convex optimization perspective
- Equilibrium of individual concern-critical influence maximization in virtual and real blending network
- The equivalence of optimal perspective formulation and Shor's SDP for quadratic programs with indicator variables
- Supermodularity and valid inequalities for quadratic optimization with indicators
- Stochastic Variance Reduction for DR-Submodular Maximization
- A 1/2-approximation algorithm for maximizing a non-monotone weak-submodular function on a bounded integer lattice
- Lifting the convex conjugate in Lagrangian relaxations: a tractable approach for continuous Markov random fields
- Linear-step solvability of some folded concave and singly-parametric sparse optimization problems
- A survey on double greedy algorithms for maximizing non-monotone submodular functions
- The Frank-Wolfe algorithm: a short introduction
- On the convex hull of convex quadratic optimization problems with indicators
This page was built for publication: Submodular functions: from discrete to continuous domains
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2414912)