Sharp Bounds for the Number of Regions of Maxout Networks and Vertices of Minkowski Sums

DOI10.1137/21M1413699MaRDI QIDQ5886829

No author found.

Publication date: 11 April 2023

Published in: SIAM Journal on Applied Algebra and Geometry (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/2104.08135

zbMATH Keywords

Newton polytopehyperplane arrangementlinear regions of neural networkstropical hypersurface arrangementupper bound theorem for Minkowski sums

Mathematics Subject Classification ID

Artificial neural networks and deep learning (68T07) Combinatorial properties of polytopes and polyhedra (number of faces, shortest paths, etc.) (52B05) Combinatorial aspects of tropical varieties (14T15) Combinatorics of partially ordered sets (06A07)

Related Items

Getting away with more network pruning: from sparsity to geometry and linear regions ⋮ Towards Lower Bounds on the Depth of ReLU Neural Networks ⋮ On the number of regions of piecewise linear neural networks

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• The maximum number of faces of the Minkowski sum of two convex polytopes
• Maximal f-vectors of Minkowski sums of large numbers of polytopes
• Relative Stanley-Reisner theory and upper bound theorems for Minkowski sums
• On the power of small-depth threshold circuits
• A combinatorial analysis of topological dissections
• Asymptotic mean values of Gaussian polytopes
• Error bounds for approximations with deep ReLU networks
• Tropical hyperplane arrangements and oriented matroids
• The degree of a tropical basis
• On the Interpretation of Whitney Numbers Through Arrangements of Hyperplanes, Zonotopes, Non-Radon Partitions, and Orientations of Graphs
• Tropical Linear Spaces
• Facing up to arrangements: face-count formulas for partitions of space by hyperplanes
• Lectures on Polytopes
• General Constructive Representations for Continuous Piecewise-Linear Functions
• Minkowski Addition of Polytopes: Computational Complexity and Applications to Gröbner Bases
• Essentials of Tropical Combinatorics
• The maximum number of faces of the minkowski sum of three convex polytopes
• A Framework for the Construction of Upper Bounds on the Number of Affine Linear Regions of ReLU Feed-Forward Neural Networks
• Convex Analysis
• [https://portal.mardi4nfdi.de/wiki/Publication:5731810 On the foundations of combinatorial theory I. Theory of M�bius Functions]
• Partition of Space