The Structure of Conservative Gradient Fields

DOI10.1137/21M1393637zbMath1471.49013arXiv2101.00699MaRDI QIDQ5010051

Adrian S. Lewis, Tonghua Tian

Publication date: 24 August 2021

Published in: SIAM Journal on Optimization (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/2101.00699

zbMATH Keywords

stratification; automatic differentiation; Clarke subdifferential; variational analysis; deep learning; semialgebraic; conservative field; subgradient descent

Mathematics Subject Classification ID

68T07: Artificial neural networks and deep learning

90C56: Derivative-free methods and methods using generalized derivatives

65K10: Numerical optimization and variational techniques

49J40: Variational inequalities

49J52: Nonsmooth analysis

14P10: Semialgebraic sets and related spaces

Uses Software

• TensorFlow
• PyTorch