VC dimensions of group convolutional neural networks

DOI10.1016/J.NEUNET.2023.10.012MaRDI QIDQ6148443zbMATH OpenOpenAlexFDO

Authors Philipp Petersen, Anna Sepliarskaia

Publication date 11 January 2024

Published in Neural Networks (Search for Journal in Brave)

Copyright license Creative Commons Attribution 4.0 International

Full work available at URL https://arxiv.org/abs/2212.09507

zbMATH Keywords

VC dimensionconvolutional neural networksgeneralizationsample complexitygroup convolutional neural networks

Mathematics Subject Classification ID

Artificial neural networks and deep learning (68T07)

Abstract: We study the generalization capacity of group convolutional neural networks. We identify precise estimates for the VC dimensions of simple sets of group convolutional neural networks. In particular, we find that for infinite groups and appropriately chosen convolutional kernels, already two-parameter families of convolutional neural networks have an infinite VC dimension, despite being invariant to the action of an infinite group.

Recommendations

• Group invariance, stability to deformations, and complexity of deep convolutional representations
• Neural networks with quadratic VC dimension
• scientific article; zbMATH DE number 7064043
• Neural Nets with Superlinear VC-Dimension
• Universality of deep convolutional neural networks

Cites work

• An Elementary Proof of the Wallis Product Formula for pi
• Deep learning
• Foundations of machine learning
• Lie groups. An approach through invariants and representations
• Neural Network Learning
• Understanding machine learning. From theory to algorithms

Cited in

(2)

• Locality defeats the curse of dimensionality in convolutional teacher–student scenarios*
• Mittag-Leffler stability and synchronization of multi-delayed fractional neural networks via Halanay inequality

This page was built for publication: VC dimensions of group convolutional neural networks

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6148443)