Entropy Bifurcation of Neural Networks on Cayley Trees

DOI10.1142/S0218127420500157MaRDI QIDQ5220448zbMATH OpenOpenAlexFDO

Authors Jung-Chao Ban, Chih-Hung Chang, Nai-Zhu Huang

Publication date 23 March 2020

Published in International Journal of Bifurcation and Chaos in Applied Sciences and Engineering (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1706.09283

zbMATH Keywords

neural networksminimal entropyCayley treeentropy spectrumseparation propertylearning problem

Mathematics Subject Classification ID

Trees (05C05) Neural networks for/in biological studies, artificial life and related topics (92B20) Entropy and other invariants, isomorphism, classification in ergodic theory (37A35) Symbolic dynamics (37B10)

Abstract: It has been demonstrated that excitable media with a tree structure performed better than other network topologies, it is natural to consider neural networks defined on Cayley trees. The investigation of a symbolic space called tree-shift of finite type is important when it comes to the discussion of the equilibrium solutions of neural networks on Cayley trees. Entropy is a frequently used invariant for measuring the complexity of a system, and constant entropy for an open set of coupling weights between neurons means that the specific network is stable. This paper gives a complete characterization for entropy spectrum of neural networks on Cayley trees and reveals whether the entropy bifurcates when the coupling weights change.

Recommendations

• THE ENTROPY OF STATIONARY SOLUTIONS' MAP OF CELLULAR NEURAL NETWORKS
• ON THE MONOTONICITY OF ENTROPY FOR MULTILAYER CELLULAR NEURAL NETWORKS
• ON THE DENSE ENTROPY OF TWO-DIMENSIONAL INHOMOGENEOUS CELLULAR NEURAL NETWORKS
• Complexity of neural networks on Fibonacci-Cayley tree
• Route to chaos in a branching model of neural network dynamics
• Horseshoe and topological entropy estimate of a class of three-dimensional cellular neural networks
• Entropy landscape of solutions in the binary perceptron problem

Cites work

• A characterization of the entropies of multidimensional shifts of finite type
• A description of harmonic functions via properties of the group representation of the Cayley tree.
• An Introduction to Symbolic Dynamics and Coding
• Approximating entropy for a class of \(\mathbb Z^2\) Markov random fields and pressure for a class of functions on \(\mathbb Z^2\) shifts of finite type
• CELLULAR NEURAL NETWORKS: LOCAL PATTERNS FOR GENERAL TEMPLATES
• Cellular neural networks: theory
• Chaos
• Computing bounds for entropy of stationary \(\mathbb{Z}^d\) Markov random fields
• Deep learning
• Devaney's chaos or 2-scattering implies Li-Yorke's chaos
• Entropy gaps and locally maximal entropy in $\mathbb{Z}^d$ subshifts
• Ergodic theory and dynamical systems. Translated from the French by Reinie Erné
• Gibbs measures on Cayley trees
• Learning deep architectures for AI
• Mixing properties of tree-shifts
• Multidimensional sofic shifts without separation and their factors
• Neural networks and physical systems with emergent collective computational abilities
• On Li-Yorke pairs
• Realization problem of multi-layer cellular neural networks
• Sofic tree-shifts
• Spatial complexity in multi-layer cellular neural networks
• Tree-shifts of finite type
• Tree-shifts: Irreducibility, mixing, and the chaos of tree-shifts
• Tree-shifts: the entropy of tree-shifts of finite type

Cited in

(4)

• ON THE MONOTONICITY OF ENTROPY FOR MULTILAYER CELLULAR NEURAL NETWORKS
• Horseshoe and topological entropy estimate of a class of three-dimensional cellular neural networks
• Complexity of neural networks on Fibonacci-Cayley tree
• Tree-structured neural networks: spatiotemporal dynamics and optimal control

Describes a project that uses

Uses Software

• Fuzzy ARTMAP

This page was built for publication: Entropy Bifurcation of Neural Networks on Cayley Trees

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5220448)