Codimension-2 parameter space structure of continuous-time recurrent neural networks

DOI10.1007/S00422-022-00938-5zbMATH Open1495.92008arXiv2111.04547OpenAlexW4283156045MaRDI QIDQ2165380FDOQ2165380

Authors: Randall D. Beer 

Publication date: 19 August 2022

Published in: Biological Cybernetics (Search for Journal in Brave)

Abstract: If we are ever to move beyond the study of isolated special cases in theoretical neuroscience, we need to develop more general theories of neural circuits over a given neural model. The present paper considers this challenge in the context of continuous-time recurrent neural networks (CTRNNs), a simple but dynamically-universal model that has been widely utilized in both computational neuroscience and neural networks. Here we extend previous work on the parameter space structure of codimension-1 local bifurcations in CTRNNs to include codimension-2 local bifurcation manifolds. Specifically, we derive the necessary conditions for all generic local codimension-2 bifurcations for general CTRNNs, specialize these conditions to circuits containing from one to four neurons, illustrate in full detail the application of these conditions to example circuits, derive closed-form expressions for these bifurcation manifolds where possible, and demonstrate how this analysis allows us to find and trace several global codimension-1 bifurcation manifolds that originate from the codimension-2 bifurcations.

Full work available at URL: https://arxiv.org/abs/2111.04547

Recommendations

• Parameter Space Structure of Continuous-Time Recurrent Neural Networks
• Bifurcation analysis on a generalized recurrent neural network with two interconnected three-neuron components
• Continuous attractors of a class of recurrent neural networks
• Attractive periodic sets in discrete-time recurrent networks (with emphasis on fixed-point stability and bifurcations in two-neuron networks)
• POINCARÉ MAPPING OF CONTINUOUS RECURRENT NEURAL NETWORKS EXCITED BY TEMPORAL EXTERNAL INPUT

zbMATH Keywords

bifurcation theorycodimensionnonlinear dynamicsneural circuitscontinuous-time recurrent neural network

Mathematics Subject Classification ID

Neural networks for/in biological studies, artificial life and related topics (92B20) Bifurcation theory for random and stochastic dynamical systems (37H20)

Cites Work

• Nonlinear oscillations, dynamical systems, and bifurcations of vector fields
• Mathematical foundations of neuroscience
• Singularities of vector fields
• Neurons with graded response have collective computational properties like those of two-state neurons
• Elements of applied bifurcation theory
• Bifurcation analysis of a neural network model
• Weakly connected neural networks
• Title not available (Why is that?)
• Introduction to Applied Nonlinear Dynamical Systems and Chaos
• ``Neural computation of decisions in optimization problems
• Computing Hopf Bifurcations I
• Real-Time Computing Without Stable States: A New Framework for Neural Computation Based on Perturbations
• Title not available (Why is that?)
• Neural Networks for Combinatorial Optimization: A Review of More Than a Decade of Research
• Modeling of continuous time dynamical systems with input by recurrent neural networks
• Title not available (Why is that?)
• Parameter Space Structure of Continuous-Time Recurrent Neural Networks
• Complex dynamics and the structure of small neural networks
• Two neuron dynamics and adiabatic elimination
• Attractive periodic sets in discrete-time recurrent networks (with emphasis on fixed-point stability and bifurcations in two-neuron networks)
• A review of recurrent neural networks: LSTM cells and network architectures
• Mathematical equivalence of two common forms of firing rate models of neural networks
• Center-Crossing Recurrent Neural Networks for the Evolution of Rhythmic Behavior

Cited In (2)

• Continuous attractors of a class of recurrent neural networks
• Parameter Space Structure of Continuous-Time Recurrent Neural Networks

This page was built for publication: Codimension-2 parameter space structure of continuous-time recurrent neural networks

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2165380)