Neutral stability, rate propagation, and critical branching in feedforward networks

DOI10.1162/NECO_A_00461MaRDI QIDQ5378228zbMATH OpenOpenAlexWikidataFDO

Authors N. Alex Cayco-Gajic, Eric Shea-Brown

Publication date 12 June 2019

Published in Neural Computation (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1210.8406

zbMATH Keywords

feedforward neural networksneutral stabilitycritical branchingwide range of firing patterns

Mathematics Subject Classification ID

Neural networks for/in biological studies, artificial life and related topics (92B20)

Abstract: Recent experimental and computational evidence suggests that several dynamical properties may characterize the operating point of functioning neural networks: critical branching, neutral stability, and production of a wide range of firing patterns. We seek the simplest setting in which these properties emerge, clarifying their origin and relationship in random, feedforward networks of McCullochs-Pitts neurons. Two key parameters are the thresholds at which neurons fire spikes, and the overall level of feedforward connectivity. When neurons have low thresholds, we show that there is always a connectivity for which the properties in question all occur: that is, these networks preserve overall firing rates from layer to layer and produce broad distributions of activity in each layer. This fails to occur, however, when neurons have high thresholds. A key tool in explaining this difference is eigenstructure of the resulting mean-field Markov chain, as this reveals which activity modes will be preserved from layer to layer. We extend our analysis from purely excitatory networks to more complex models that include inhibition and 'local' noise, and find that both of these features extend the parameter ranges over which networks produce the properties of interest.

Recommendations

• The ground state of cortical feed-forward networks
• Dynamical properties of background neural networks with uniform firing rate and background input
• Rate and Synchrony in Feedforward Networks of Coincidence Detectors: Analytical Solution
• Stable Propagation of Activity Pulses in Populations of Spiking Neurons
• Complex evolution of spike patterns during burst propagation through feed-forward networks

Cites work

• scientific article; zbMATH DE number 2212009 (Why is no real title available?)
• A logical calculus of the ideas immanent in nervous activity
• Are biological systems poised at criticality?
• CuBIC: cumulant based inference of higher-order correlations in massively parallel spike trains
• Explaining synchrony in feed-forward networks: Are McCulloch-Pitts neurons good enough?
• Information Theory and Statistical Mechanics
• Nearly extensive sequential memory lifetime achieved by coupled nonlinear neurons
• Noise tolerance of attractor and feedforward memory models
• Real-Time Computation at the Edge of Chaos in Recurrent Neural Networks
• Stochastic resonance in neuron models
• Synchronous Firing and Higher-Order Interactions in Neuron Pool
• The ground state of cortical feed-forward networks
• The impact of high-order interactions on the rate of synchronous discharge and information transmission in somatosensory cortex

Cited in

(3)

• Intrinsic excitability state of local neuronal population modulates signal propagation in feed-forward neural networks
• The ground state of cortical feed-forward networks
• Feedforward architectures driven by inhibitory interactions

Describes a project that uses

Uses Software

• Eigtool

This page was built for publication: Neutral stability, rate propagation, and critical branching in feedforward networks

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5378228)