Mathematical derivation of wave propagation properties in hierarchical neural networks with predictive coding feedback dynamics

DOI10.1007/S11538-023-01186-9MaRDI QIDQ6049005zbMATH OpenOpenAlexFDO

Authors Grégory Faye, Guilhem Fouilhé, Rufin Van Rullen

Publication date 15 September 2023

Published in Bulletin of Mathematical Biology (Search for Journal in Brave)

Copyright license Creative Commons Attribution 4.0 International

Full work available at URL https://arxiv.org/abs/2304.05676

zbMATH Keywords

wave propagationpredictive codinghierarchical neural networks

Mathematics Subject Classification ID

Neural networks for/in biological studies, artificial life and related topics (92B20)

Abstract: Sensory perception (e.g. vision) relies on a hierarchy of cortical areas, in which neural activity propagates in both directions, to convey information not only about sensory inputs but also about cognitive states, expectations and predictions. At the macroscopic scale, neurophysiological experiments have described the corresponding neural signals as both forward and backward-travelling waves, sometimes with characteristic oscillatory signatures. It remains unclear, however, how such activity patterns relate to specific functional properties of the perceptual apparatus. Here, we present a mathematical framework, inspired by neural network models of predictive coding, to systematically investigate neural dynamics in a hierarchical perceptual system. We show that stability of the system can be systematically derived from the values of hyper-parameters controlling the different signals (related to bottom-up inputs, top-down prediction and error correction). Similarly, it is possible to determine in which direction, and at what speed neural activity propagates in the system. Different neural assemblies (reflecting distinct eigenvectors of the connectivity matrices) can simultaneously and independently display different properties in terms of stability, propagation speed or direction. We also derive continuous-limit versions of the system, both in time and in neural space. Finally, we analyze the possible influence of transmission delays between layers, and reveal the emergence of oscillations at biologically plausible frequencies.

Recommendations

• Investigation of input-output gain in dynamical systems for neural information processing
• Waves in neural media. From single neurons to neural fields
• Traveling Waves of Excitation in Neural Field Models: Equivalence of Rate Descriptions and Integrate-and-Fire Dynamics
• Binocular rivalry waves in a directionally selective neural field model
• Theory of cortical function

Cites work

• scientific article; zbMATH DE number 3116942 (Why is no real title available?)
• Convenient Stability Criteria for Difference Approximations of Hyperbolic Initial-Boundary Value Problems
• Convenient Stability Criteria for Difference Approximations of Hyperbolic Initial-Boundary Value Problems. II
• Convolution powers of complex functions on \(\mathbb Z\)
• Generalized Gaussian bounds for discrete convolution powers
• On the convolution powers of complex functions on \(\mathbb{Z}\)
• Predictive coding approximates backprop along arbitrary computation graphs
• Sharp stability for finite difference approximations of hyperbolic equations with boundary conditions
• Stability of difference schemes in the maximum-norm
• Theory of cortical function

Cited in

(4)

• The effect of signaling latencies and node refractory states on the dynamics of networks
• Predictive coding models for pain perception
• Propagation of excitation in neural network models
• Investigation of input-output gain in dynamical systems for neural information processing

This page was built for publication: Mathematical derivation of wave propagation properties in hierarchical neural networks with predictive coding feedback dynamics

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6049005)