Mathematical derivation of wave propagation properties in hierarchical neural networks with predictive coding feedback dynamics

DOI10.1007/S11538-023-01186-9zbMATH Open1522.92004arXiv2304.05676OpenAlexW4385330501MaRDI QIDQ6049005FDOQ6049005

Authors: Grégory Faye, Guilhem Fouilhé, Rufin Van Rullen 

Publication date: 15 September 2023

Published in: Bulletin of Mathematical Biology (Search for Journal in Brave)

Abstract: Sensory perception (e.g. vision) relies on a hierarchy of cortical areas, in which neural activity propagates in both directions, to convey information not only about sensory inputs but also about cognitive states, expectations and predictions. At the macroscopic scale, neurophysiological experiments have described the corresponding neural signals as both forward and backward-travelling waves, sometimes with characteristic oscillatory signatures. It remains unclear, however, how such activity patterns relate to specific functional properties of the perceptual apparatus. Here, we present a mathematical framework, inspired by neural network models of predictive coding, to systematically investigate neural dynamics in a hierarchical perceptual system. We show that stability of the system can be systematically derived from the values of hyper-parameters controlling the different signals (related to bottom-up inputs, top-down prediction and error correction). Similarly, it is possible to determine in which direction, and at what speed neural activity propagates in the system. Different neural assemblies (reflecting distinct eigenvectors of the connectivity matrices) can simultaneously and independently display different properties in terms of stability, propagation speed or direction. We also derive continuous-limit versions of the system, both in time and in neural space. Finally, we analyze the possible influence of transmission delays between layers, and reveal the emergence of oscillations at biologically plausible frequencies.

Full work available at URL: https://arxiv.org/abs/2304.05676

Recommendations

• Investigation of input-output gain in dynamical systems for neural information processing
• Waves in neural media. From single neurons to neural fields
• Traveling Waves of Excitation in Neural Field Models: Equivalence of Rate Descriptions and Integrate-and-Fire Dynamics
• Binocular rivalry waves in a directionally selective neural field model
• Theory of cortical function

zbMATH Keywords

wave propagationpredictive codinghierarchical neural networks

Mathematics Subject Classification ID

Neural networks for/in biological studies, artificial life and related topics (92B20)

Cites Work

• Convolution powers of complex functions on \(\mathbb Z\)
• Title not available (Why is that?)
• Convenient Stability Criteria for Difference Approximations of Hyperbolic Initial-Boundary Value Problems
• Stability of difference schemes in the maximum-norm
• On the convolution powers of complex functions on \(\mathbb{Z}\)
• Convenient Stability Criteria for Difference Approximations of Hyperbolic Initial-Boundary Value Problems. II
• Generalized Gaussian bounds for discrete convolution powers
• Sharp stability for finite difference approximations of hyperbolic equations with boundary conditions
• Theory of cortical function
• Predictive coding approximates backprop along arbitrary computation graphs

Cited In (4)

• The effect of signaling latencies and node refractory states on the dynamics of networks
• Predictive coding models for pain perception
• Propagation of excitation in neural network models
• Investigation of input-output gain in dynamical systems for neural information processing

This page was built for publication: Mathematical derivation of wave propagation properties in hierarchical neural networks with predictive coding feedback dynamics

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6049005)