Implementing a Bayes filter in a neural circuit: the case of unknown stimulus dynamics
From MaRDI portal
Publication:5382483
Abstract: In order to interact intelligently with objects in the world, animals must first transform neural population responses into estimates of the dynamic, unknown stimuli which caused them. The Bayesian solution to this problem is known as a Bayes filter, which applies Bayes' rule to combine population responses with the predictions of an internal model. In this paper we present a method for learning to approximate a Bayes filter when the stimulus dynamics are unknown. To do this we use the inferential properties of probabilistic population codes to compute Bayes' rule, and train a neural network to compute approximate predictions by the method of maximum likelihood. In particular, we perform stochastic gradient descent on the negative log-likelihood with a novel approximation of the gradient. We demonstrate our methods on a finite-state, a linear, and a nonlinear filtering problem, and show how the hidden layer of the neural network develops tuning curves which are consistent with findings in experimental neuroscience.
Recommendations
- Bayesian Filtering in Spiking Neural Networks: Noise, Adaptation, and Multisensory Integration
- Bayesian Computation in Recurrent Neural Circuits
- Exact Inferences in a Neural Implementation of a Hidden Markov Model
- Bayesian inference and online learning in Poisson neuronal networks
- Bayesian Population Decoding of Motor Cortical Activity Using a Kalman Filter
Cites work
- Bayesian filtering and smoothing
- Compatible Conditional Distributions
- Conditionally specified distributions: An introduction. (With comments and a rejoinder).
- Exact Inferences in a Neural Implementation of a Hidden Markov Model
- Forward models for physiological motor control
- Graphical models, exponential families, and variational inference
- scientific article; zbMATH DE number 5284813 (Why is no real title available?)
- scientific article; zbMATH DE number 3513115 (Why is no real title available?)
- scientific article; zbMATH DE number 597902 (Why is no real title available?)
- scientific article; zbMATH DE number 1983334 (Why is no real title available?)
- scientific article; zbMATH DE number 2238781 (Why is no real title available?)
- Justifying and Generalizing Contrastive Divergence
- Learning deep architectures for AI
- Learning representations by back-propagating errors
- Probability Theory
- Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images
- Training Products of Experts by Minimizing Contrastive Divergence
Cited in
(5)- Bayesian Filtering in Spiking Neural Networks: Noise, Adaptation, and Multisensory Integration
- Efficient Bayesian Tracking of Multiple Sources of Neural Activity: Algorithms and Real-Time FPGA Implementation
- Identificación de las respuestas de redes neuronales cerebrales y artificiales ante la presencia de estímulos frecuentes e infrecuentes mediante filtros de tipo Kalman
- Bayesian filtering with multiple internal models: toward a theory of social intelligence
- Exact Inferences in a Neural Implementation of a Hidden Markov Model
This page was built for publication: Implementing a Bayes filter in a neural circuit: the case of unknown stimulus dynamics
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5382483)
