Analyzing dynamic decision-making models using Chapman-Kolmogorov equations
From MaRDI portal
Publication:2281019
Abstract: Decision-making in dynamic environments typically requires adaptive evidence accumulation that weights new evidence more heavily than old observations. Recent experimental studies of dynamic decision tasks require subjects to make decisions for which the correct choice switches stochastically throughout a single trial. In such cases, an ideal observer's belief is described by an evolution equation that is doubly stochastic, reflecting stochasticity in the both observations and environmental changes. In these contexts, we show that the probability density of the belief can be represented using differential Chapman-Kolmogorov equations, allowing efficient computation of ensemble statistics. This allows us to reliably compare normative models to near-normative approximations using, as model performance metrics, decision response accuracy and Kullback-Leibler divergence of the belief distributions. Such belief distributions could be obtained empirically from subjects by asking them to report their decision confidence. We also study how response accuracy is affected by additional internal noise, showing optimality requires longer integration timescales as more noise is added. Lastly, we demonstrate that our method can be applied to tasks in which evidence arrives in a discrete, pulsatile fashion, rather than continuously.
Recommendations
- Stochastic models of evidence accumulation in changing environments
- Evidence accumulation and change rate inference in dynamic environments
- Optimizing sequential decisions in the drift-diffusion model
- Dynamical Analysis of Bayesian Inference Models for the Eriksen Task
- Closed-form approximations of first-passage distributions for a stochastic decision-making model
Cites work
- A general nonstationary diffusion model for two-choice decision-making
- Bayesian online learning of the hazard rate in change-point problems
- Evidence accumulation and change rate inference in dynamic environments
- From Poisson shot noise to the integrated Ornstein-Uhlenbeck process: neurally principled models of information accumulation in decision-making and response time
- Fundamental derivations form decision field theory
- Handbook of stochastic methods for physics, chemistry and the natural sciences.
- scientific article; zbMATH DE number 765034 (Why is no real title available?)
- scientific article; zbMATH DE number 5207903 (Why is no real title available?)
- Integrate-and-fire neurons driven by asymmetric dichotomous noise
- Integrate-and-Fire Neurons Driven by Correlated Stochastic Input
- Noise-induced transitions. Theory and applications in physics, chemistry, and biology
- Stochastic models of evidence accumulation in changing environments
- The Diffusion Decision Model: Theory and Data for Two-Choice Decision Tasks
- The elements of statistical learning. Data mining, inference, and prediction
- The Frequency Distribution of the Difference Between Two Poisson Variates Belonging to Different Populations
Cited in
(5)- Statistical modeling and inferences on dynamic decision-making mechanism underlying longitudinal distribution data with resource heterogeneity
- Stochastic models of evidence accumulation in changing environments
- scientific article; zbMATH DE number 5702710 (Why is no real title available?)
- Evidence accumulation and change rate inference in dynamic environments
- Dynamic noise estimation: a generalized method for modeling noise fluctuations in decision-making
This page was built for publication: Analyzing dynamic decision-making models using Chapman-Kolmogorov equations
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2281019)
