A Markov chain approximation of switched Fokker-Planck equations for a model of on-off intermittency in the postural control during quiet standing

DOI10.1016/J.CNSNS.2023.107488zbMATH Open1529.65086arXiv2109.02427MaRDI QIDQ6058747FDOQ6058747

Authors: Yasuyuki Suzuki, Keigo Togame, Akihiro Nakamura, Taishin Nomura 

Publication date: 1 November 2023

Published in: Communications in Nonlinear Science and Numerical Simulation (Search for Journal in Brave)

Abstract: The intermittent on-off switching of feedback control is considered as a major mechanism of postural stabilization during human quiet standing, which can be modeled by switched-type hybrid stochastic delay differential equations with unstable subsystems. Dynamics of the model can also be described by the corresponding switched-type Fokker-Planck (FP) equations. Here, we develop a comprehensive numerical recipe to simulate switched-type FP equations in the case that the probability current is conserved at the switching boundary, as is the case for noise-free models exhibiting C^0-continuity for solutions at the boundary, but in a way extendable to cases with discontinuous jump. Specifically, the FP equations are approximated by a finite state Markov chain model using the finite element method. Then, dynamics of the Markov chain model, including time evolution of probability density function (PDF), stationary PDF, and power spectrum of postural sway are analyzed. We further investigate how the stationary PDF alters as values of important parameters of the model change. Dynamics of the Markov chain model are compared with Monte Carlo-based dynamics of the model, by which the developed numerical recipe is validated. The obtained Markov chain model forms a basis of our future investigations of the intermittent postural control as a Markov decision process.

Full work available at URL: https://arxiv.org/abs/2109.02427

Recommendations

• Numerical solutions of stochastic control problems: Markov chain approximation methods
• Numerical method for stationary distribution of stochastic differential equations with Markovian switching
• Complexity and dynamics of switched human balance control during quiet standing
• Stationary distributions of Euler–Maruyama-type stochastic difference equations with Markovian switching and their convergence
• Stationary in distributions of numerical solutions for stochastic partial differential equations with Markovian switching

zbMATH Keywords

Fokker-Planck equationfinite element analysisMarkov chain approximationstochastic hybrid dynamical system

Mathematics Subject Classification ID

Computational methods in Markov chains (60J22) Monte Carlo methods (65C05) Numerical analysis or methods applied to Markov chains (65C40) Strange attractors, chaotic dynamics of systems with hyperbolic behavior (37D45) Ordinary differential equations and systems with randomness (34F05) Fokker-Planck equations (35Q84) Integro-partial differential equations (35R09) PDEs with randomness, stochastic partial differential equations (35R60) Finite element, Rayleigh-Ritz and Galerkin methods for initial value and initial-boundary value problems involving PDEs (65M60) Control of mechanical systems (70Q05) Biomechanics (92C10) Feedback control (93B52) Methods of ordinary differential equations applied to PDEs (35A24) PDEs on time scales (35R07)

Cites Work

• Controlling chaos
• Balancing with reflex delay.
• Modeling human postural sway using an intermittent control and hemodynamic perturbations
• Long term correlation and inhomogeneity of the inverted pendulum sway time-series under the intermittent control paradigm

Cited In (1)

• How the brain can be trained to achieve an intermittent control strategy for stabilizing quiet stance by means of reinforcement learning

This page was built for publication: A Markov chain approximation of switched Fokker-Planck equations for a model of on-off intermittency in the postural control during quiet standing

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6058747)