A Markov chain approximation of switched Fokker-Planck equations for a model of on-off intermittency in the postural control during quiet standing

DOI10.1016/J.CNSNS.2023.107488MaRDI QIDQ6058747zbMATH OpenFDO

Authors Yasuyuki Suzuki, Keigo Togame, Akihiro Nakamura, Taishin Nomura

Publication date 1 November 2023

Published in Communications in Nonlinear Science and Numerical Simulation (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/2109.02427

zbMATH Keywords

finite element analysisFokker-Planck equationMarkov chain approximationstochastic hybrid dynamical system

Mathematics Subject Classification ID

Ordinary differential equations and systems with randomness (34F05) Methods of ordinary differential equations applied to PDEs (35A24) Fokker-Planck equations (35Q84) PDEs on time scales (35R07) Integro-partial differential equations (35R09) PDEs with randomness, stochastic partial differential equations (35R60) Strange attractors, chaotic dynamics of systems with hyperbolic behavior (37D45) Computational methods in Markov chains (60J22) Monte Carlo methods (65C05) Numerical analysis or methods applied to Markov chains (65C40) Finite element, Rayleigh-Ritz and Galerkin methods for initial value and initial-boundary value problems involving PDEs (65M60) Control of mechanical systems (70Q05) Biomechanics (92C10) Feedback control (93B52)

Abstract: The intermittent on-off switching of feedback control is considered as a major mechanism of postural stabilization during human quiet standing, which can be modeled by switched-type hybrid stochastic delay differential equations with unstable subsystems. Dynamics of the model can also be described by the corresponding switched-type Fokker-Planck (FP) equations. Here, we develop a comprehensive numerical recipe to simulate switched-type FP equations in the case that the probability current is conserved at the switching boundary, as is the case for noise-free models exhibiting C^0-continuity for solutions at the boundary, but in a way extendable to cases with discontinuous jump. Specifically, the FP equations are approximated by a finite state Markov chain model using the finite element method. Then, dynamics of the Markov chain model, including time evolution of probability density function (PDF), stationary PDF, and power spectrum of postural sway are analyzed. We further investigate how the stationary PDF alters as values of important parameters of the model change. Dynamics of the Markov chain model are compared with Monte Carlo-based dynamics of the model, by which the developed numerical recipe is validated. The obtained Markov chain model forms a basis of our future investigations of the intermittent postural control as a Markov decision process.

Review text

In this paper, a comprehensive numerical recipe is developed to represent and simulate switched-type hybrid Fokker-Planck (FP) equations, which govern time evolutions of probability density functions (PDFs) of two stochastic ordinary differential equations (S-ODEs) that are switched with each other, as finite Markov chain models. The discretization is performed by using the finite element method (FEM), and then stochastic switching dynamics of the intermittent control model, including time evolutions of PDFs, stationary PDFs, and power spectral density functions (PSD). are analyzed in detail using the Markov chain approximation of the hybrid FP equations. The major achievement of this study is formulation of the Markov chain approximation of switched-type hybrid S-ODEs, and for solving stationary PDFs of the switched-type hybrid S-ODEs.

Recommendations

• Numerical solutions of stochastic control problems: Markov chain approximation methods
• Numerical method for stationary distribution of stochastic differential equations with Markovian switching
• Complexity and dynamics of switched human balance control during quiet standing
• Stationary distributions of Euler–Maruyama-type stochastic difference equations with Markovian switching and their convergence
• Stationary in distributions of numerical solutions for stochastic partial differential equations with Markovian switching

Cites work

• Balancing with reflex delay.
• Controlling chaos
• Long term correlation and inhomogeneity of the inverted pendulum sway time-series under the intermittent control paradigm
• Modeling human postural sway using an intermittent control and hemodynamic perturbations

Cited in

(2)

• How the brain can be trained to achieve an intermittent control strategy for stabilizing quiet stance by means of reinforcement learning
• Estimating continuous and intermittent feedback models of postural control using the least squares method

This page was built for publication: A Markov chain approximation of switched Fokker-Planck equations for a model of on-off intermittency in the postural control during quiet standing

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6058747)