Continuous-time Markov chains and applications. A two-time-scale approach (Q424648): Difference between revisions
From MaRDI portal
Created a new Item |
Set profile property. |
||
(4 intermediate revisions by 3 users not shown) | |||
Property / author | |||
Property / author: G. George Yin / rank | |||
Property / author | |||
Property / author: Qing Zhang / rank | |||
Property / review text | |||
This book is the expanded second edition of ``Continuous-time Markov chains and applications. A singular perturbation approach.'' which appeared 1998. The main structure has been maintained; in two occasions, two former chapters have been merged, and two new chapters have been added, hence the excellent review of the first edition remains essentially valid (see [Zbl 0896.60039]). A first part starts after an introduction and a an exhaustive overview over the text followed by a chapter on background and introductory material. It closes in Chapter 3 with many motivating applications of continuous time Markov chains (cMC). The second part kicks of with a chapter on the asymptotic expansion of the forward Kolmogorov equations of singularly perturbed cMC in different settings. Chapter 5 merges two formerly separate chapters on occupation measures and ramifications. A short new Chapter 6 on asymptotic expansions for backward (Kolmogorov) equations on finite states via dual formulations of the forward case. The third part is dedicated to Markov decision problems, the stochastic control of (finite-dimensional) dynamical systems, numerical methods for control and optimization. Chapter 10 is new and gives a convergence result for the HJB equations of the asymptotic optimal control of linear quadratic Gaussian systems. The book remains clearly of interest to researchers in stochastic control, operation research, manufacturing system, engineering, economics and applied mathematics. | |||
Property / review text: This book is the expanded second edition of ``Continuous-time Markov chains and applications. A singular perturbation approach.'' which appeared 1998. The main structure has been maintained; in two occasions, two former chapters have been merged, and two new chapters have been added, hence the excellent review of the first edition remains essentially valid (see [Zbl 0896.60039]). A first part starts after an introduction and a an exhaustive overview over the text followed by a chapter on background and introductory material. It closes in Chapter 3 with many motivating applications of continuous time Markov chains (cMC). The second part kicks of with a chapter on the asymptotic expansion of the forward Kolmogorov equations of singularly perturbed cMC in different settings. Chapter 5 merges two formerly separate chapters on occupation measures and ramifications. A short new Chapter 6 on asymptotic expansions for backward (Kolmogorov) equations on finite states via dual formulations of the forward case. The third part is dedicated to Markov decision problems, the stochastic control of (finite-dimensional) dynamical systems, numerical methods for control and optimization. Chapter 10 is new and gives a convergence result for the HJB equations of the asymptotic optimal control of linear quadratic Gaussian systems. The book remains clearly of interest to researchers in stochastic control, operation research, manufacturing system, engineering, economics and applied mathematics. / rank | |||
Normal rank | |||
Property / Mathematics Subject Classification ID | |||
Property / Mathematics Subject Classification ID: 60J27 / rank | |||
Normal rank | |||
Property / Mathematics Subject Classification ID | |||
Property / Mathematics Subject Classification ID: 60J25 / rank | |||
Normal rank | |||
Property / Mathematics Subject Classification ID | |||
Property / Mathematics Subject Classification ID: 60J28 / rank | |||
Normal rank | |||
Property / Mathematics Subject Classification ID | |||
Property / Mathematics Subject Classification ID: 60J35 / rank | |||
Normal rank | |||
Property / Mathematics Subject Classification ID | |||
Property / Mathematics Subject Classification ID: 60-02 / rank | |||
Normal rank | |||
Property / zbMATH DE Number | |||
Property / zbMATH DE Number: 6042623 / rank | |||
Normal rank | |||
Property / zbMATH Keywords | |||
singularly perturbed continuous time Markov chains | |||
Property / zbMATH Keywords: singularly perturbed continuous time Markov chains / rank | |||
Normal rank | |||
Property / zbMATH Keywords | |||
Markovian switching | |||
Property / zbMATH Keywords: Markovian switching / rank | |||
Normal rank | |||
Property / zbMATH Keywords | |||
asymptotic expansions | |||
Property / zbMATH Keywords: asymptotic expansions / rank | |||
Normal rank | |||
Property / zbMATH Keywords | |||
time-scale separation | |||
Property / zbMATH Keywords: time-scale separation / rank | |||
Normal rank | |||
Property / author | |||
Property / author: G. George Yin / rank | |||
Normal rank | |||
Property / author | |||
Property / author: Qing Zhang / rank | |||
Normal rank | |||
Property / reviewed by | |||
Property / reviewed by: Michael A. Högele / rank | |||
Normal rank | |||
Property / MaRDI profile type | |||
Property / MaRDI profile type: MaRDI publication profile / rank | |||
Normal rank | |||
links / mardi / name | links / mardi / name | ||
Latest revision as of 01:13, 5 March 2024
scientific article
Language | Label | Description | Also known as |
---|---|---|---|
English | Continuous-time Markov chains and applications. A two-time-scale approach |
scientific article |
Statements
Continuous-time Markov chains and applications. A two-time-scale approach (English)
0 references
4 June 2012
0 references
This book is the expanded second edition of ``Continuous-time Markov chains and applications. A singular perturbation approach.'' which appeared 1998. The main structure has been maintained; in two occasions, two former chapters have been merged, and two new chapters have been added, hence the excellent review of the first edition remains essentially valid (see [Zbl 0896.60039]). A first part starts after an introduction and a an exhaustive overview over the text followed by a chapter on background and introductory material. It closes in Chapter 3 with many motivating applications of continuous time Markov chains (cMC). The second part kicks of with a chapter on the asymptotic expansion of the forward Kolmogorov equations of singularly perturbed cMC in different settings. Chapter 5 merges two formerly separate chapters on occupation measures and ramifications. A short new Chapter 6 on asymptotic expansions for backward (Kolmogorov) equations on finite states via dual formulations of the forward case. The third part is dedicated to Markov decision problems, the stochastic control of (finite-dimensional) dynamical systems, numerical methods for control and optimization. Chapter 10 is new and gives a convergence result for the HJB equations of the asymptotic optimal control of linear quadratic Gaussian systems. The book remains clearly of interest to researchers in stochastic control, operation research, manufacturing system, engineering, economics and applied mathematics.
0 references
singularly perturbed continuous time Markov chains
0 references
Markovian switching
0 references
asymptotic expansions
0 references
time-scale separation
0 references