{"entities":{"Q4375487":{"pageid":6405086,"ns":120,"title":"Item:Q4375487","lastrevid":108319436,"modified":"2026-11-05T21:57:12Z","type":"item","id":"Q4375487","labels":{"en":{"language":"en","value":"Continuous-time Markov chains and applications. A singular perturbation approach"}},"descriptions":{"en":{"language":"en","value":"scientific article; zbMATH DE number 1113626"}},"aliases":{},"claims":{"P31":[{"mainsnak":{"snaktype":"value","property":"P31","hash":"fd5912e4dab4b881a8eb0eb27e7893fef55176ad","datavalue":{"value":{"entity-type":"item","numeric-id":56887,"id":"Q56887"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q4375487$8D3D85E5-2F8F-4F36-8728-E39650648961","rank":"normal"}],"P225":[{"mainsnak":{"snaktype":"value","property":"P225","hash":"e54ba0d45670d659a4b88e4ccb1cbe62f07e32d4","datavalue":{"value":"0896.60039","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q4375487$B6BC0967-3A46-43DF-B90A-54FFB60409AB","rank":"normal"}],"P28":[{"mainsnak":{"snaktype":"value","property":"P28","hash":"343aa374fccf16bdffc072d46517973eeef7ce41","datavalue":{"value":{"time":"+1998-02-05T00:00:00Z","timezone":0,"before":0,"after":0,"precision":11,"calendarmodel":"http://www.wikidata.org/entity/Q1985727"},"type":"time"},"datatype":"time"},"type":"statement","id":"Q4375487$F427C80C-955A-4980-AC55-CCF217BBD761","rank":"normal"}],"P226":[{"mainsnak":{"snaktype":"value","property":"P226","hash":"5324c54a5b1cbe1a80cf6fd5ed624d38a1676138","datavalue":{"value":"60J27","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q4375487$F500C1BB-1168-43C0-94F5-0326BC911106","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P226","hash":"b2e72cf7f0f0774458fb92f26798374a0d2df256","datavalue":{"value":"60-02","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q4375487$4E63D5CE-134F-4427-9DF5-A69BC430EF3C","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P226","hash":"e3bc6c7cda8279d6ad2b578e7a7e4967447c3cc4","datavalue":{"value":"93E20","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q4375487$4820BC17-7CB0-479C-8699-56B16861B8B2","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P226","hash":"83a94c21f789e058a8d583c524929f057579d6ea","datavalue":{"value":"34E05","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q4375487$EF4600B9-1F00-4402-98B4-E5C53B892FEF","rank":"normal"}],"P1451":[{"mainsnak":{"snaktype":"value","property":"P1451","hash":"10505d6598417335793c820a55060710830ac06f","datavalue":{"value":"1113626","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q4375487$F5176E35-D68E-4C27-B264-EE77EB09F4A3","rank":"normal"}],"P1450":[{"mainsnak":{"snaktype":"value","property":"P1450","hash":"d3982d8953519793fd0c504f10b659a42d3cb9a8","datavalue":{"value":"Markov process","type":"string"},"datatype":"string"},"type":"statement","id":"Q4375487$A64EB5CE-A7B4-4A63-9114-4BCA0F83C1A1","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1450","hash":"ba1f0068f5497654bb5d0e0ec4b40f12d4d645ab","datavalue":{"value":"generator","type":"string"},"datatype":"string"},"type":"statement","id":"Q4375487$87A49698-996C-45E9-AD02-BA0708011715","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1450","hash":"5e21afbdaf02af4c82a95d3cc9234147491d3dc8","datavalue":{"value":"forward Kolmogorov equation","type":"string"},"datatype":"string"},"type":"statement","id":"Q4375487$CA7ED5AE-CEA7-4A27-90D6-4FEFFE87EBCE","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1450","hash":"a56e5793ea33870a204239ad40fe7f02bf24fac2","datavalue":{"value":"expansion","type":"string"},"datatype":"string"},"type":"statement","id":"Q4375487$3DF30D8C-4800-4F60-BF38-AC2B68E74D98","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1450","hash":"d009c9f5384109efa1cf20c0e3ab70c821410da8","datavalue":{"value":"small parameter","type":"string"},"datatype":"string"},"type":"statement","id":"Q4375487$00A105DB-E4C7-438A-BD42-58F77F7FB375","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1450","hash":"1efe79184fcf0faee20198eea995bc13b6af7c72","datavalue":{"value":"Markov decision problem","type":"string"},"datatype":"string"},"type":"statement","id":"Q4375487$C5654457-D5B9-43B4-BE2E-CF035C9D94D3","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1450","hash":"4d56f07d90d87f9e983b5cd43df3d2e10c6a0d4b","datavalue":{"value":"complex system","type":"string"},"datatype":"string"},"type":"statement","id":"Q4375487$0457AB12-013C-4432-BEFF-8FEBB2A77880","rank":"normal"}],"P16":[{"mainsnak":{"snaktype":"value","property":"P16","hash":"729087847d073a4f1ae402dc8c91371bfffe3ac0","datavalue":{"value":{"entity-type":"item","numeric-id":326802,"id":"Q326802"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q4375487$FF7DC997-4D2D-41FA-8C6C-2ABFDAF68DD8","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P16","hash":"a08f57832c50c3ebd37b47f8b7599892b8038474","datavalue":{"value":{"entity-type":"item","numeric-id":256309,"id":"Q256309"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q4375487$B025FC2C-0D20-4B79-8278-757AB19F7B11","rank":"normal"}],"P1460":[{"mainsnak":{"snaktype":"value","property":"P1460","hash":"57f7fea50d2ce1b39b695c4a1313582eed405e38","datavalue":{"value":{"entity-type":"item","numeric-id":5976449,"id":"Q5976449"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q4375487$BA700E50-68CF-4CD3-B9D8-31D2762AC153","rank":"normal"}],"P1643":[{"mainsnak":{"snaktype":"value","property":"P1643","hash":"fdea72b56c35af8b1715446398e31e8f4113d946","datavalue":{"value":{"entity-type":"item","numeric-id":1189368,"id":"Q1189368"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","qualifiers":{"P1659":[{"snaktype":"value","property":"P1659","hash":"eab169274ec2eaf8579d4f1e963d5dba019548b1","datavalue":{"value":{"amount":"+0.94987637","unit":"1"},"type":"quantity"},"datatype":"quantity"}],"P1660":[{"snaktype":"value","property":"P1660","hash":"ac3c626774dcd0d16f89557f66586245841a01db","datavalue":{"value":{"entity-type":"item","numeric-id":6767936,"id":"Q6767936"},"type":"wikibase-entityid"},"datatype":"wikibase-item"}]},"qualifiers-order":["P1659","P1660"],"id":"Q4375487$0134AAAC-D0C0-478E-A265-4680EFE9DA80","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1643","hash":"d210580de956fe19ba5e63bf7f7f65c2d1a27434","datavalue":{"value":{"entity-type":"item","numeric-id":2467116,"id":"Q2467116"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","qualifiers":{"P1659":[{"snaktype":"value","property":"P1659","hash":"b69610fc89533ae82cb40faf8a0594beac19d29d","datavalue":{"value":{"amount":"+0.94883776","unit":"1"},"type":"quantity"},"datatype":"quantity"}],"P1660":[{"snaktype":"value","property":"P1660","hash":"ac3c626774dcd0d16f89557f66586245841a01db","datavalue":{"value":{"entity-type":"item","numeric-id":6767936,"id":"Q6767936"},"type":"wikibase-entityid"},"datatype":"wikibase-item"}]},"qualifiers-order":["P1659","P1660"],"id":"Q4375487$DDF4AE6D-34CE-4452-A05B-5FABF5F5CFB9","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1643","hash":"57dcd01d5c1d8ea522e6a2c754b15b840f85abc3","datavalue":{"value":{"entity-type":"item","numeric-id":4507316,"id":"Q4507316"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","qualifiers":{"P1659":[{"snaktype":"value","property":"P1659","hash":"80da18ad5df2f8c984a5f0ba027587d8b150649b","datavalue":{"value":{"amount":"+0.9391166","unit":"1"},"type":"quantity"},"datatype":"quantity"}],"P1660":[{"snaktype":"value","property":"P1660","hash":"ac3c626774dcd0d16f89557f66586245841a01db","datavalue":{"value":{"entity-type":"item","numeric-id":6767936,"id":"Q6767936"},"type":"wikibase-entityid"},"datatype":"wikibase-item"}]},"qualifiers-order":["P1659","P1660"],"id":"Q4375487$002EAA75-67A6-4D9E-9535-1FFF2A7E172E","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1643","hash":"bfc9993d10aa5869230ac5168f01988982caa649","datavalue":{"value":{"entity-type":"item","numeric-id":2407759,"id":"Q2407759"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","qualifiers":{"P1659":[{"snaktype":"value","property":"P1659","hash":"94cedd2f970eee69bf62bb6961e9a093f987b554","datavalue":{"value":{"amount":"+0.9381644","unit":"1"},"type":"quantity"},"datatype":"quantity"}],"P1660":[{"snaktype":"value","property":"P1660","hash":"ac3c626774dcd0d16f89557f66586245841a01db","datavalue":{"value":{"entity-type":"item","numeric-id":6767936,"id":"Q6767936"},"type":"wikibase-entityid"},"datatype":"wikibase-item"}]},"qualifiers-order":["P1659","P1660"],"id":"Q4375487$3BA797D9-5A17-4F09-AC28-DAD9CC7F024D","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1643","hash":"7632297dbd635f50921f0b3a325de65a408d58e2","datavalue":{"value":{"entity-type":"item","numeric-id":4407571,"id":"Q4407571"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","qualifiers":{"P1659":[{"snaktype":"value","property":"P1659","hash":"ce2f37903e92767eb7e869d3e13628e5da893286","datavalue":{"value":{"amount":"+0.9374173","unit":"1"},"type":"quantity"},"datatype":"quantity"}],"P1660":[{"snaktype":"value","property":"P1660","hash":"ac3c626774dcd0d16f89557f66586245841a01db","datavalue":{"value":{"entity-type":"item","numeric-id":6767936,"id":"Q6767936"},"type":"wikibase-entityid"},"datatype":"wikibase-item"}]},"qualifiers-order":["P1659","P1660"],"id":"Q4375487$8EB84A83-6EB3-4E77-963B-30DE36E3C12E","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1643","hash":"ed7e8594b393dc7dd3af784ad24cca403c7e3005","datavalue":{"value":{"entity-type":"item","numeric-id":4547436,"id":"Q4547436"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","qualifiers":{"P1659":[{"snaktype":"value","property":"P1659","hash":"a83ff617b07cb520e79c2da7bf4b899f60e5b0e8","datavalue":{"value":{"amount":"+0.9337964","unit":"1"},"type":"quantity"},"datatype":"quantity"}],"P1660":[{"snaktype":"value","property":"P1660","hash":"ac3c626774dcd0d16f89557f66586245841a01db","datavalue":{"value":{"entity-type":"item","numeric-id":6767936,"id":"Q6767936"},"type":"wikibase-entityid"},"datatype":"wikibase-item"}]},"qualifiers-order":["P1659","P1660"],"id":"Q4375487$F9791F9A-217D-4F72-BEA7-CA14C1D16906","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1643","hash":"d9841288a226d8ae98dd3188e7915f0cdae618c4","datavalue":{"value":{"entity-type":"item","numeric-id":4727148,"id":"Q4727148"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","qualifiers":{"P1659":[{"snaktype":"value","property":"P1659","hash":"b5e7a012cf2b6d64ccc0a3cd9c26e986fbe3876a","datavalue":{"value":{"amount":"+0.9330648","unit":"1"},"type":"quantity"},"datatype":"quantity"}],"P1660":[{"snaktype":"value","property":"P1660","hash":"ac3c626774dcd0d16f89557f66586245841a01db","datavalue":{"value":{"entity-type":"item","numeric-id":6767936,"id":"Q6767936"},"type":"wikibase-entityid"},"datatype":"wikibase-item"}]},"qualifiers-order":["P1659","P1660"],"id":"Q4375487$A858022A-CED5-41B4-8EAC-1F7384E356B2","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1643","hash":"87df6c9d3ecc389575dde2ec6addada887ff63ee","datavalue":{"value":{"entity-type":"item","numeric-id":2453875,"id":"Q2453875"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","qualifiers":{"P1659":[{"snaktype":"value","property":"P1659","hash":"926996d3966c120218808cc15da567cd2fa37b7f","datavalue":{"value":{"amount":"+0.9324827","unit":"1"},"type":"quantity"},"datatype":"quantity"}],"P1660":[{"snaktype":"value","property":"P1660","hash":"ac3c626774dcd0d16f89557f66586245841a01db","datavalue":{"value":{"entity-type":"item","numeric-id":6767936,"id":"Q6767936"},"type":"wikibase-entityid"},"datatype":"wikibase-item"}]},"qualifiers-order":["P1659","P1660"],"id":"Q4375487$43C21322-250A-427F-808F-FB0A76EFE3FF","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1643","hash":"8049fc16c8c250c9a1ce36d48ebe76bd8f1b305b","datavalue":{"value":{"entity-type":"item","numeric-id":2629807,"id":"Q2629807"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","qualifiers":{"P1659":[{"snaktype":"value","property":"P1659","hash":"66f3a3e2d5d973bc9e3c54952e7776b0c8f353fd","datavalue":{"value":{"amount":"+0.93006045","unit":"1"},"type":"quantity"},"datatype":"quantity"}],"P1660":[{"snaktype":"value","property":"P1660","hash":"ac3c626774dcd0d16f89557f66586245841a01db","datavalue":{"value":{"entity-type":"item","numeric-id":6767936,"id":"Q6767936"},"type":"wikibase-entityid"},"datatype":"wikibase-item"}]},"qualifiers-order":["P1659","P1660"],"id":"Q4375487$2DD284F1-DA91-43D3-85D7-6AD76D042000","rank":"normal"}],"P159":[{"mainsnak":{"snaktype":"value","property":"P159","hash":"23def1d5d4904ddf477ef729bcc158266292b054","datavalue":{"value":{"text":"Continuous-time Markov chains and applications. A singular perturbation approach","language":"en"},"type":"monolingualtext"},"datatype":"monolingualtext"},"type":"statement","id":"Q4375487$76B5B2A0-850D-4E36-ABB0-3C50AC06ACF9","rank":"normal"}],"P1448":[{"mainsnak":{"snaktype":"value","property":"P1448","hash":"ec1c42f0bb581118dd241c78039aefca45f8258a","datavalue":{"value":"The main matter of the book are stepped Markov processes \\((\\alpha^\\varepsilon (t),\\;t\\geq 0)\\) with a finite state space \\({\\mathcal M}= \\{1, \\dots, m\\}\\) and their applications to Markov decision problems. The authors investigate properties of the process connected with its generator \\(Q^\\varepsilon (t)\\) \\((\\varepsilon >0)\\), where \\(t\\) is a time parameter showing the relation to a one-dimensional probability distribution of the process: \\[ {\\partial p^\\varepsilon(t) \\over \\partial t}= p^\\varepsilon (t)Q^\\varepsilon (t), \\quad p^\\varepsilon (0) =p^0 \\quad \\left( p^0_i\\geq 0,\\sum^m_{i=1} p^0_i= 1\\right), \\] \\(\\varepsilon\\) is a small parameter defining a family of the processes with a singularity. Such a singularity arises in the case \\( Q^\\varepsilon(t)={1\\over\\varepsilon}\\widetilde Q(t)+ \\widehat Q(t)\\), where \\(\\widetilde Q(t)\\) and \\(\\widehat Q(t)\\) are generators themselves. The first interesting property of the family is an asymptotic expansion of the probability distribution containing a regular part and a singular one: \\[ p^\\varepsilon (t)= \\sum^n_{i=1} \\varepsilon^i \\varphi^{(i)} (t)+ \\sum^n_{i=1} \\varepsilon^i \\psi^{(i)} (t) +o(\\varepsilon^n), \\] where \\(\\varphi^{(i)}\\), \\(\\psi^{(i)}\\) are some functions which can be found in a constructive way and \\(o(\\varepsilon^n)\\) can be estimated. The case \\(\\widetilde Q(t)= \\text{diag} (\\widetilde Q^1(t), \\dots, \\widetilde Q^l (t))\\) is most meaningful, where \\(\\widetilde Q^i (t)\\) is a generator of an irreducible Markov process on the state space \\({\\mathcal M}_i\\) \\(({\\mathcal M}_i \\cap {\\mathcal M}_j =\\emptyset\\) \\((i\\neq j)\\), \\({\\mathcal M} =\\bigcup^l_{i=1} {\\mathcal M}_i)\\). This expansion can take into account sets of absorbing and transient states. It is surprising that there exist variants of the law of large numbers and of the central limit theorem for these non-homogeneous in time processes. They correspond to a difference between a sojourn time at a state \\(i\\in {\\mathcal M}\\) and an appropriate one-dimensional probability. In the above block structure of the matrix \\(\\widetilde Q(t)\\) the problem of interaction of quick and slow parts is investigated. In this interaction an aggregated process \\(\\overline \\alpha^\\varepsilon (\\cdot)\\) \\((\\overline \\alpha^\\varepsilon (t)=k\\) when \\(\\alpha^\\varepsilon (t) \\in {\\mathcal M}_k)\\) plays the main role. It is interesting that \\(\\overline \\alpha^\\varepsilon (\\cdot)\\) tends weakly to a limit process \\(\\overline \\alpha (\\cdot)\\) in the metric space \\({\\mathcal D} [0,T]\\) \\((T>0)\\). On the other hand the set of the processes \\(\\alpha^\\varepsilon (\\cdot)\\) \\((\\varepsilon >0)\\) is not tight in this space. As generalizations of the finite-dimensional case the following families are discussed: a countable case when \\(\\widetilde Q(t)= \\text{diag} (\\widetilde Q^1(t),\\widetilde Q^2(t),\\dots)\\) (irreducible block structure) and the case of a singularly perturbed diffusion process. The main applications of the authors' results on the singular perturbation relate to a Markov model of a complex control system. In this system it is natural to distinguish slow and quick parts which demand a hierarchical control. The main idea in this application is to construct a Hamiltonian in terms of a singularly perturbed process and to solve the corresponding Hamilton-Jacoby-Bellman equation. The authors propose some numerical methods for that. The book is convenient for a reader to use due to its clear style and accurate preliminaries, notes and appendices, explaining the plan, the history and technical details.","type":"string"},"datatype":"string"},"type":"statement","id":"Q4375487$13273080-931F-4DDF-AF17-23207271E8DC","rank":"normal"}]},"sitelinks":{"mardi":{"site":"mardi","title":"Continuous-time Markov chains and applications. A singular perturbation approach","badges":[],"url":"https://portal.mardi4nfdi.de/wiki/Continuous-time_Markov_chains_and_applications._A_singular_perturbation_approach"}}}}}