{"entities":{"Q1973302":{"pageid":1984044,"ns":120,"title":"Item:Q1973302","lastrevid":46915320,"modified":"2025-12-25T20:35:20Z","type":"item","id":"Q1973302","labels":{"en":{"language":"en","value":"Markov control process with the expected total cost criterion: Optimality, stability, and transient models"}},"descriptions":{"en":{"language":"en","value":"scientific article; zbMATH DE number 1436944"}},"aliases":{},"claims":{"P31":[{"mainsnak":{"snaktype":"value","property":"P31","hash":"fd5912e4dab4b881a8eb0eb27e7893fef55176ad","datavalue":{"value":{"entity-type":"item","numeric-id":56887,"id":"Q56887"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q1973302$A19B1FF0-2F78-4C9C-ABD0-FB247500D8C9","rank":"normal"}],"P159":[{"mainsnak":{"snaktype":"value","property":"P159","hash":"847fa13e9a8ab677a581f443f40442cbf692f75e","datavalue":{"value":{"text":"Markov control process with the expected total cost criterion: Optimality, stability, and transient models","language":"en"},"type":"monolingualtext"},"datatype":"monolingualtext"},"type":"statement","id":"Q1973302$BE6B4943-F0D0-4661-B63F-B9CA810C7BB9","rank":"normal"}],"P225":[{"mainsnak":{"snaktype":"value","property":"P225","hash":"f7c03dca47d5b58990f0802f361ada2dc4de86c0","datavalue":{"value":"0964.93086","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q1973302$6D99261A-40E1-4384-9560-EA44BD2D8F2E","rank":"normal"}],"P27":[{"mainsnak":{"snaktype":"value","property":"P27","hash":"beac64c9e70e1913dd96b0e370f4d029273ed9f9","datavalue":{"value":"10.1023/A:1006368714127","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q1973302$93F44F0B-6240-4107-8B2F-C57E50A3F48B","rank":"normal"}],"P16":[{"mainsnak":{"snaktype":"value","property":"P16","hash":"016e612022830fdab679414edd2922ced8c44389","datavalue":{"value":{"entity-type":"item","numeric-id":1973300,"id":"Q1973300"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q1973302$3A2C9CC0-9C12-452B-812F-1504059D69FB","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P16","hash":"1fa84b5689ae6c6d213b4cb03ca83e749e68c526","datavalue":{"value":{"entity-type":"item","numeric-id":1973301,"id":"Q1973301"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q1973302$D1C188A5-6AE8-4CD7-B7B6-0B3AD7FBAAC2","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P16","hash":"65a789ec039c0740052b621158327ea321c66164","datavalue":{"value":{"entity-type":"item","numeric-id":217261,"id":"Q217261"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q1973302$DB93B251-11C8-4BBC-AAA5-3A32969891D3","rank":"normal"}],"P200":[{"mainsnak":{"snaktype":"value","property":"P200","hash":"8d1231d86866fb01586b04e1f50e347c0a84f9cd","datavalue":{"value":{"entity-type":"item","numeric-id":190587,"id":"Q190587"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q1973302$D4DF3A88-72A0-4D15-8222-C42D99AB76D7","rank":"normal"}],"P28":[{"mainsnak":{"snaktype":"value","property":"P28","hash":"3bfb21b1596c9215cf173b2dd3315088d58fe076","datavalue":{"value":{"time":"+2000-08-29T00:00:00Z","timezone":0,"before":0,"after":0,"precision":11,"calendarmodel":"http://www.wikidata.org/entity/Q1985727"},"type":"time"},"datatype":"time"},"type":"statement","id":"Q1973302$B719CB48-C26B-409E-9371-B00C5C752E77","rank":"normal"}],"P1448":[{"mainsnak":{"snaktype":"value","property":"P1448","hash":"ba1250edd99a2ea75e3453672148dabebbf2f697","datavalue":{"value":"The authors study discrete-time Markov Control Processes (MCPs) on Borel spaces under the Expected Total Cost (ETC) criterion  \\[ V(\\pi, x)= E^\\pi_x\\Biggl[ \\sum^\\infty_{t= 0} c(x_ t,a_t)\\Biggr], \\]  where \\(c(x_t, a_t)\\) is the cost-per-stage function and is possibly unbounded [for the basic concepts and notations of the MCPs, cf. \\textit{O. Hern\u00e1ndez-Lerma} and \\textit{J. B. Lasserre}, Discrete-time Markov control processes: Basic optimality criteria, Springer-Verlag, New York (1995; Zbl 0840.93001)]. A lot of optimality questions are answered affirmatively here. Conditions for a control policy to be ETC-optimal and conditions for the ETC-value function to be a solution to the dynamic programming equation are well provided. It is also shown that the finiteness of the ETC function may lead to two kinds of stability: Lagrange stability and stability with probability one. In addition, transient control models [cf. \\textit{S. R. Pliska}, Dynamic programming and its applications, Proc. Int. Conf., Vancouver 1977, 335-349 (1978; Zbl 0458.90082)] are fully analyzed. In fact, with the authors' new results, the paper provides a fairly complete, up-dated, survey-like presentation of the ETC criterion for MCPs.","type":"string"},"datatype":"string"},"type":"statement","id":"Q1973302$07C1666A-A0CA-420B-A35B-0D29261F12B2","rank":"normal"}],"P1447":[{"mainsnak":{"snaktype":"value","property":"P1447","hash":"45e6fadf5dc208a7e2a9945e966efc6b55109061","datavalue":{"value":{"entity-type":"item","numeric-id":758008,"id":"Q758008"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q1973302$4203331A-B813-4768-994E-DBB72452C665","rank":"normal"}],"P226":[{"mainsnak":{"snaktype":"value","property":"P226","hash":"e3bc6c7cda8279d6ad2b578e7a7e4967447c3cc4","datavalue":{"value":"93E20","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q1973302$DB68189C-6639-4151-83C0-9191BCC3261A","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P226","hash":"377d3ab03372cff12915e0de0374438ff70c3716","datavalue":{"value":"90C40","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q1973302$B4F6F194-2DBB-4B98-BC32-08E119D86D07","rank":"normal"}],"P1451":[{"mainsnak":{"snaktype":"value","property":"P1451","hash":"6f6941785ac8ebf426c282a459fe16e5d1dfbf94","datavalue":{"value":"1436944","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q1973302$7E61597B-5F1A-4CEE-8134-8B32A2D303C3","rank":"normal"}],"P1450":[{"mainsnak":{"snaktype":"value","property":"P1450","hash":"b787a7fb4983f9edd99c2283d82bd30f90e94b57","datavalue":{"value":"policy iteration","type":"string"},"datatype":"string"},"type":"statement","id":"Q1973302$F323D2B7-85A9-40C8-BD01-7511952FB824","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1450","hash":"96eac13573075d1e118cf2033523d69ed170fb47","datavalue":{"value":"discrete-time Markov control processes","type":"string"},"datatype":"string"},"type":"statement","id":"Q1973302$CE24A82F-7C69-4151-A6DA-1774AEB29509","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1450","hash":"f5e8193a4c01b5aa0563a9f89d4e6f78abc20baf","datavalue":{"value":"expected total cost","type":"string"},"datatype":"string"},"type":"statement","id":"Q1973302$B88C1E6B-0E74-4D57-9DE1-A707EAEA9357","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1450","hash":"0d82cfa81638332a8c825bcbbd9d7f7f9c0c45be","datavalue":{"value":"dynamic programming","type":"string"},"datatype":"string"},"type":"statement","id":"Q1973302$1A8ED495-D26A-4436-B238-5D75B7D93904","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1450","hash":"7316fb62e44c24092795e78763cd7b42583c4ec9","datavalue":{"value":"Lagrange stability","type":"string"},"datatype":"string"},"type":"statement","id":"Q1973302$CD184E0F-E04F-4C03-A7D3-97CDBB1163E9","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1450","hash":"816165ea66693f77e085e325775ee5f94ded6bb3","datavalue":{"value":"stability with probability one","type":"string"},"datatype":"string"},"type":"statement","id":"Q1973302$6250975C-A4B3-47DF-8A2B-C00950779C14","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1450","hash":"bf9ca3c620f013f2a58b810f348d1289174d935a","datavalue":{"value":"transient control models","type":"string"},"datatype":"string"},"type":"statement","id":"Q1973302$199F3956-7503-4CE2-9DB1-FEE57DB06CA1","rank":"normal"}],"P1460":[{"mainsnak":{"snaktype":"value","property":"P1460","hash":"57f7fea50d2ce1b39b695c4a1313582eed405e38","datavalue":{"value":{"entity-type":"item","numeric-id":5976449,"id":"Q5976449"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q1973302$BBEDA31D-8C87-4DC0-AD7D-B29024B5D76D","rank":"normal"}],"P205":[{"mainsnak":{"snaktype":"value","property":"P205","hash":"900cc9c73723f59aacbd56b42de3b52d2666f5c1","datavalue":{"value":"https://doi.org/10.1023/a:1006368714127","type":"string"},"datatype":"url"},"type":"statement","id":"Q1973302$A6310C24-4A79-48FA-A6D6-2496E1B52D84","rank":"normal"}],"P388":[{"mainsnak":{"snaktype":"value","property":"P388","hash":"2bfb13ba730edf1e76ca620d962a2ba42f9f7f35","datavalue":{"value":"W1920513863","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q1973302$F27C6730-999F-44F9-86CA-3AEE8BDD869D","rank":"normal"}],"P1643":[{"mainsnak":{"snaktype":"value","property":"P1643","hash":"a6b3c22878a8845239fce06fe12271f1fa5ff4f2","datavalue":{"value":{"entity-type":"item","numeric-id":4039208,"id":"Q4039208"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","qualifiers":{"P1659":[{"snaktype":"value","property":"P1659","hash":"4654eaab06d5c53326d19686e3caaca0a24441a9","datavalue":{"value":{"amount":"+0.8409210443496704","unit":"1"},"type":"quantity"},"datatype":"quantity"}],"P1660":[{"snaktype":"value","property":"P1660","hash":"a327a09ea0305e98d5cf33bd4036320e19f2aed0","datavalue":{"value":{"entity-type":"item","numeric-id":6821328,"id":"Q6821328"},"type":"wikibase-entityid"},"datatype":"wikibase-item"}]},"qualifiers-order":["P1659","P1660"],"id":"Q1973302$9D28DA40-97B1-452B-8FDA-66A14F707AA2","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1643","hash":"e1bc141c503d2846cc6afadf67aa3cd11fa1c352","datavalue":{"value":{"entity-type":"item","numeric-id":4255598,"id":"Q4255598"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","qualifiers":{"P1659":[{"snaktype":"value","property":"P1659","hash":"c24ca7d8b66377f5280677ddd5b436f9cdc47d9f","datavalue":{"value":{"amount":"+0.840100884437561","unit":"1"},"type":"quantity"},"datatype":"quantity"}],"P1660":[{"snaktype":"value","property":"P1660","hash":"a327a09ea0305e98d5cf33bd4036320e19f2aed0","datavalue":{"value":{"entity-type":"item","numeric-id":6821328,"id":"Q6821328"},"type":"wikibase-entityid"},"datatype":"wikibase-item"}]},"qualifiers-order":["P1659","P1660"],"id":"Q1973302$726685A6-BE63-4ADF-8A07-3A1DBCE06E93","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1643","hash":"ddf65adee19dfd6ab8dd0499d28f373f23a00fc4","datavalue":{"value":{"entity-type":"item","numeric-id":4863593,"id":"Q4863593"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","qualifiers":{"P1659":[{"snaktype":"value","property":"P1659","hash":"2df504602bba3745fbf8c8d61c4e18c22a6699a4","datavalue":{"value":{"amount":"+0.8179087042808533","unit":"1"},"type":"quantity"},"datatype":"quantity"}],"P1660":[{"snaktype":"value","property":"P1660","hash":"a327a09ea0305e98d5cf33bd4036320e19f2aed0","datavalue":{"value":{"entity-type":"item","numeric-id":6821328,"id":"Q6821328"},"type":"wikibase-entityid"},"datatype":"wikibase-item"}]},"qualifiers-order":["P1659","P1660"],"id":"Q1973302$E39CE466-4B49-463C-BEBE-D1C60401A513","rank":"normal"}]},"sitelinks":{"mardi":{"site":"mardi","title":"Publication:1973302","badges":[],"url":"https://portal.mardi4nfdi.de/wiki/Publication:1973302"}}}}}