{"entities":{"Q1176301":{"pageid":1187050,"ns":120,"title":"Item:Q1176301","lastrevid":66434817,"modified":"2026-04-12T10:03:20Z","type":"item","id":"Q1176301","labels":{"en":{"language":"en","value":"Average cost Markov decision processes: Optimality conditions"}},"descriptions":{"en":{"language":"en","value":"scientific article; zbMATH DE number 14009"}},"aliases":{},"claims":{"P31":[{"mainsnak":{"snaktype":"value","property":"P31","hash":"fd5912e4dab4b881a8eb0eb27e7893fef55176ad","datavalue":{"value":{"entity-type":"item","numeric-id":56887,"id":"Q56887"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q1176301$A493C087-B12D-49A7-BB2D-02E3AE7F4409","rank":"normal"}],"P159":[{"mainsnak":{"snaktype":"value","property":"P159","hash":"8e951dd8fe1bb290d4b4a604f16d39661773cb27","datavalue":{"value":{"text":"Average cost Markov decision processes: Optimality conditions","language":"en"},"type":"monolingualtext"},"datatype":"monolingualtext"},"type":"statement","id":"Q1176301$5120BB7F-6888-4430-9D6B-39F187BE6B0D","rank":"normal"}],"P225":[{"mainsnak":{"snaktype":"value","property":"P225","hash":"ab4dc44752ff68a2b0e03c20efa03cef8325dc44","datavalue":{"value":"0739.90072","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q1176301$71FB71B0-866E-4D36-8850-AA8819D01B31","rank":"normal"}],"P27":[{"mainsnak":{"snaktype":"value","property":"P27","hash":"73adee18f28af6af08e81834fe50a7b1c264e715","datavalue":{"value":"10.1016/0022-247X(91)90244-T","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q1176301$113FA57E-5A6F-4F52-AD92-481B06622EFD","rank":"normal"}],"P200":[{"mainsnak":{"snaktype":"value","property":"P200","hash":"c5ad7b9baf8e531c6b1ad954eb5f2899cc8fe5e5","datavalue":{"value":{"entity-type":"item","numeric-id":85344,"id":"Q85344"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q1176301$0D3E4A28-6B53-4556-B623-551F1D81CA5B","rank":"normal"}],"P28":[{"mainsnak":{"snaktype":"value","property":"P28","hash":"d3f790682a6be4cc1f3210e15eebe1d6cc5ffbc2","datavalue":{"value":{"time":"+1992-06-25T00:00:00Z","timezone":0,"before":0,"after":0,"precision":11,"calendarmodel":"http://www.wikidata.org/entity/Q1985727"},"type":"time"},"datatype":"time"},"type":"statement","id":"Q1176301$38425614-A723-4C5E-A936-56A61C81620C","rank":"normal"}],"P1448":[{"mainsnak":{"snaktype":"value","property":"P1448","hash":"93496b9b8b736676d96ef8aa964a5fb4d4bf0796","datavalue":{"value":"The authors consider the following discrete-time Markov decision processes with long run expected average cost criterion: both state space \\(X\\) and action set \\(A\\) are Borel sets (i.e. Borel subsets of complete separable metric spaces) and, for each state \\(x\\in X\\), a nonempty measurable subset \\(A(x)\\) of \\(A\\), which is the set of the admissible actions when the process is in state \\(x\\), is compact. The transition law \\(q(\\cdot\\mid\\cdot,\\cdot)\\) is a stochastic kernel on \\(X\\) given \\(X\\times A\\) such that \\(\\int_ X v(y)q(dy\\mid x,a)\\) is a lower semi-continuous function in \\(a\\in A(x)\\) for each \\(x\\in X\\) and any bounded measurable function \\(v\\) on \\(X\\). The one-stage cost function \\(c\\) is bounded measurable on \\(X\\times A\\) and lower semi-continuous in \\(a\\in A(x)\\) for each \\(x\\in X\\). The authors give ergodicity conditions with respect to the transition law \\(q\\) under which a duality theorem holds, that is, the existence of an optimal solution to the primal problem, which is equivalently a solution to the optimality equation for the Markov decision model with the average cost criterion, yields an optimal solution to the dual problem or the deterministic version and conversely, and furthermore the corresponding optimal values of the problems are equal. This result extends those of \\textit{K. Yamada} [J. Math. Anal. Appl. 50, 579-595 (1975; Zbl 0323.90053)] and \\textit{J. A. Filar} and \\textit{T. A. Schultz} [Oper. Res. Lett. 7, 303-307 (1988; Zbl 0659.90095)] to the model with general Borel spaces. Also, using the concept of opportunity cost introduced by \\textit{J. Flynn} [J. Math. Anal. Appl. 76, 202-208 (1980; Zbl 0438.90100); ibid. 144, 586-594 (1989; Zbl 0679.90084)], they show that a stationary policy determined from the optimality equation is strong average optimal.","type":"string"},"datatype":"string"},"type":"statement","id":"Q1176301$28D9BFBC-2BCF-4090-89D8-7A4F4770322F","rank":"normal"}],"P226":[{"mainsnak":{"snaktype":"value","property":"P226","hash":"377d3ab03372cff12915e0de0374438ff70c3716","datavalue":{"value":"90C40","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q1176301$DDA47B4D-C360-4502-91A5-58A501F4E019","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P226","hash":"e3bc6c7cda8279d6ad2b578e7a7e4967447c3cc4","datavalue":{"value":"93E20","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q1176301$39D4CFCC-A29B-4666-8881-71978D7EA44C","rank":"normal"}],"P1451":[{"mainsnak":{"snaktype":"value","property":"P1451","hash":"6351bacc8e0180cff17dce05300108efb4bbe66b","datavalue":{"value":"14009","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q1176301$527EEB55-4996-4CC1-ABE9-D2BA2BA6EE96","rank":"normal"}],"P1450":[{"mainsnak":{"snaktype":"value","property":"P1450","hash":"4ee2b6a8cf5bbb5586491390b25d1ac2ec9674da","datavalue":{"value":"duality theorem","type":"string"},"datatype":"string"},"type":"statement","id":"Q1176301$7574A32F-EB05-4AA5-986D-A53248D1F3C9","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1450","hash":"7e1b41a3bcf46167c4d8b2e9550b20a4d4de6cba","datavalue":{"value":"strong average optimality","type":"string"},"datatype":"string"},"type":"statement","id":"Q1176301$39D387C4-319E-4C2C-BDDD-3E90B13BB0CC","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1450","hash":"ce23345a67f4b87da2e820ced0fdd206f3d05238","datavalue":{"value":"long run expected average cost criterion","type":"string"},"datatype":"string"},"type":"statement","id":"Q1176301$3390B7CA-9F48-4FFC-B464-EE31318CB2BF","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1450","hash":"e636be650b3d9611aa3c47740d51501adb25d314","datavalue":{"value":"ergodicity conditions","type":"string"},"datatype":"string"},"type":"statement","id":"Q1176301$D4AD0174-6F8B-4CEC-AB74-49BC8EC91AAC","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1450","hash":"fafe5149f7370250cb595648c7b6526568b1a12c","datavalue":{"value":"opportunity cost","type":"string"},"datatype":"string"},"type":"statement","id":"Q1176301$C875FE97-B1A4-4E9E-8FF9-3938264E62CB","rank":"normal"}],"P16":[{"mainsnak":{"snaktype":"value","property":"P16","hash":"65a789ec039c0740052b621158327ea321c66164","datavalue":{"value":{"entity-type":"item","numeric-id":217261,"id":"Q217261"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q1176301$EC0B1322-4832-4E1A-8129-7DFAEBF8E23A","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P16","hash":"77ec0aff32231429080d0cca3db1b62d3fe3f112","datavalue":{"value":{"entity-type":"item","numeric-id":999563,"id":"Q999563"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q1176301$6F876950-8B4E-446A-A169-3763921A6E5F","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P16","hash":"3d6909d519daff13c846ee3c5786c88cf823ecb9","datavalue":{"value":{"entity-type":"item","numeric-id":1731747,"id":"Q1731747"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q1176301$2A9ED01E-5F21-4154-8403-B72408478B51","rank":"normal"}],"P1447":[{"mainsnak":{"snaktype":"value","property":"P1447","hash":"544c50f1a55384cc907f306dfffad302e385e2ac","datavalue":{"value":{"entity-type":"item","numeric-id":588539,"id":"Q588539"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q1176301$FC84EB8B-AE17-4E45-AA4D-B044156579C6","rank":"normal"}],"P1460":[{"mainsnak":{"snaktype":"value","property":"P1460","hash":"57f7fea50d2ce1b39b695c4a1313582eed405e38","datavalue":{"value":{"entity-type":"item","numeric-id":5976449,"id":"Q5976449"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q1176301$602BB974-3231-4AF1-8BD1-B9B0367FF204","rank":"normal"}],"P223":[{"mainsnak":{"snaktype":"value","property":"P223","hash":"e46a1122e0af35bb2b10a0101a42f17733a7647d","datavalue":{"value":{"entity-type":"item","numeric-id":1112741,"id":"Q1112741"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q1176301$67437CE5-0057-4B99-A3FA-EE7576883290","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P223","hash":"4d31ac5e5311c06baf50d03b1af5e25bd5b1b956","datavalue":{"value":{"entity-type":"item","numeric-id":1142160,"id":"Q1142160"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q1176301$B5261779-4B2D-4729-963B-FB0D2358F42C","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P223","hash":"59897822a957ec1d494b67a25b0f71b78b369e04","datavalue":{"value":{"entity-type":"item","numeric-id":912004,"id":"Q912004"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q1176301$F80C9CFB-6BF1-4394-8B2A-BB332939C90F","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P223","hash":"c27061cd08122beb910f834d5ed63addb46f4214","datavalue":{"value":{"entity-type":"item","numeric-id":4172731,"id":"Q4172731"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q1176301$237699D6-EF2D-4C3B-BC00-C75E87169708","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P223","hash":"a58210f4265fa11ed7229ce85db4870539016f14","datavalue":{"value":{"entity-type":"item","numeric-id":1801301,"id":"Q1801301"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q1176301$B54A12C7-6093-4093-92BD-BD4A023BE93C","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P223","hash":"742e7d8ada88ca00f56e004ceb4a87393d5ba5de","datavalue":{"value":{"entity-type":"item","numeric-id":1104254,"id":"Q1104254"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q1176301$1C6396AA-C3F1-46B5-AF66-3E61BDB6CA73","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P223","hash":"39aa18014a930acaad587b0c949bfb33505147f0","datavalue":{"value":{"entity-type":"item","numeric-id":2638961,"id":"Q2638961"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q1176301$3E6C8B98-5811-4CC0-B412-54288CEF1915","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P223","hash":"f61b7c666ab612130480d5b119c135c2253271e3","datavalue":{"value":{"entity-type":"item","numeric-id":5599448,"id":"Q5599448"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q1176301$F1CF40C5-81DD-42B6-903B-ABD3B0CBD9F8","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P223","hash":"a8e48379ff68d2025d4aa7fbefd684e2faa97383","datavalue":{"value":{"entity-type":"item","numeric-id":3833894,"id":"Q3833894"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q1176301$A249A819-DC5F-4C72-AF73-4366410DFC0F","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P223","hash":"f13c880908335c24845b9e607abbfe621c503625","datavalue":{"value":{"entity-type":"item","numeric-id":3966881,"id":"Q3966881"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q1176301$C43A3403-CE6C-461C-BCC8-123D28A17F25","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P223","hash":"3eaedd9de4e16a0ff2a38f2721e5ef364931bfa0","datavalue":{"value":{"entity-type":"item","numeric-id":1224504,"id":"Q1224504"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q1176301$5D6A4586-5021-4980-81BE-045FDFFA38B9","rank":"normal"}],"P1643":[{"mainsnak":{"snaktype":"value","property":"P1643","hash":"91e2c1a4c013a3d183bd1e94d506e3f612537dcb","datavalue":{"value":{"entity-type":"item","numeric-id":3410916,"id":"Q3410916"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","qualifiers":{"P1659":[{"snaktype":"value","property":"P1659","hash":"f89b19a9757a475b6314672ac534d4c2b33069de","datavalue":{"value":{"amount":"+0.8861691355705261","unit":"1"},"type":"quantity"},"datatype":"quantity"}],"P1660":[{"snaktype":"value","property":"P1660","hash":"a327a09ea0305e98d5cf33bd4036320e19f2aed0","datavalue":{"value":{"entity-type":"item","numeric-id":6821328,"id":"Q6821328"},"type":"wikibase-entityid"},"datatype":"wikibase-item"}]},"qualifiers-order":["P1659","P1660"],"id":"Q1176301$DE26A7A0-1688-456F-82DF-AA36BF659D42","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1643","hash":"3978d6966b2c0d54e3433e45e3534281805f1665","datavalue":{"value":{"entity-type":"item","numeric-id":1814435,"id":"Q1814435"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","qualifiers":{"P1659":[{"snaktype":"value","property":"P1659","hash":"5ea436d50e09a03bd972d54f227fb9ff2058f897","datavalue":{"value":{"amount":"+0.8715063333511353","unit":"1"},"type":"quantity"},"datatype":"quantity"}],"P1660":[{"snaktype":"value","property":"P1660","hash":"a327a09ea0305e98d5cf33bd4036320e19f2aed0","datavalue":{"value":{"entity-type":"item","numeric-id":6821328,"id":"Q6821328"},"type":"wikibase-entityid"},"datatype":"wikibase-item"}]},"qualifiers-order":["P1659","P1660"],"id":"Q1176301$7EAF20B3-A088-421E-A477-D977D97017F1","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1643","hash":"0edc4107d58298ca1fe9f072e3175b475060f36b","datavalue":{"value":{"entity-type":"item","numeric-id":2925348,"id":"Q2925348"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","qualifiers":{"P1659":[{"snaktype":"value","property":"P1659","hash":"61e059745f99dac96ec73db6b50c88578081f2c7","datavalue":{"value":{"amount":"+0.868661105632782","unit":"1"},"type":"quantity"},"datatype":"quantity"}],"P1660":[{"snaktype":"value","property":"P1660","hash":"a327a09ea0305e98d5cf33bd4036320e19f2aed0","datavalue":{"value":{"entity-type":"item","numeric-id":6821328,"id":"Q6821328"},"type":"wikibase-entityid"},"datatype":"wikibase-item"}]},"qualifiers-order":["P1659","P1660"],"id":"Q1176301$CB6045BC-7B6A-4521-929B-95D06409D0FA","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1643","hash":"7cbc034d5aedbd1df652b4c0653e9146a44ec896","datavalue":{"value":{"entity-type":"item","numeric-id":3748085,"id":"Q3748085"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","qualifiers":{"P1659":[{"snaktype":"value","property":"P1659","hash":"cb721b0b87652e4776d5e44fd1742b622c453109","datavalue":{"value":{"amount":"+0.8605374097824097","unit":"1"},"type":"quantity"},"datatype":"quantity"}],"P1660":[{"snaktype":"value","property":"P1660","hash":"a327a09ea0305e98d5cf33bd4036320e19f2aed0","datavalue":{"value":{"entity-type":"item","numeric-id":6821328,"id":"Q6821328"},"type":"wikibase-entityid"},"datatype":"wikibase-item"}]},"qualifiers-order":["P1659","P1660"],"id":"Q1176301$0CC3AA5F-57AA-404A-BD7A-8D508206ABEB","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1643","hash":"25f8de4e12e35065f35c66806995b7b84082f56a","datavalue":{"value":{"entity-type":"item","numeric-id":1076617,"id":"Q1076617"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","qualifiers":{"P1659":[{"snaktype":"value","property":"P1659","hash":"25bf9366924f7a84da80de8f22eecbc458f7d104","datavalue":{"value":{"amount":"+0.8598479628562927","unit":"1"},"type":"quantity"},"datatype":"quantity"}],"P1660":[{"snaktype":"value","property":"P1660","hash":"a327a09ea0305e98d5cf33bd4036320e19f2aed0","datavalue":{"value":{"entity-type":"item","numeric-id":6821328,"id":"Q6821328"},"type":"wikibase-entityid"},"datatype":"wikibase-item"}]},"qualifiers-order":["P1659","P1660"],"id":"Q1176301$A6FABDE4-419B-467D-B79C-6DF72D9C99C2","rank":"normal"}]},"sitelinks":{"mardi":{"site":"mardi","title":"Average cost Markov decision processes: Optimality conditions","badges":[],"url":"https://portal.mardi4nfdi.de/wiki/Average_cost_Markov_decision_processes:_Optimality_conditions"}}}}}