{"entities":{"Q908861":{"pageid":910709,"ns":120,"title":"Item:Q908861","lastrevid":65271090,"modified":"2026-04-12T01:26:48Z","type":"item","id":"Q908861","labels":{"en":{"language":"en","value":"Separable value functions for infinite horizon average reward Markov decision processes"}},"descriptions":{"en":{"language":"en","value":"scientific article; zbMATH DE number 4135738"}},"aliases":{},"claims":{"P31":[{"mainsnak":{"snaktype":"value","property":"P31","hash":"fd5912e4dab4b881a8eb0eb27e7893fef55176ad","datavalue":{"value":{"entity-type":"item","numeric-id":56887,"id":"Q56887"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q908861$CDB25A2B-6A9C-42A1-B0D1-5E8488F9EB1A","rank":"normal"}],"P159":[{"mainsnak":{"snaktype":"value","property":"P159","hash":"8cabb728e0fd3137db4d547060147a3a8c5ad9e5","datavalue":{"value":{"text":"Separable value functions for infinite horizon average reward Markov decision processes","language":"en"},"type":"monolingualtext"},"datatype":"monolingualtext"},"type":"statement","id":"Q908861$1150835E-58E8-4742-B99D-33AE9BB60870","rank":"normal"}],"P225":[{"mainsnak":{"snaktype":"value","property":"P225","hash":"8c0705f6fbaa03a6b9b3de7c7fa2d3ff65051105","datavalue":{"value":"0693.90095","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q908861$043DE4CE-398D-4CEC-BE76-7B9E240E50E0","rank":"normal"}],"P27":[{"mainsnak":{"snaktype":"value","property":"P27","hash":"f3cf9712c0ffa0aca278410d65f3d1deda4534f0","datavalue":{"value":"10.1016/0022-247X(89)90345-4","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q908861$05E7BF83-2A5E-42B2-B000-ED0467D12AF4","rank":"normal"}],"P200":[{"mainsnak":{"snaktype":"value","property":"P200","hash":"c5ad7b9baf8e531c6b1ad954eb5f2899cc8fe5e5","datavalue":{"value":{"entity-type":"item","numeric-id":85344,"id":"Q85344"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q908861$63D9CD62-2F30-44A2-BDB3-9E45F7248ECC","rank":"normal"}],"P28":[{"mainsnak":{"snaktype":"value","property":"P28","hash":"7211ad5ca16eb0d22cd0051fff3d0f3af254ceb6","datavalue":{"value":{"time":"+1989-00-00T00:00:00Z","timezone":0,"before":0,"after":0,"precision":9,"calendarmodel":"http://www.wikidata.org/entity/Q1985727"},"type":"time"},"datatype":"time"},"type":"statement","id":"Q908861$ED68EE52-71CC-4141-83D9-B98A91A2F516","rank":"normal"}],"P1448":[{"mainsnak":{"snaktype":"value","property":"P1448","hash":"7cd970f77287c09b1629c2ed0eea4e16e6f1b668","datavalue":{"value":"Consider the following decision problem:   (a) The state and control spaces S, C are of the form \\(S=\\times^ p_{j=1}S_ j\\), \\(C=\\times^ p_{j=1}C_ j\\), \\(S_ j\\subset R^{nj}\\), \\(C_ j\\subset R^{m_ j}\\) for some integers \\(n_ j\\), \\(m_ j\\), \\(1\\leq j\\leq p\\) and finite \\(C_ j\\), \\(S_ j;\\)    (b) for any given state x, the action set is \\(A(x)=x^ p_{j=0}w_ j(x_ j)\\), \\(x_ j\\in S_ j\\), \\(w_ j(x_ j)\\subset C_ j;\\)    (c) for each \\(i\\in \\{1,2,...,p\\}\\) there is a set \\(I_ i\\subset \\{1,2,...,p\\}\\) such that \\(I_ i\\cap I_ j=\\emptyset\\) if \\(i\\neq j\\); \\(\\cup^{p}_{i=1}I_ i\\subset \\{1,2,...,p\\};\\)    (d) The reward in the current period is of the form \\(r(x,y)=\\sum^{p}_{j=1}r_ j(x_ j,y_ j)\\), \\(x_ j\\in S_ j\\), \\(y_ j\\in w_ j(x_ j);\\)    (e) The states of the next period (given the state \\(x\\in S\\) and the action \\(y\\in A(x))\\) are described by a random variable D (with values in a finite set D) and a function g of the form \\(g(x,y,d)=\\times^ p_{j=1}g_ j(x_{i(j)},y_{i(j)},d)\\) where \\(i(j)=i\\) for \\(j\\in I_ i\\), \\(1\\leq i\\leq p\\), \\(d\\in D.\\)     The problem is to find a policy to maximize the expected reward per period in the long run. A method to find a solution is given. The optimality equation is investigated and the relation to the separated optimality equations is given. An elementary inventory problem within this framework is treated. The paper extends the results of \\textit{W. S. Lovejoy} [Oper. Res. 34, 630-637 (1986; Zbl 0632.90088)].","type":"string"},"datatype":"string"},"type":"statement","id":"Q908861$E8E22192-8184-43E6-92BE-AD39BBC59973","rank":"normal"}],"P226":[{"mainsnak":{"snaktype":"value","property":"P226","hash":"377d3ab03372cff12915e0de0374438ff70c3716","datavalue":{"value":"90C40","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q908861$9CE162BC-D772-457C-86F2-C4897FACA029","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P226","hash":"6f87676c65161128847f8e2acd745d50c25801ce","datavalue":{"value":"90B05","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q908861$10BC0ADD-C627-4105-B8EB-6973631A87D3","rank":"normal"}],"P1451":[{"mainsnak":{"snaktype":"value","property":"P1451","hash":"6ebe6f10f6b52a21afcfe25d12448353ddeef17d","datavalue":{"value":"4135738","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q908861$737788D3-9B17-410C-9BBA-EA4694B1EE67","rank":"normal"}],"P1450":[{"mainsnak":{"snaktype":"value","property":"P1450","hash":"1efe79184fcf0faee20198eea995bc13b6af7c72","datavalue":{"value":"Markov decision problem","type":"string"},"datatype":"string"},"type":"statement","id":"Q908861$119B07D9-7895-476F-AB55-A41A6A28B5A2","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1450","hash":"1a09d29053982bebbf113287e6631e7a0c48ee56","datavalue":{"value":"infinite horizon","type":"string"},"datatype":"string"},"type":"statement","id":"Q908861$CB122CA3-7413-4851-B5D7-EC8B0B3DF61F","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1450","hash":"ae9ac33fbe281c7bf8565fa2c577496b9b65917c","datavalue":{"value":"average reward","type":"string"},"datatype":"string"},"type":"statement","id":"Q908861$7EA4BEF5-0949-42B1-97CE-8F1EF8E6E81D","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1450","hash":"f0fc775e2ac5b150313406a0cd0576f45fadd6a2","datavalue":{"value":"expected reward","type":"string"},"datatype":"string"},"type":"statement","id":"Q908861$165C0E6C-31A9-4951-930B-BE3F6AB5423E","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1450","hash":"30bb37222d0de279af559440a4d29741d5a28e26","datavalue":{"value":"optimality equation","type":"string"},"datatype":"string"},"type":"statement","id":"Q908861$70889C24-ED79-4F1C-92A0-1CB687C004B1","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1450","hash":"af2502fa7986e76c8bffd802d26324585f565a1e","datavalue":{"value":"separated optimality equations","type":"string"},"datatype":"string"},"type":"statement","id":"Q908861$43308A27-AA04-42E0-A1AD-2F85AE9B1AF0","rank":"normal"}],"P16":[{"mainsnak":{"snaktype":"value","property":"P16","hash":"14fb6158c2e7a30d22594a5ac8edc4708d1a10b2","datavalue":{"value":{"entity-type":"item","numeric-id":181183,"id":"Q181183"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q908861$38ACC09B-EC09-4DE5-A2AB-3E6E532BD081","rank":"normal"}],"P1447":[{"mainsnak":{"snaktype":"value","property":"P1447","hash":"a059546f0b0486b6a2bbe72db9c16869dfb00d36","datavalue":{"value":{"entity-type":"item","numeric-id":1405193,"id":"Q1405193"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q908861$EBECD8C4-558E-47D5-99B3-C687F70F7F4A","rank":"normal"}],"P1460":[{"mainsnak":{"snaktype":"value","property":"P1460","hash":"57f7fea50d2ce1b39b695c4a1313582eed405e38","datavalue":{"value":{"entity-type":"item","numeric-id":5976449,"id":"Q5976449"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q908861$EB4B19EC-E7A8-4AC4-844B-8B0667D897F8","rank":"normal"}],"P223":[{"mainsnak":{"snaktype":"value","property":"P223","hash":"40184808fd93ff0b36dc9c6208cad5cbcf7df881","datavalue":{"value":{"entity-type":"item","numeric-id":5510366,"id":"Q5510366"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q908861$EDE3822B-CD2E-4E69-B17F-8CC37213E3F0","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P223","hash":"771096eacbd8ecbc3cd371619bc85cbb2c2d7025","datavalue":{"value":{"entity-type":"item","numeric-id":2561156,"id":"Q2561156"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q908861$CBC2F534-5318-4EDA-A3C5-76F50B5847AD","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P223","hash":"0459d1a93a135deb9a3f3404173b887fd894a7be","datavalue":{"value":{"entity-type":"item","numeric-id":3266141,"id":"Q3266141"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q908861$0F324928-0039-47A7-B9E4-F362C74B56EC","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P223","hash":"04eca27583481cde504ad29c78bcf037c6d48113","datavalue":{"value":{"entity-type":"item","numeric-id":3770309,"id":"Q3770309"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q908861$531DC6A6-2643-41E4-92D0-7BF131E56959","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P223","hash":"a7e0b29418c91cd254cdedeee66d6826fcfd16f7","datavalue":{"value":{"entity-type":"item","numeric-id":1249538,"id":"Q1249538"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q908861$2BC5BEC9-E86E-43EF-B5E3-BC68DE40A90E","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P223","hash":"ddeb001a7b1609068a3c730c7c5a11482205bc20","datavalue":{"value":{"entity-type":"item","numeric-id":1139525,"id":"Q1139525"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q908861$10093314-278F-42D8-B4CE-3483ED098CF1","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P223","hash":"a708e986aac65478c22f494884263f019c65bf63","datavalue":{"value":{"entity-type":"item","numeric-id":4187617,"id":"Q4187617"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q908861$FEBD9DA7-BD9A-43B0-8A4D-D5B792FB379F","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P223","hash":"c941a46717ecfa1ffe1b07be73298888e9b941ba","datavalue":{"value":{"entity-type":"item","numeric-id":5518989,"id":"Q5518989"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q908861$196CCF70-7355-4198-AED4-D6F1B0A01DE0","rank":"normal"}],"P1643":[{"mainsnak":{"snaktype":"value","property":"P1643","hash":"e2f1b65fd7c2217fb5442041966b29bdb17ceff6","datavalue":{"value":{"entity-type":"item","numeric-id":1091952,"id":"Q1091952"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","qualifiers":{"P1659":[{"snaktype":"value","property":"P1659","hash":"a87dbce3224e46eee74e47930a35e41fe7fd0525","datavalue":{"value":{"amount":"+0.80953175","unit":"1"},"type":"quantity"},"datatype":"quantity"}],"P1660":[{"snaktype":"value","property":"P1660","hash":"ba354e87a58191d58d132c60481c945a3234ce85","datavalue":{"value":{"entity-type":"item","numeric-id":6534273,"id":"Q6534273"},"type":"wikibase-entityid"},"datatype":"wikibase-item"}]},"qualifiers-order":["P1659","P1660"],"id":"Q908861$BE7891AB-69AA-4D6C-B79D-86E741F9C266","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1643","hash":"649fc5b4209201ea5b1f35b3e31adbfd80c0d06c","datavalue":{"value":{"entity-type":"item","numeric-id":1310718,"id":"Q1310718"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","qualifiers":{"P1659":[{"snaktype":"value","property":"P1659","hash":"b4bf67c09ee11b2a9ab67ffa0fae1f171d32d0d4","datavalue":{"value":{"amount":"+0.80771345","unit":"1"},"type":"quantity"},"datatype":"quantity"}],"P1660":[{"snaktype":"value","property":"P1660","hash":"ba354e87a58191d58d132c60481c945a3234ce85","datavalue":{"value":{"entity-type":"item","numeric-id":6534273,"id":"Q6534273"},"type":"wikibase-entityid"},"datatype":"wikibase-item"}]},"qualifiers-order":["P1659","P1660"],"id":"Q908861$D966529F-1B11-45CB-B01B-E84737B7952A","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1643","hash":"0d23f20c4a54a9ef37522f8db5f20e400b3ebd6c","datavalue":{"value":{"entity-type":"item","numeric-id":2367616,"id":"Q2367616"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","qualifiers":{"P1659":[{"snaktype":"value","property":"P1659","hash":"b0ef8a599d791295b014e61509578a7ad03d008f","datavalue":{"value":{"amount":"+0.80083144","unit":"1"},"type":"quantity"},"datatype":"quantity"}],"P1660":[{"snaktype":"value","property":"P1660","hash":"ba354e87a58191d58d132c60481c945a3234ce85","datavalue":{"value":{"entity-type":"item","numeric-id":6534273,"id":"Q6534273"},"type":"wikibase-entityid"},"datatype":"wikibase-item"}]},"qualifiers-order":["P1659","P1660"],"id":"Q908861$A2CB4D74-852D-4E6A-9424-47A56AC19D4C","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1643","hash":"bc9697b968fed6fbe434e9fe821fd816e7f7ccef","datavalue":{"value":{"entity-type":"item","numeric-id":4315289,"id":"Q4315289"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","qualifiers":{"P1659":[{"snaktype":"value","property":"P1659","hash":"4d12531b0300319b52a4d3e1e7c66c394129b577","datavalue":{"value":{"amount":"+0.79340583","unit":"1"},"type":"quantity"},"datatype":"quantity"}],"P1660":[{"snaktype":"value","property":"P1660","hash":"ba354e87a58191d58d132c60481c945a3234ce85","datavalue":{"value":{"entity-type":"item","numeric-id":6534273,"id":"Q6534273"},"type":"wikibase-entityid"},"datatype":"wikibase-item"}]},"qualifiers-order":["P1659","P1660"],"id":"Q908861$EB4DDABE-3165-4C7D-BD24-C7A2ED55C41A","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1643","hash":"44823180b412577061c79b67c471cb294150e8c3","datavalue":{"value":{"entity-type":"item","numeric-id":3757702,"id":"Q3757702"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","qualifiers":{"P1659":[{"snaktype":"value","property":"P1659","hash":"2b3dcf7a35fbe9cd3ed8505b38e895fbddf16804","datavalue":{"value":{"amount":"+0.79242986","unit":"1"},"type":"quantity"},"datatype":"quantity"}],"P1660":[{"snaktype":"value","property":"P1660","hash":"ba354e87a58191d58d132c60481c945a3234ce85","datavalue":{"value":{"entity-type":"item","numeric-id":6534273,"id":"Q6534273"},"type":"wikibase-entityid"},"datatype":"wikibase-item"}]},"qualifiers-order":["P1659","P1660"],"id":"Q908861$E7378F6B-DE71-4A71-89BE-5B418F976794","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1643","hash":"89d24c97fd5a46dc4abe5308930875eff1428ef9","datavalue":{"value":{"entity-type":"item","numeric-id":3832356,"id":"Q3832356"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","qualifiers":{"P1659":[{"snaktype":"value","property":"P1659","hash":"e7be710e1d917efe04060b67eb7d33d65d35f3f6","datavalue":{"value":{"amount":"+0.7889195","unit":"1"},"type":"quantity"},"datatype":"quantity"}],"P1660":[{"snaktype":"value","property":"P1660","hash":"ba354e87a58191d58d132c60481c945a3234ce85","datavalue":{"value":{"entity-type":"item","numeric-id":6534273,"id":"Q6534273"},"type":"wikibase-entityid"},"datatype":"wikibase-item"}]},"qualifiers-order":["P1659","P1660"],"id":"Q908861$D84FAE57-362D-4132-AD2D-76398D740D7D","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1643","hash":"c8f70abd54d349b2714c49c8d7024bc59573fdff","datavalue":{"value":{"entity-type":"item","numeric-id":1335393,"id":"Q1335393"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","qualifiers":{"P1659":[{"snaktype":"value","property":"P1659","hash":"8c2efade2531a8328e56d1772e34a5f897aa2921","datavalue":{"value":{"amount":"+0.78739","unit":"1"},"type":"quantity"},"datatype":"quantity"}],"P1660":[{"snaktype":"value","property":"P1660","hash":"ba354e87a58191d58d132c60481c945a3234ce85","datavalue":{"value":{"entity-type":"item","numeric-id":6534273,"id":"Q6534273"},"type":"wikibase-entityid"},"datatype":"wikibase-item"}]},"qualifiers-order":["P1659","P1660"],"id":"Q908861$32872A05-594A-4CC5-B86F-E09082A15B9B","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1643","hash":"c1e581cf707b6c784d143258173e53030dcbceab","datavalue":{"value":{"entity-type":"item","numeric-id":4888273,"id":"Q4888273"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","qualifiers":{"P1659":[{"snaktype":"value","property":"P1659","hash":"a15bf874e4d7886df41bd1e7aff89fa760422942","datavalue":{"value":{"amount":"+0.78514135","unit":"1"},"type":"quantity"},"datatype":"quantity"}],"P1660":[{"snaktype":"value","property":"P1660","hash":"ba354e87a58191d58d132c60481c945a3234ce85","datavalue":{"value":{"entity-type":"item","numeric-id":6534273,"id":"Q6534273"},"type":"wikibase-entityid"},"datatype":"wikibase-item"}]},"qualifiers-order":["P1659","P1660"],"id":"Q908861$B33AC8FB-62D7-452F-9A21-6AACFF5951E5","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1643","hash":"7623383d1e56a5b6908480681a089c42d66d8c47","datavalue":{"value":{"entity-type":"item","numeric-id":792886,"id":"Q792886"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","qualifiers":{"P1659":[{"snaktype":"value","property":"P1659","hash":"48b1053518d03ece268049431661a6276dccd3d6","datavalue":{"value":{"amount":"+0.78467876","unit":"1"},"type":"quantity"},"datatype":"quantity"}],"P1660":[{"snaktype":"value","property":"P1660","hash":"ba354e87a58191d58d132c60481c945a3234ce85","datavalue":{"value":{"entity-type":"item","numeric-id":6534273,"id":"Q6534273"},"type":"wikibase-entityid"},"datatype":"wikibase-item"}]},"qualifiers-order":["P1659","P1660"],"id":"Q908861$2ABD14EE-BC15-4634-B48E-34429E827703","rank":"normal"}]},"sitelinks":{"mardi":{"site":"mardi","title":"Separable value functions for infinite horizon average reward Markov decision processes","badges":[],"url":"https://portal.mardi4nfdi.de/wiki/Separable_value_functions_for_infinite_horizon_average_reward_Markov_decision_processes"}}}}}