{"entities":{"Q742670":{"pageid":744519,"ns":120,"title":"Item:Q742670","lastrevid":64039491,"modified":"2026-04-11T17:14:06Z","type":"item","id":"Q742670","labels":{"en":{"language":"en","value":"Minimum mutual information and non-Gaussianity through the maximum entropy method: estimation from finite samples"}},"descriptions":{"en":{"language":"en","value":"scientific article; zbMATH DE number 6346088"}},"aliases":{},"claims":{"P31":[{"mainsnak":{"snaktype":"value","property":"P31","hash":"fd5912e4dab4b881a8eb0eb27e7893fef55176ad","datavalue":{"value":{"entity-type":"item","numeric-id":56887,"id":"Q56887"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q742670$18029BD4-C51A-4FF7-ABE1-AF8B8BC51515","rank":"normal"}],"P159":[{"mainsnak":{"snaktype":"value","property":"P159","hash":"93d4449067b672b3e95066955aa529c2be2625c6","datavalue":{"value":{"text":"Minimum mutual information and non-Gaussianity through the maximum entropy method: estimation from finite samples","language":"en"},"type":"monolingualtext"},"datatype":"monolingualtext"},"type":"statement","id":"Q742670$AEAAF768-7E06-4553-8304-6B08E63AADD5","rank":"normal"}],"P225":[{"mainsnak":{"snaktype":"value","property":"P225","hash":"d87e71f80b2eded06e0cd53705665f4893fbcbcc","datavalue":{"value":"1296.62016","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q742670$B01EEBEB-D81A-47EC-8C59-4CEC712531D9","rank":"normal"}],"P16":[{"mainsnak":{"snaktype":"value","property":"P16","hash":"c4654614ccc1b79c785372e392106cf711d0ed70","datavalue":{"value":{"entity-type":"item","numeric-id":406086,"id":"Q406086"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q742670$349EC2E0-9378-41FE-A0A9-06DD47B2DEDA","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P16","hash":"86b0906f3b5d47011016fd611a8144c86982b1a3","datavalue":{"value":{"entity-type":"item","numeric-id":406087,"id":"Q406087"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q742670$00C806B4-F9C7-4F3B-A81C-EF0D4A88613C","rank":"normal"}],"P200":[{"mainsnak":{"snaktype":"value","property":"P200","hash":"5cd7699fb04f6d346a394454e45cb2ba8d87b719","datavalue":{"value":{"entity-type":"item","numeric-id":72504,"id":"Q72504"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q742670$19F6F2C4-3B21-4D31-8D29-0F109099A01A","rank":"normal"}],"P28":[{"mainsnak":{"snaktype":"value","property":"P28","hash":"f90b0a6fd8ec246798cd4dc3af4e3ab8afb6f1a6","datavalue":{"value":{"time":"+2014-09-19T00:00:00Z","timezone":0,"before":0,"after":0,"precision":11,"calendarmodel":"http://www.wikidata.org/entity/Q1985727"},"type":"time"},"datatype":"time"},"type":"statement","id":"Q742670$05E9E458-F11D-42EF-A9FC-283E34C2DD21","rank":"normal"}],"P1448":[{"mainsnak":{"snaktype":"value","property":"P1448","hash":"b80ac367e542d5cd343b20202b09fff33d0d366a","datavalue":{"value":"Summary: The Minimum Mutual Information (MinMI) Principle provides the least committed, maximum-joint-entropy (ME) inferential law that is compatible with prescribed marginal distributions and empirical cross constraints. Here, we estimate MI bounds (the MinMI values) generated by constraining sets \\(\\mathbf T_{cr}\\) comprehended by \\(m_{cr}\\) linear and/or nonlinear joint expectations, computed from samples of \\(N\\) iid outcomes. Marginals (and their entropy) are imposed by single morphisms of the original random variables. \\(N\\)-asymptotic formulas are given both for the distribution of cross expectation's estimation errors, the MinMI estimation bias, its variance and distribution. A growing \\(\\mathbf T_{cr}\\) leads to an increasing MinMI, converging eventually to the total MI. Under \\(N\\)-sized samples, the MinMI increment relative to two encapsulated sets \\(\\mathbf T_{cr1}\\subset\\mathbf T_{cr2}\\) (with numbers of constraints \\(m_{cr1}<m_{cr2}\\)) is the test-difference \\(\\delta H=H_{\\max 1,N}-H_{\\max 2,N}\\geq 0\\) between the two respective estimated MEs. Asymptotically, \\(\\delta H\\) follows a Chi-Squared distribution \\(\\frac{1}{2N}\\chi^2_{(m_{cr2}-m_{cr1})}\\) whose upper quantiles determine if constraints in \\(\\mathbf T_{cr2}/\\mathbf T_{cr1}\\) explain significant extra MI. As an example, we have set marginals to being normally distributed (Gaussian) and have built a sequence of MI bounds, associated to successive non-linear correlations due to joint non-Gaussianity. Noting that in real-world situations available sample sizes can be rather low, the relationship between MinMI bias, probability density over-fitting and outliers is put in evidence for under-sampled data.","type":"string"},"datatype":"string"},"type":"statement","id":"Q742670$85CEC09C-FDE4-4233-BC87-886EC78FE35F","rank":"normal"}],"P226":[{"mainsnak":{"snaktype":"value","property":"P226","hash":"43e8f62905bedd997cf0dbb9ef3fe59e21b4ed65","datavalue":{"value":"62B10","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q742670$98EB5FBA-1229-44D7-BD7F-5C7F06819B74","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P226","hash":"e30d62051793251cdb7305d492b252b2239dfb5e","datavalue":{"value":"94A17","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q742670$6ECEE634-C01B-4605-ABE8-31A5340405B3","rank":"normal"}],"P1451":[{"mainsnak":{"snaktype":"value","property":"P1451","hash":"31775c85fee9f9148fbf8510b8457e742b8e6ad5","datavalue":{"value":"6346088","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q742670$5768BD22-0045-4608-9818-06E8CBB6F311","rank":"normal"}],"P1450":[{"mainsnak":{"snaktype":"value","property":"P1450","hash":"c51857c26a0b6d95e144454001a5ebde294ecbca","datavalue":{"value":"mutual information","type":"string"},"datatype":"string"},"type":"statement","id":"Q742670$B6C17467-07E9-4D86-94B4-62667CEDCCDF","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1450","hash":"a95d4b78fb896c587b7a2f440f84895374e1f1d3","datavalue":{"value":"non-Gaussianity","type":"string"},"datatype":"string"},"type":"statement","id":"Q742670$8CCD0E03-B59B-499B-862B-59C84A73E3AA","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1450","hash":"21075f4355ee4f80e0b9d02184dcdc79dc840678","datavalue":{"value":"maximum entropy distributions","type":"string"},"datatype":"string"},"type":"statement","id":"Q742670$ADAB8E0A-5A4C-4C6C-B1B0-9CBA9BFB14ED","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1450","hash":"5736bb82b5dd92462000c97922c7d228dfe5289d","datavalue":{"value":"entropy bias","type":"string"},"datatype":"string"},"type":"statement","id":"Q742670$3E2DAD57-31B1-4468-962E-79CDA10C5951","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1450","hash":"52df321345ec30f6469585295e8bbc29ebe59fc0","datavalue":{"value":"mutual information distribution","type":"string"},"datatype":"string"},"type":"statement","id":"Q742670$33365119-5189-4666-9911-ECA37048A48E","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1450","hash":"a13b919242f06fff5aa5f4a6a7a5b0b4df0b4588","datavalue":{"value":"morphism","type":"string"},"datatype":"string"},"type":"statement","id":"Q742670$87EE7FDB-EB57-44D3-A0B9-BA73B03A4910","rank":"normal"}],"P1460":[{"mainsnak":{"snaktype":"value","property":"P1460","hash":"57f7fea50d2ce1b39b695c4a1313582eed405e38","datavalue":{"value":{"entity-type":"item","numeric-id":5976449,"id":"Q5976449"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q742670$7EC12483-1AFE-4F1A-9762-FB7010EEF520","rank":"normal"}],"P205":[{"mainsnak":{"snaktype":"value","property":"P205","hash":"508b9e93e169aa9ba32e567506737f4ce6c9be8e","datavalue":{"value":"https://doi.org/10.3390/e15030721","type":"string"},"datatype":"url"},"type":"statement","id":"Q742670$1235EE30-B144-409A-8196-3B88AE99506C","rank":"normal"}],"P388":[{"mainsnak":{"snaktype":"value","property":"P388","hash":"b4020f30162468a28c9301fbadd46fad56970ccd","datavalue":{"value":"W2024993643","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q742670$780BF92E-D444-46DF-A777-A5256135029D","rank":"normal"}],"P12":[{"mainsnak":{"snaktype":"value","property":"P12","hash":"c685df6a32876c81168dd4d00c55d00679f60f8c","datavalue":{"value":"Q64391353","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q742670$DDB015CA-A851-41AA-9331-00444B378BCB","rank":"normal"}],"P223":[{"mainsnak":{"snaktype":"value","property":"P223","hash":"78f0cf2b8270f6087b7bc3862da42dbac9e1bf1f","datavalue":{"value":{"entity-type":"item","numeric-id":88168,"id":"Q88168"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q742670$13876082-509A-4813-8BC8-2DA634D3F55C","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P223","hash":"f900b7afae98f4bf2fea9fe5956a0676b5de55f6","datavalue":{"value":{"entity-type":"item","numeric-id":657482,"id":"Q657482"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q742670$EB5C4443-6831-48CD-9652-D48076C5F420","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P223","hash":"9ca21ad740f14bcec5c91b73eb2f22f347d9b01a","datavalue":{"value":{"entity-type":"item","numeric-id":406088,"id":"Q406088"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q742670$4640F539-3401-4E6B-8520-042F89AE0A55","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P223","hash":"63a30c77116acd209b449b0066cc75d36bfe8862","datavalue":{"value":{"entity-type":"item","numeric-id":4816848,"id":"Q4816848"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q742670$EAC206E1-D973-4C71-8499-1C71273D13D8","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P223","hash":"ab7558a2f6c802651ab4550a304f2c142895dbf6","datavalue":{"value":{"entity-type":"item","numeric-id":4395705,"id":"Q4395705"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q742670$0907FF11-8DDE-47E9-AF15-17AC11F39783","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P223","hash":"732ef510636edcea3a2a9c3055566a66be32c098","datavalue":{"value":{"entity-type":"item","numeric-id":3503764,"id":"Q3503764"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q742670$BFCCA00C-F3B6-4526-BCF3-849D8E09B63E","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P223","hash":"076ed41a18982c68f281bbef0352de180189e802","datavalue":{"value":{"entity-type":"item","numeric-id":1273993,"id":"Q1273993"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q742670$6A5E1262-85DB-4344-AD4B-1183F4045832","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P223","hash":"655abdc6d94f7c7029799a9f3acff3b213cdddb1","datavalue":{"value":{"entity-type":"item","numeric-id":94967,"id":"Q94967"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q742670$0976E24B-6172-4782-937F-939E810EA83B","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P223","hash":"e835e28b9d65d371a4c74491a2ab0b883cc3946f","datavalue":{"value":{"entity-type":"item","numeric-id":957142,"id":"Q957142"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q742670$3238F858-C8D9-48A5-9D7B-9A89F211E699","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P223","hash":"8ebba9f38f836ce9224fc096257cc0a153a516d8","datavalue":{"value":{"entity-type":"item","numeric-id":3867715,"id":"Q3867715"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q742670$D5DC95F1-31D6-4237-AFF6-B78B99045382","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P223","hash":"1faf60e6e13818cfd39336fdc04fb56e6cb3b9df","datavalue":{"value":{"entity-type":"item","numeric-id":1858911,"id":"Q1858911"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q742670$DAE6078B-B32F-48FF-AA2E-88231C94DA5E","rank":"normal"}],"P1635":[{"mainsnak":{"snaktype":"value","property":"P1635","hash":"576564dd387cf3b7b9c4751d17e99912a078e34e","datavalue":{"value":"journals/entropy/PiresP13","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q742670$265486B5-514F-42F2-94ED-417EC17153B5","rank":"normal"}],"P27":[{"mainsnak":{"snaktype":"value","property":"P27","hash":"ea9412cb3862a8861022f23d1ba07dd8d893c248","datavalue":{"value":"10.3390/E15030721","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q742670$2120D52D-66AC-411F-808F-1CCFEF2D919E","rank":"normal"}],"P1643":[{"mainsnak":{"snaktype":"value","property":"P1643","hash":"e09c9210ba1f85b8da99430d2e764ffc5f86cba9","datavalue":{"value":{"entity-type":"item","numeric-id":406088,"id":"Q406088"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","qualifiers":{"P1659":[{"snaktype":"value","property":"P1659","hash":"f27e7afa5b61fff85fb66b444b23d0f0dc8c473a","datavalue":{"value":{"amount":"+0.8975153565406799","unit":"1"},"type":"quantity"},"datatype":"quantity"}],"P1660":[{"snaktype":"value","property":"P1660","hash":"a327a09ea0305e98d5cf33bd4036320e19f2aed0","datavalue":{"value":{"entity-type":"item","numeric-id":6821328,"id":"Q6821328"},"type":"wikibase-entityid"},"datatype":"wikibase-item"}]},"qualifiers-order":["P1659","P1660"],"id":"Q742670$1E777FF5-7B24-46CB-BDA4-AA9F528C1CE8","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1643","hash":"e9a612e2b9b7685de0ef8cab496917e24f8a441c","datavalue":{"value":{"entity-type":"item","numeric-id":4816848,"id":"Q4816848"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","qualifiers":{"P1659":[{"snaktype":"value","property":"P1659","hash":"2565fafa2683a04c4f1f763ef8c460551b02dca6","datavalue":{"value":{"amount":"+0.7592695951461792","unit":"1"},"type":"quantity"},"datatype":"quantity"}],"P1660":[{"snaktype":"value","property":"P1660","hash":"a327a09ea0305e98d5cf33bd4036320e19f2aed0","datavalue":{"value":{"entity-type":"item","numeric-id":6821328,"id":"Q6821328"},"type":"wikibase-entityid"},"datatype":"wikibase-item"}]},"qualifiers-order":["P1659","P1660"],"id":"Q742670$FBC4B698-A865-4C8B-8F23-C877FD8B39EA","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1643","hash":"14ece1292184e9e6f326b714be6b03846aa378e6","datavalue":{"value":{"entity-type":"item","numeric-id":906214,"id":"Q906214"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","qualifiers":{"P1659":[{"snaktype":"value","property":"P1659","hash":"11e6d8521c8a5293ed6cd52f08abd3f82c4fe9e9","datavalue":{"value":{"amount":"+0.740495502948761","unit":"1"},"type":"quantity"},"datatype":"quantity"}],"P1660":[{"snaktype":"value","property":"P1660","hash":"a327a09ea0305e98d5cf33bd4036320e19f2aed0","datavalue":{"value":{"entity-type":"item","numeric-id":6821328,"id":"Q6821328"},"type":"wikibase-entityid"},"datatype":"wikibase-item"}]},"qualifiers-order":["P1659","P1660"],"id":"Q742670$D3C2F8A3-95C1-4E8E-8592-9EC1434241A8","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1643","hash":"e55f1d63f073b887dbbb09465a4250414f80f122","datavalue":{"value":{"entity-type":"item","numeric-id":280732,"id":"Q280732"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","qualifiers":{"P1659":[{"snaktype":"value","property":"P1659","hash":"1e0c7cf94f8dd92c94244d65f004bbc64f78fb19","datavalue":{"value":{"amount":"+0.7376219034194946","unit":"1"},"type":"quantity"},"datatype":"quantity"}],"P1660":[{"snaktype":"value","property":"P1660","hash":"a327a09ea0305e98d5cf33bd4036320e19f2aed0","datavalue":{"value":{"entity-type":"item","numeric-id":6821328,"id":"Q6821328"},"type":"wikibase-entityid"},"datatype":"wikibase-item"}]},"qualifiers-order":["P1659","P1660"],"id":"Q742670$1EC7D399-6516-430A-9726-9A2BF71B54D5","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1643","hash":"73295c4b1561b5fb8c0e009b93be8e6deb519c5f","datavalue":{"value":{"entity-type":"item","numeric-id":957142,"id":"Q957142"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","qualifiers":{"P1659":[{"snaktype":"value","property":"P1659","hash":"77b4669c540ab12b6772b0498a6c8fe92b0f208d","datavalue":{"value":{"amount":"+0.7337685227394104","unit":"1"},"type":"quantity"},"datatype":"quantity"}],"P1660":[{"snaktype":"value","property":"P1660","hash":"a327a09ea0305e98d5cf33bd4036320e19f2aed0","datavalue":{"value":{"entity-type":"item","numeric-id":6821328,"id":"Q6821328"},"type":"wikibase-entityid"},"datatype":"wikibase-item"}]},"qualifiers-order":["P1659","P1660"],"id":"Q742670$346BFF9F-FF3D-404E-94AF-CE3DEAEE3966","rank":"normal"}]},"sitelinks":{"mardi":{"site":"mardi","title":"Minimum mutual information and non-Gaussianity through the maximum entropy method: estimation from finite samples","badges":[],"url":"https://portal.mardi4nfdi.de/wiki/Minimum_mutual_information_and_non-Gaussianity_through_the_maximum_entropy_method:_estimation_from_finite_samples"}}}}}