{"entities":{"Q742724":{"pageid":744573,"ns":120,"title":"Item:Q742724","lastrevid":64039947,"modified":"2026-04-11T17:14:14Z","type":"item","id":"Q742724","labels":{"en":{"language":"en","value":"Bayesian and quasi-Bayesian estimators for mutual information from discrete data"}},"descriptions":{"en":{"language":"en","value":"scientific article; zbMATH DE number 6346138"}},"aliases":{},"claims":{"P31":[{"mainsnak":{"snaktype":"value","property":"P31","hash":"fd5912e4dab4b881a8eb0eb27e7893fef55176ad","datavalue":{"value":{"entity-type":"item","numeric-id":56887,"id":"Q56887"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q742724$9BD66A1A-180E-48C0-AC85-B61DA078405B","rank":"normal"}],"P159":[{"mainsnak":{"snaktype":"value","property":"P159","hash":"7bac6f036ba4200ab78082dd5b7ffce6e00e1d52","datavalue":{"value":{"text":"Bayesian and quasi-Bayesian estimators for mutual information from discrete data","language":"en"},"type":"monolingualtext"},"datatype":"monolingualtext"},"type":"statement","id":"Q742724$3B9BD4C0-FB60-4CFC-96F3-FB3149F35AF3","rank":"normal"}],"P225":[{"mainsnak":{"snaktype":"value","property":"P225","hash":"0ebe64dc2be6ec42a1f54dffe00d2a18da18c684","datavalue":{"value":"1296.62054","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q742724$FFFBD108-70A5-48FE-82C3-ACDE98FD3881","rank":"normal"}],"P16":[{"mainsnak":{"snaktype":"value","property":"P16","hash":"875c12ffccbb32d9203144d34a2e1d7dc29bbb31","datavalue":{"value":{"entity-type":"item","numeric-id":742721,"id":"Q742721"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q742724$2B7C9A75-2E40-4927-ACC3-DA65C18D4250","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P16","hash":"2ad2165ab6e43b2bd1c881ce8f130c2d9716d081","datavalue":{"value":{"entity-type":"item","numeric-id":742722,"id":"Q742722"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q742724$C0FEB804-6239-414C-B017-1236F5A616B7","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P16","hash":"c596795fca069226aafdd05558ccc735a6d33f9c","datavalue":{"value":{"entity-type":"item","numeric-id":742723,"id":"Q742723"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q742724$F56A3DC6-A6E0-4036-8A36-1A05AB54A7B7","rank":"normal"}],"P200":[{"mainsnak":{"snaktype":"value","property":"P200","hash":"5cd7699fb04f6d346a394454e45cb2ba8d87b719","datavalue":{"value":{"entity-type":"item","numeric-id":72504,"id":"Q72504"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q742724$E7179635-D4B2-4DD8-B316-B72A52E5A5C5","rank":"normal"}],"P28":[{"mainsnak":{"snaktype":"value","property":"P28","hash":"f90b0a6fd8ec246798cd4dc3af4e3ab8afb6f1a6","datavalue":{"value":{"time":"+2014-09-19T00:00:00Z","timezone":0,"before":0,"after":0,"precision":11,"calendarmodel":"http://www.wikidata.org/entity/Q1985727"},"type":"time"},"datatype":"time"},"type":"statement","id":"Q742724$93CA81F0-3493-4280-86B0-913556E6FBD2","rank":"normal"}],"P1448":[{"mainsnak":{"snaktype":"value","property":"P1448","hash":"05eba094816857433e8ada311b954abe838fe4a3","datavalue":{"value":"Summary: Mutual information (MI) quantifies the statistical dependency between a pair of random variables, and plays a central role in the analysis of engineering and biological systems. Estimation of MI is difficult due to its dependence on an entire joint distribution, which is difficult to estimate from samples. Here we discuss several regularized estimators for MI that employ priors based on the Dirichlet distribution. First, we discuss three ``quasi-Bayesian'' estimators that result from linear combinations of Bayesian estimates for conditional and marginal entropies. We show that these estimators are not in fact Bayesian, and do not arise from a well-defined posterior distribution and may in fact be negative. Second, we show that a fully Bayesian MI estimator proposed by Hutter (2002), which relies on a fixed Dirichlet prior, exhibits strong prior dependence and has large bias for small datasets. Third, we formulate a novel Bayesian estimator using a mixture-of-Dirichlets prior, with mixing weights designed to produce an approximately flat prior over MI. We examine the performance of these estimators with a variety of simulated datasets and show that, surprisingly, quasi-Bayesian estimators generally outperform our Bayesian estimator. We discuss outstanding challenges for MI estimation and suggest promising avenues for future research.","type":"string"},"datatype":"string"},"type":"statement","id":"Q742724$887F66A3-004C-4735-937E-9C304E50FBDE","rank":"normal"}],"P226":[{"mainsnak":{"snaktype":"value","property":"P226","hash":"2474c99ceba943e04dda4ddfffedfe45f5fdfd62","datavalue":{"value":"62F15","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q742724$45E1F9D7-B167-4CBC-924E-01E1BCD31DC2","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P226","hash":"43e8f62905bedd997cf0dbb9ef3fe59e21b4ed65","datavalue":{"value":"62B10","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q742724$3A31A46E-6602-4545-8F36-6D65A2D00E39","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P226","hash":"e30d62051793251cdb7305d492b252b2239dfb5e","datavalue":{"value":"94A17","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q742724$60BEC62E-6C29-4B33-BC86-91D194CDB780","rank":"normal"}],"P1451":[{"mainsnak":{"snaktype":"value","property":"P1451","hash":"e7253494030e361dc594eebbed37f68855e372fd","datavalue":{"value":"6346138","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q742724$3E9932A1-7A76-400D-A014-45BBF197F504","rank":"normal"}],"P1450":[{"mainsnak":{"snaktype":"value","property":"P1450","hash":"c51857c26a0b6d95e144454001a5ebde294ecbca","datavalue":{"value":"mutual information","type":"string"},"datatype":"string"},"type":"statement","id":"Q742724$DACEB760-3C5E-4F6A-82CF-2D4242A6F941","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1450","hash":"1c2e069b1a2184cd3b0f52ffa83b5fcb89125e86","datavalue":{"value":"entropy","type":"string"},"datatype":"string"},"type":"statement","id":"Q742724$02EDF790-544A-4AD7-8D19-3A59AC4F39BA","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1450","hash":"e724002d81498ba6fa07082f9036851805316029","datavalue":{"value":"Dirichlet distribution","type":"string"},"datatype":"string"},"type":"statement","id":"Q742724$EF2F9334-8E47-4F63-91F1-38A363D30B62","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1450","hash":"3fd739f59b784a7fcb422ea22dd3d7f488c48dc8","datavalue":{"value":"Bayes least squares","type":"string"},"datatype":"string"},"type":"statement","id":"Q742724$7216A586-FF6B-4E86-BE4A-2952E2C4B342","rank":"normal"}],"P1460":[{"mainsnak":{"snaktype":"value","property":"P1460","hash":"57f7fea50d2ce1b39b695c4a1313582eed405e38","datavalue":{"value":{"entity-type":"item","numeric-id":5976449,"id":"Q5976449"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q742724$BCF3BE30-3EFC-44D8-ADE0-C775E7EF9D26","rank":"normal"}],"P205":[{"mainsnak":{"snaktype":"value","property":"P205","hash":"026ed9468ae794c5ced2dcdae7b7b3165d7ac5f9","datavalue":{"value":"https://doi.org/10.3390/e15051738","type":"string"},"datatype":"url"},"type":"statement","id":"Q742724$56AFDFC8-01B5-4539-820A-0FABD5056C00","rank":"normal"}],"P388":[{"mainsnak":{"snaktype":"value","property":"P388","hash":"47a8f9f049ad4b3c04b8034635649867526d17a4","datavalue":{"value":"W2122477496","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q742724$9479485A-14B5-40C6-84FD-5AB024E5F801","rank":"normal"}],"P12":[{"mainsnak":{"snaktype":"value","property":"P12","hash":"9602fe959ce2a76a2583d33cae2cb0b1d6d5ee43","datavalue":{"value":"Q63987882","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q742724$F5FAE992-A7FB-42FB-9ABC-5FF8B1A4447E","rank":"normal"}],"P223":[{"mainsnak":{"snaktype":"value","property":"P223","hash":"82574a3db0582779a1c11099371f4dabb6d226cc","datavalue":{"value":{"entity-type":"item","numeric-id":3266068,"id":"Q3266068"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q742724$B0E389C8-CE89-4FA9-ACAC-835DA9B84A64","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P223","hash":"0a46076ac7cbf22737e1ef14e8d9b3db277d86ca","datavalue":{"value":{"entity-type":"item","numeric-id":5550283,"id":"Q5550283"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q742724$658C0A29-DDDC-4047-9DAA-E7165946E12A","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P223","hash":"a3efba1b62f796b7b1114c0f9c34f4b6390b6fb4","datavalue":{"value":{"entity-type":"item","numeric-id":4397008,"id":"Q4397008"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q742724$4B45A5B6-A9E2-4034-9361-833B435A8D6D","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P223","hash":"63a30c77116acd209b449b0066cc75d36bfe8862","datavalue":{"value":{"entity-type":"item","numeric-id":4816848,"id":"Q4816848"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q742724$5F94DE75-BAC5-4FC1-A136-61A38D2D89C7","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P223","hash":"d90fbf6b402c35112e68fe51347813be5d541d54","datavalue":{"value":{"entity-type":"item","numeric-id":4819825,"id":"Q4819825"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q742724$CB548323-1832-43D6-87E5-F8F041868BE0","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P223","hash":"299275e943ecd5dc2dc2e35bf578b42463ea85d4","datavalue":{"value":{"entity-type":"item","numeric-id":3025070,"id":"Q3025070"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q742724$771E8768-E190-4368-AE2A-AAA0D23B7E54","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P223","hash":"eba689885258e2fdfc0b08206c5eb595c8c4189c","datavalue":{"value":{"entity-type":"item","numeric-id":5457581,"id":"Q5457581"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q742724$62566832-2DEF-4268-897E-CF92E2F2F3EC","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P223","hash":"bb7843f2eb4b24ce50784e05c968d9e88ce482a9","datavalue":{"value":{"entity-type":"item","numeric-id":5441302,"id":"Q5441302"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q742724$EA1A5FA1-B97C-4010-8B15-F1356BECBB3A","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P223","hash":"053f838f33fb2200cfdf92af6646bd54b7b12e83","datavalue":{"value":{"entity-type":"item","numeric-id":3613610,"id":"Q3613610"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q742724$94A1228A-DCE9-475E-BA1F-57FE4E75C8C4","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P223","hash":"e835e28b9d65d371a4c74491a2ab0b883cc3946f","datavalue":{"value":{"entity-type":"item","numeric-id":957142,"id":"Q957142"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","id":"Q742724$8A469136-16C0-40DF-8B31-3B9FF67F6E1F","rank":"normal"}],"P27":[{"mainsnak":{"snaktype":"value","property":"P27","hash":"0154d212aefa5214d94684becea359acc4e640ac","datavalue":{"value":"10.3390/E15051738","type":"string"},"datatype":"external-id"},"type":"statement","id":"Q742724$50B26640-6E71-49E6-A1E2-D827328E5FF0","rank":"normal"}],"P1643":[{"mainsnak":{"snaktype":"value","property":"P1643","hash":"14ece1292184e9e6f326b714be6b03846aa378e6","datavalue":{"value":{"entity-type":"item","numeric-id":906214,"id":"Q906214"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","qualifiers":{"P1659":[{"snaktype":"value","property":"P1659","hash":"a9e9a3614cb481dd72f57307a82ca4860d4ac216","datavalue":{"value":{"amount":"+0.7981249690055847","unit":"1"},"type":"quantity"},"datatype":"quantity"}],"P1660":[{"snaktype":"value","property":"P1660","hash":"a327a09ea0305e98d5cf33bd4036320e19f2aed0","datavalue":{"value":{"entity-type":"item","numeric-id":6821328,"id":"Q6821328"},"type":"wikibase-entityid"},"datatype":"wikibase-item"}]},"qualifiers-order":["P1659","P1660"],"id":"Q742724$10267C46-7D49-4963-9227-A2D2EDD3BB21","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1643","hash":"73295c4b1561b5fb8c0e009b93be8e6deb519c5f","datavalue":{"value":{"entity-type":"item","numeric-id":957142,"id":"Q957142"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","qualifiers":{"P1659":[{"snaktype":"value","property":"P1659","hash":"3e8e3b1b486efa56a80ce2975cda60502d206be6","datavalue":{"value":{"amount":"+0.7950605750083923","unit":"1"},"type":"quantity"},"datatype":"quantity"}],"P1660":[{"snaktype":"value","property":"P1660","hash":"a327a09ea0305e98d5cf33bd4036320e19f2aed0","datavalue":{"value":{"entity-type":"item","numeric-id":6821328,"id":"Q6821328"},"type":"wikibase-entityid"},"datatype":"wikibase-item"}]},"qualifiers-order":["P1659","P1660"],"id":"Q742724$4C04F295-48C6-4405-BF91-ADEACCEC44F3","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1643","hash":"e9a612e2b9b7685de0ef8cab496917e24f8a441c","datavalue":{"value":{"entity-type":"item","numeric-id":4816848,"id":"Q4816848"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","qualifiers":{"P1659":[{"snaktype":"value","property":"P1659","hash":"81ee8bc8d7f7c503abe03cf7ef173aeebab7b87b","datavalue":{"value":{"amount":"+0.7875588536262512","unit":"1"},"type":"quantity"},"datatype":"quantity"}],"P1660":[{"snaktype":"value","property":"P1660","hash":"a327a09ea0305e98d5cf33bd4036320e19f2aed0","datavalue":{"value":{"entity-type":"item","numeric-id":6821328,"id":"Q6821328"},"type":"wikibase-entityid"},"datatype":"wikibase-item"}]},"qualifiers-order":["P1659","P1660"],"id":"Q742724$F434A5D9-EB06-42E9-A769-9C9C6C131567","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1643","hash":"5459cd3d2f69b5d6a00d8ce0cd4de8b4a0d72c6d","datavalue":{"value":{"entity-type":"item","numeric-id":3508114,"id":"Q3508114"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","qualifiers":{"P1659":[{"snaktype":"value","property":"P1659","hash":"87f80b7d443e1578646b8e0dd29d6fbb8b1e93bd","datavalue":{"value":{"amount":"+0.7679978609085083","unit":"1"},"type":"quantity"},"datatype":"quantity"}],"P1660":[{"snaktype":"value","property":"P1660","hash":"a327a09ea0305e98d5cf33bd4036320e19f2aed0","datavalue":{"value":{"entity-type":"item","numeric-id":6821328,"id":"Q6821328"},"type":"wikibase-entityid"},"datatype":"wikibase-item"}]},"qualifiers-order":["P1659","P1660"],"id":"Q742724$2E2822AC-B1B6-40F0-9E38-A55085A5E846","rank":"normal"},{"mainsnak":{"snaktype":"value","property":"P1643","hash":"4858f1cccc8b7c01d5ff31cbf34f282e739d77c2","datavalue":{"value":{"entity-type":"item","numeric-id":4967504,"id":"Q4967504"},"type":"wikibase-entityid"},"datatype":"wikibase-item"},"type":"statement","qualifiers":{"P1659":[{"snaktype":"value","property":"P1659","hash":"0fb22b16cbe082ae6a951e224338da7db46a9e7c","datavalue":{"value":{"amount":"+0.7656617164611816","unit":"1"},"type":"quantity"},"datatype":"quantity"}],"P1660":[{"snaktype":"value","property":"P1660","hash":"a327a09ea0305e98d5cf33bd4036320e19f2aed0","datavalue":{"value":{"entity-type":"item","numeric-id":6821328,"id":"Q6821328"},"type":"wikibase-entityid"},"datatype":"wikibase-item"}]},"qualifiers-order":["P1659","P1660"],"id":"Q742724$B4B00B1A-6F67-4CBC-A7D9-937A9F1571C2","rank":"normal"}]},"sitelinks":{"mardi":{"site":"mardi","title":"Bayesian and quasi-Bayesian estimators for mutual information from discrete data","badges":[],"url":"https://portal.mardi4nfdi.de/wiki/Bayesian_and_quasi-Bayesian_estimators_for_mutual_information_from_discrete_data"}}}}}