| dc.contributor.advisor | Wibral, Michael Prof. Dr. | |
| dc.contributor.author | Schick-Poland, Kyle | |
| dc.date.accessioned | 2025-09-17T17:53:48Z | |
| dc.date.available | 2025-09-23T00:50:07Z | |
| dc.date.issued | 2025-09-17 | |
| dc.identifier.uri | http://resolver.sub.uni-goettingen.de/purl?ediss-11858/16236 | |
| dc.identifier.uri | http://dx.doi.org/10.53846/goediss-11518 | |
| dc.format.extent | 129 | de |
| dc.language.iso | eng | de |
| dc.rights.uri | http://creativecommons.org/licenses/by/4.0/ | |
| dc.subject.ddc | 530 | de |
| dc.title | A Measure-Theoretic Perspective on Multivariate Information with Applications to Data Science | de |
| dc.type | doctoralThesis | de |
| dc.contributor.referee | Wolf, Fred Prof. Dr. | |
| dc.date.examination | 2024-10-23 | de |
| dc.subject.gok | Physik (PPN621336750) | de |
| dc.description.abstracteng | This dissertation establishes a measure-theoretic foundation for information theory by formulating entropy, mutual information, and related quantities on a common type of probability spaces. Using Radon–Nikodym derivatives of induced probability measures, and Lebesgue integration, it extends Shannon’s framework beyond discrete variables to continuous and mixed distributions in a mathematically consistent manner.
The main contribution is the introduction of Partial Information Decomposition (PID) within this framework. While continuous PID measures exist, they suffer from limited generality. Here, unique, redundant, and synergistic information are defined as functionals on measurable spaces, expressed via Radon–Nikodym derivatives of conditional probability measures with respect to product measures on σ-algebras. This establishes a PID based on redundancy rigorously across arbitrary measurable spaces.
The measure-theoretic extension of TE is expressed in terms of conditional Radon–Nikodym derivatives on product σ-algebras, yielding a generalized quantification of directional information flow in stochastic processes.
Building on this, new k-nearest neighbour estimators are derived for PID and Transfer Entropy (TE). These estimators extend the Kraskov–Stögbauer–Grassberger (KSG) method to assess the respective information terms in continuous and mixed distributions, with empirical proofs of convergence relying on the law of large numbers.
By unifying discrete, continuous, and mixed settings under a σ-algebraic formalism and deriving provably convergent estimators, this work advances the mathematical foundations of information decomposition and informative measures, providing a rigorous framework for future developments in modern information theory. | de |
| dc.contributor.coReferee | Sturm, Anja Prof. Dr. | |
| dc.contributor.thirdReferee | Niemeyer, Jens Prof. Dr. | |
| dc.contributor.thirdReferee | Klumpp, Stefan Prof. Dr. | |
| dc.contributor.thirdReferee | Enderlein, Jörg Prof. Dr. | |
| dc.subject.eng | Information Theory | de |
| dc.subject.eng | Partial Information Decomposition | de |
| dc.subject.eng | Transfer Entropy | de |
| dc.subject.eng | Estimation | de |
| dc.subject.eng | Measure Theory | de |
| dc.identifier.urn | urn:nbn:de:gbv:7-ediss-16236-8 | |
| dc.affiliation.institute | Fakultät für Physik | de |
| dc.description.embargoed | 2025-09-22 | de |
| dc.identifier.ppn | 1936215853 | |
| dc.notes.confirmationsent | Confirmation sent 2025-09-17T19:45:01 | de |