Computer Science - Information Theory

Information Decomposition Diagrams Applied beyond Shannon Entropy: A Generalization of Hu's Theorem
We generalize information diagrams to functions beyond Shannon entropy, including Kolmogorov complexity and the generalization error from machine learning.
Leon Lang, Pierre Baudot, Rick Quax, Patrick Forré
PDF Cite arXiv
Information Decomposition Diagrams Applied beyond Shannon Entropy: A Generalization of Hu's Theorem