dnner

Python library dnner - DNNs Entropy from Replicas. The code in this package computes the entropy, mutual information and MMSE of multi-layer GLMs given orthogonally-invariant matrices of arbitrary spectrum. More details available in arXiv:1805.09785 and our published NeurIPS 2018 paper