Information Theory Toolbox

Version (4.25 KB) by Mo Chen
Functions for Information theory, such as entropy, mutual information, KL divergence, etc
Updated Mon, 07 Mar 2016 11:53:05 +0000

View License

This toolbox contains functions for DISCRETE random variables to compute following quantities:
2)Joint entropy
3)Conditional entropy
4)Relative entropy (KL divergence)
5)Mutual information
6)Normalized mutual information
7)Normalized variation information
This package is now a part of the PRML toolbox (

Cite As

Mo Chen (2024). Information Theory Toolbox (, MATLAB Central File Exchange. Retrieved .

MATLAB Release Compatibility
Created with R2011b
Compatible with any release
Platform Compatibility
Windows macOS Linux

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!
Version Published Release Notes

minor tweak, more demos