Conditional Entropy

version 1.0.0.0 (1.38 KB) by Will Dwinnell
Calculates the conditional entropy of a discrete variable, given other discrete variables.

2.4K Downloads

Updated Sun, 12 Sep 2010 10:42:42 +0000

View License

ConditionalEntropy: Calculates conditional entropy (in bits) of Y, given X

H = ConditionalEntropy(Y,X)

H = calculated entropy of Y, given X (in bits)
Y = dependent variable (column vector)
X = independent variable(s)

Note 1: Each distinct value is considered a unique symbol.

Note 2: requires 'Entropy' and 'MutualInformation' functions

Example: 'X' (1 bit of entropy), 'Y' (2 bits of entropy)
Given 'X', 'Y's conditional entropy is 1 bit.

Note: Estimated entropy values are slightly less than true, due to finite sample size.

Y = ceil(4 * rand(1e3,1)); X = double(Y <= 2);
ConditionalEntropy(Y,X)

Cite As

Will Dwinnell (2022). Conditional Entropy (https://www.mathworks.com/matlabcentral/fileexchange/28693-conditional-entropy), MATLAB Central File Exchange. Retrieved .

MATLAB Release Compatibility
Created with R12
Compatible with any release
Platform Compatibility
Windows macOS Linux

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!