## Conditional Entropy

Version 1.0.0.0 (1.38 KB) by
Calculates the conditional entropy of a discrete variable, given other discrete variables.

2.4K Downloads

Updated Sun, 12 Sep 2010 10:42:42 +0000

View License

ConditionalEntropy: Calculates conditional entropy (in bits) of Y, given X

H = ConditionalEntropy(Y,X)

H = calculated entropy of Y, given X (in bits)
Y = dependent variable (column vector)
X = independent variable(s)

Note 1: Each distinct value is considered a unique symbol.

Note 2: requires 'Entropy' and 'MutualInformation' functions

Example: 'X' (1 bit of entropy), 'Y' (2 bits of entropy)
Given 'X', 'Y's conditional entropy is 1 bit.

Note: Estimated entropy values are slightly less than true, due to finite sample size.

Y = ceil(4 * rand(1e3,1)); X = double(Y <= 2);
ConditionalEntropy(Y,X)

### Cite As

Will Dwinnell (2023). Conditional Entropy (https://www.mathworks.com/matlabcentral/fileexchange/28693-conditional-entropy), MATLAB Central File Exchange. Retrieved .

##### MATLAB Release Compatibility
Created with R12
Compatible with any release
##### Platform Compatibility
Windows macOS Linux

### Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!
Version Published Release Notes
1.0.0.0