Random Data Classification

Create and classify random data sets

This toolbox (or set of functions) can be used to create random data sets, assign virtual labels and then run a classification algorithm on the data. In theory such a classification should fail since the data is random. In practice, the chance level depends, among other things, on sample size (the size of the data). The provided tools illusrate the possibility of exceeding theoretical chance levels (e.g. 50% decoding in a 2-class calssification) by chance.

To this end, we propose a number of Matlab routines that can be used in the following order:
- b_Create_random_dataset: generates random data
- c_Classify_Datasets: classifes the random data and plots the decoding % as a function of sample size
- d_Statistic_binomial_distribution: computes the statistical chance level using the cumulative binomial distribution function
- e_Statistic_permutations: computes a statistical chance level using permutations (non-parametric test)