Entropy

Entropy: A Measure of Uncertainty

Entropy of a random  variable measures uncertainty  inherent to possible outcomes of the variable. H(X)= -Σin    pilog2pi , where i=1, 2, 3 , 4, …..,n Where pi  are probabilities of associated events. Take an example of tossing two coins, then you will have sample space . S={T,H} And X is defined as number of […]

Entropy: A Measure of Uncertainty Read More »