I.06 / Shannon information and communication
Calculate uncertainty for two binary sources.
A fair binary source has entropy of one bit per symbol. If one outcome occurs with probability 0.9 and the other with 0.1, the binary entropy is about 0.469 bits. Generate short illustrative sequences with these settings, compare their symbol counts, and examine why a short sample may differ noticeably from the generating probabilities.
