H measures the variety among the elements in any set. Chapter 3 introduced two ways to calculate H, Hmax and Hobs. In Chapter 4, these two quantities will provide a basis for estimating the [Page 33]degree to which structural constraints on the way a code uses its elements reduces the amount that can be communicated by using the code. Hmax measures the maximum variety that would be observed if all elements appeared with equal probability, and Hobs measures the variety of actual observations: The difference between these two quantities is redundancy, the reduction in the efficiency of the code due to constraints on the use of its elements. Redundancy is useful for analyzing the trade-off between efficiency ...
Redundancy: How Structure Affects Variety
Redundancy: How structure affects variety