Redundancy

A measure of the possible increase in the transmission rate of information by using a statistical dependence between the components of the information processed at the source of information. The redundancy of a stationary source of information in discrete time processing the information generated by a stationary stochastic process

where takes values in some finite set with elements, is defined to be

where is the rate of generation of information by the given source (see Information, rate of generation of) and is the maximum possible speed of generation of information by a source in discrete time whose components take different values.

For references, see ,

at Communication channel.