Information Theory – Chapter 3: Important Inequality
Data Processing Inequality Let X\rightarrow Y\rightarrow Z form a Markov chain if P_{XYZ}(x,y,z)=P_X…
Information Theory – Chapter 1: Entropy
This chapter introduce the definition of entropy, joint entropy, conditional entropy, relative entro…