Vidyalelo
ECE · Q111

Information Theory And Coding

Engineering and GATE · ECE · question 111

Q111

A discrete memory less source has two symbols x1 and x2 with probabilities p(x1) and p(x2) respectively, then the entropy of the source H(X) is

A.
H(X) = p(x1)log10p(x1) + p(x2)log10p(x2)
B.
H(X) = -p(x1)log10p(x1) - p(x2)log10p(x2)
C.
H(X) = -p(x1)log2p(x1) - p(x2)log2p (x2)
Answer
D.
H(X) = p(x1)log2p(x1) + p(x2)log2p(x2)

Answer: Option C

Solution

Answer: Option C
No explanation is given for this question Let's Discuss on Board