In a communication system each message (0 or 1) is transmitted three times in order to reduce the probability of error. The detection is based on the majority rule at the receiver. If pe is the probability of bit error, the probability of error for this communication system is
A source generates one of the five symbols s1, s2, s3, s4 and s5 once in every 601 second. The symbols are assumed to be independent and occur with probabilities 41,41,41,81&81. The average information rate of the source in bits/second is:
Discrete source S1 has 4 equiprobable symbols while discrete source S2 has 16 equiprobable symbols. When the entropy of these two sources is compared, entropy of
A communication channel has a bandwidth of 100 MHz. The channel is extremely noisy such that the signal power is very much below the noise power. What is the capacity of this channel?
An image uses 512 × 512 picture elements. Each of the picture elements can take any of the 8 distinguishable intensity levels. The maximum entropy in the above image will be
A source produces 4 symbols with probabilities 21, 41, 81 and 81. For this source, a practical coding scheme has an average code word length of 2 bits/symbol. The efficiency of the code is:
A source generates four messages m1, m2, m3 and m4, with probabilities 0.5, 0.25, 0.125 and 0.125 respectively. The messages are generated independently of each other. A source coder assigns binary code to each message. Which of the following codes has minimum average length and is also uniquely decodable (sequence as per m1, m2, m3, m4)?