Vidyalelo
ECE · all questions

Information Theory And Coding
practice.

Practice every MCQ with options. Use Show answers when you want the correct option and solution.

232

Questions

10/12

Page

Pick an option on a question to see the right answer and solution.

In a communication system each message (0 or 1) is transmitted three times in order to reduce the probability of error. The detection is based on the majority rule at the receiver. If pe is the probability of bit error, the probability of error for this communication system is

Select an option to see the answer and solution.

Consider a source with four symbols. The entropy of the source will be maximum when probabilities of occurrence of symbols are:

Select an option to see the answer and solution.

A source generates one of the five symbols s1, s2, s3, s4 and s5 once in every second. The symbols are assumed to be independent and occur with probabilities    The average information rate of the source in bits/second is:

Select an option to see the answer and solution.

The relation between entropy and mutual information is

Select an option to see the answer and solution.

Blocking probability of a 3 stage switch in term of inlet utilization P

Select an option to see the answer and solution.

A communication channel with Additive white Gaussian Noise, has a bandwidth of 4 kHz and SNR of 31 dB. Its channel capacity is

Select an option to see the answer and solution.

Discrete source S1 has 4 equiprobable symbols while discrete source S2 has 16 equiprobable symbols. When the entropy of these two sources is compared, entropy of

Select an option to see the answer and solution.

Information is

Select an option to see the answer and solution.

Which statement is not correct?

Select an option to see the answer and solution.

A communication channel has a bandwidth of 100 MHz. The channel is extremely noisy such that the signal power is very much below the noise power. What is the capacity of this channel?

Select an option to see the answer and solution.

The information capacity (bits/sec) of a channel with bandwidth W MHz and transmission time T is given by

Select an option to see the answer and solution.

A binary source in which 0's occurs 3 times as often as 1's. Then its entropy in bits/symbol will be

Select an option to see the answer and solution.

Match List-I with List-II and select the correct answer using the options given below the lists:
List-I (Theorem/law) List-II (Specified Quantity)
a. Shannon source theorem 1. Channel capacity coding
b. Dimensionality theorem 2. Storage space of a signal
c. Wiener-Kintchine theorem 3. Power spectral density of random process
d. Shannon-Hartley law 4. Optimum code length

Select an option to see the answer and solution.

An image uses 512 × 512 picture elements. Each of the picture elements can take any of the 8 distinguishable intensity levels. The maximum entropy in the above image will be

Select an option to see the answer and solution.

Shannon Hartley law

Select an option to see the answer and solution.

A source produces 4 symbols with probabilities , , and . For this source, a practical coding scheme has an average code word length of 2 bits/symbol. The efficiency of the code is:

Select an option to see the answer and solution.

A source generates four messages m1, m2, m3 and m4, with probabilities 0.5, 0.25, 0.125 and 0.125 respectively. The messages are generated independently of each other. A source coder assigns binary code to each message. Which of the following codes has minimum average length and is also uniquely decodable (sequence as per m1, m2, m3, m4)?

Select an option to see the answer and solution.

If the minimum possible length and average length of a coding scheme are 2.418 and 2.45 bits respectively. Then its code efficiency and redundancy are

Select an option to see the answer and solution.

The purpose of source coding is to

Select an option to see the answer and solution.

Data rate R and information rate Rt are different because of

Select an option to see the answer and solution.