Vidyalelo
ECE · all questions

Information Theory And Coding
practice.

Practice every MCQ with options. Use Show answers when you want the correct option and solution.

232

Questions

12/12

Page

Pick an option on a question to see the right answer and solution.

A source produces three symbols A, B and C with probabilities P(A) = , P(B) = and P(C) = . The source entropy is

Select an option to see the answer and solution.

Consider a discrete memoryless source with source alphabet S = {s0, s1, s2} with probabilities P(s0) = , P(s1) = and P(s2) =
The entropy of the source is

Select an option to see the answer and solution.

According shanon-hartley law at no noise the channel capacity is going to be

Select an option to see the answer and solution.

Which of the following statements is correct?
S1: Channel capacity is the same for two binary symmetric channels with transition probabilities as 0.1 and 0.9.
S2: For a binary symmetric channel with transition probability 0.5, the channel capacity is 1.
S3: For AWGN channel with infinite bandwidth, channel capacity is also infinite.
S4: If Y = g(X), then H(Y) > H(X).

Select an option to see the answer and solution.

A source generates three symbols with probabilities 0.25, 0.25, 0.50 at a rate of 3000 symbols per second. Assuming independent generation of symbols, the most efficient source encoder would have average bit is

Select an option to see the answer and solution.

Source encoding in a data communication system is done in order to

Select an option to see the answer and solution.

A communication channel is having a bandwidth of 3000 Hz. The transmitted power is such that the received signal-to-noise ratio is 1023. The maximum data rate that can be transmitted t error-free through the channel is:

Select an option to see the answer and solution.

In a binary system, the symbols 0 and 1 occur with a probability of p0 and p1 respectively. The maximum value for entropy occurs when:

Select an option to see the answer and solution.

Consider a binary memoryless channel characterized by the transition probability diagram shown in the figure.
The channel is
Information Theory and Coding mcq question image

Select an option to see the answer and solution.

A random experiment has 64 equally likely outcomes. Find the information associated with each outcome.

Select an option to see the answer and solution.

For M equally likely messages, the average amount of information H is

Select an option to see the answer and solution.

An ideal power limited communication channel with additive white Gaussian noise is having 4 KHz band width and Signal to Noise ratio of 255. The channel capacity is:

Select an option to see the answer and solution.