Information Theory And Coding MCQs with Answers 2027

Q121

What is the channel capacity of a noisy channel with conditional probability of error p =

\frac{1}{2}

?

Select an option to see the answer and solution.

Q122

Open question

A binary symmetric channel with p as transition probability, uses repetition code 'n' times, with n = 2m + 1 being an odd integer. In a block of n bits, if the number of zeros exceed number of ones, decoder decodes it as "0" otherwise as "1". An error occurs when m + 1 or more transmission out of 3 are incorrect, what is the probability of error?

Select an option to see the answer and solution.

Q123

Open question

Over a certain binary communication channel, the symbol 0 is transmitted with probability 0.4 and 1 is transmitted with probability 0.6. It is given that p(ε/0) = 10^-6 and p(ε/1) = 10^-4, where p(ε/x_i) is the probability of detecting the error given that x_i is transmitted. What is the error probability of the channel?

Select an option to see the answer and solution.

Q124

Open question

Entropy of a source with 4 symbols is maximum possible. What would be the average Huffman code length of this source?

Select an option to see the answer and solution.

Q125

Open question

. . . . . . . . is the average amount of information that must be delivered in order to resolve the uncertainty about the outcome of a trial.

Select an option to see the answer and solution.

Q126

Open question

A prefix code is . . . . . . . . decodable and satisfies . . . . . . . . inequality.

Select an option to see the answer and solution.

Q127

Open question

The minimum transmitter power requirement in the absence of channel coding of a communication system is 2 W. If a channel coding scheme of 3 dB is incorporated in the system, the minimum required transmitter power is

Select an option to see the answer and solution.

Q128

Open question

A communication system is used to transmit one of 16 possible signals. Assume that transmission is accomplished by encoding the signals into binary digits. Further assume that signals are equally likely to occur. If each binary digit requires 1µ sec. For transmission, then how much information (in bits) is transmitted by the system in 8 microseconds?

Select an option to see the answer and solution.

Q129

Open question

The average information associated with an extremely unlikely message is zero. What is the average information associated with an extremely likely message?

Select an option to see the answer and solution.

Q130

Open question

A telephone channel has bandwidth B of 3kHz and SNR (S/ηB) of 30 dB. It is connected to a teletype machine having 32 different symbols. The symbol rate required for errorless transmission is nearly

Select an option to see the answer and solution.

Q131

Open question

A discrete source emits four symbols with probabilities

\frac{1}{3}, \frac{1}{3}, \frac{1}{4}

and

\frac{1}{12}

every 100 µs. The information rate is:

Select an option to see the answer and solution.

Q132

Open question

The channel capacity of an ideal AWGN channel with infinite bandwidth is approximated as (where S is average signal power and

\frac{η}{2}

is the double sided power spectral density of white Gaussian noise)

Select an option to see the answer and solution.

Q133

Open question

If the channel is band limited to 6 kHz and signal to noise ratio is 16, what would be the capacity of channel?

Select an option to see the answer and solution.

Q134

Open question

In Huffman coding, data in a tree always occur at-

Select an option to see the answer and solution.

Q135

Open question

In information theory, the entropy is

Select an option to see the answer and solution.

Q136

Open question

What is the entropy of a communication system that consists of six messages with probabilities

\frac{1}{8}, \frac{1}{8}, \frac{1}{8}, \frac{1}{4}

and

\frac{1}{4}

respectively?

Select an option to see the answer and solution.

Q137

Open question

Which one of the following statements is correct?
The Shannon's Theorem, channel capacity formula indicates that in theory

Select an option to see the answer and solution.

Q138

Open question

An 8 level encoding scheme is used in a PCM system of 10 kHz channel BW. The channel capacity is

Select an option to see the answer and solution.

Q139

Open question

A zero memory source emits six messages with probabilities 0.3, 0.25, 0.15, 0.12, 0.1 and 0.08. If binary Huffman coding is used, what will be the average code length?

Select an option to see the answer and solution.

Q140

Open question

Block codes are . . . . . . . . codes that enable a limited number of errors to be detected and corrected without retransmission

Select an option to see the answer and solution.

Information Theory And Codingpractice.

Information Theory And Coding
practice.