(a) Explain the concept of Entropy in information theory. How does it quantify the uncertainty of a random message source? (b) Compare Amplitude…

(a) Explain the concept of Entropy in information theory. How does it quantify the uncertainty of a random message source?

(b) Compare Amplitude Modulation (AM) and Frequency Modulation (FM) in terms of bandwidth requirement, noise performance, and power efficiency.

(c) A discrete memoryless source emits symbols A, B, C, D with probabilities 0.5, 0.25, 0.15, 0.10, respectively.

(i) Calculate the entropy of the source in bits per symbol, and

(ii) If each symbol is transmitted every millisecond, determine the information rate of the source.