An introduction to the fundamental principles of the theory of communication. Topics include: information measures, entropy, mutual information, divergence; modeling of information sources, discrete memoryless sources, Markov sources, entropy rate, source redundancy; fundamentals of lossless data compression, block encoding, variable-length encoding, Kraft inequality, design of Shannon-Fano and Huffman codes; fundamentals of channel coding, channel capacity, noisy channel coding theorem, channels with memory, lossless information transmission theorem; continuous-alphabet sources and channels, differential entropy, capacity of discrete-time and band-limited continuous-time Gaussian channels; rate-distortion theory, lossy data compression, rate-distortion theorem, lossy information transmission theorem. Offered jointly with MATH-474). Three term hours, fall; lectures.
An introduction to the fundamental principles of the theory of communication. Topics include: information measures, entropy, mutual information, divergence; modeling of information sources, discrete memoryless sources, Markov sources, entropy rate, source redundancy; fundamentals of lossless data compression, block encoding, variable-length encoding, Kraft inequality, design of Shannon-Fano and Huffman codes; fundamentals of channel coding, channel capacity, noisy channel coding theorem, channels with memory, lossless information transmission theorem; continuous-alphabet sources and channels, differential entropy, capacity of discrete-time and band-limited continuous-time Gaussian channels; rate-distortion theory, lossy data compression, rate-distortion theorem, lossy information transmission theorem. Offered jointly with MATH-474). Three term hours, fall; lectures.
