GITAM (Deemed to be University) GITAM School of Technology
L T P S J C
INFORMATION THEORY AND ERROR
EECE3121
CONTROL CODING
3 0 0 0 0 3
Pre-requisite None
Co-requisite None
Preferable EECE3011: Digital Communications
exposure
Course Description:
This course provides a basic understanding of the measure of information, source coding,
channel capacity and channel coding techniques. Source coding is used to compress the size of
the data generated from digital source by reducing redundancy. Channel capacity is a much-
used metric for the maximum amount of traffic or signal that can move over a particular
infrastructure channel. Channel coding is used for error detection and/or error correction by
adding some redundant bits to source coded data in order to improve performance.
CourseEducational Objectives:
● To introduce the principles and applications of information theory in terms of
probability and entropy and practical aspects of data compression and source coding
techniques.
● To explain the quantitative measure of information which may be used in order to
build efficient solutions to communication engineering problems such as calculating
the capacity of a communication channel with and without noise.
● To explain linear block codes, cyclic codes and convolution coding techniques for
channel performance improvement against errors.
● To describe suitable error control coding technique for burst error correction.
UNIT 1 Source Coding 9 hours
Introduction to information theory, uncertainty and information, average mutual
information and entropy, source coding theorem, Huffman coding, the Lempel-Ziv
algorithm.
UNIT 2 Channel Capacity and Coding 5 hours
Channel models, channel capacity, information capacity theorem, the Shannon limit,
Channel Coding, Type of errors.
B Tech. Electronics and Communication Engineering w.e.f. 2021-22 admitted batch
GITAM (Deemed to be University) GITAM School of Technology
UNIT 3 Linear Block Codes 12 hours
Linear Block Codes for Error Correction: Introduction to error correcting codes, basic
definitions, matrix description of linear block codes, parity check matrix, decoding of a
linear block code, syndrome decoding. Cyclic Codes: Introduction to cyclic codes,
polynomials, the division algorithm for polynomials, a method for generating cyclic codes,
burst error correction, cyclic redundancy check (CRC) codes.
UNIT 4 Convolutional Codes 6 hours
Convolutional Codes: Introduction to convolutional codes, tree codes and trellis codes,
polynomial description of convolutional codes, distance notions for convolutional codes,
the generating function.
UNIT 5 Turbo and LDPC Codes 10 hours
Turbo Codes: Code concatenation, Concatenating codes in parallel, Iterative decoding of
turbo codes, implementing MAP. Low density parity check codes: Codes with sparse parity
check matrix. Decoding and encoding algorithms, High level architecture for LDPC
decoders
Textbooks:
1. Ranjan Bose, Information Theory, Coding and Cryptography, 2/e, Tata McGraw- Hill,
2010.
2. Simon Haykin, Communication Systems, 4/e, John Wiley and Sons, 2002.
3. Yuan Zing, Practical Guide to Error Control Coding with MATLAB, Artech Book
Publishers, 2010.
References:
1. Amitabha Bhatacharya, Digital Communication, Tata McGraw-Hill, 2006.
2. William Stallings, Cryptography and Network Security Principles and Practices, 3/e,
Pearson Education, 2007.
3. Bruce Carlson, Paul B. Crilly, Communication Systems, 5/e, Tata McGraw Hill,
2009.
4. R.P Singh and S.D. Sapre, Communication Systems,2/e by Tata McGraw-Hill,2007
CourseOutcomes:
1. Determine the amount of information per symbol, information rate and Entropy of a
discrete memory less source (L4).
2. Design lossless source codes for discrete memory less source to improve the efficiency
of information transmission (L5)
B Tech. Electronics and Communication Engineering w.e.f. 2021-22 admitted batch
GITAM (Deemed to be University) GITAM School of Technology
3. Evaluate the information capacity of discrete memory less channels and determine
possible code rates achievable on such channels (L6)
4. Understand control of burst errors (L2).
5. Apply linear block codes, cyclic codes and convolutional codes for error correction and
error detection (L3).
CO-PO Mapping:
PO1 PO2 PO3 PO4 PO5 PO6 PO7 PO8 PO9 PO10 PO11 PO12 PSO1 PSO2 PSO3
CO1 3 2 2 2 2
CO2 3 2 3 3 2
CO3 2 1 3 3 2
CO4 2 2 2 3 2
CO5 3 1 2 3 1
Note: 1 - Low Correlation 2 - Medium Correlation 3 - High Correlation
APPROVED IN:
BOS :24-12-21 ACADEMIC COUNCIL: 22ndAC<<01-04-22>>
SDG No. & Statement:
SDG Justification:
B Tech. Electronics and Communication Engineering w.e.f. 2021-22 admitted batch
