0% found this document useful (0 votes)

100 views38 pages

Information Theory and Coding: 4 Electrical Engineering by DR Wassan Saad

This document is a lecture on information theory and coding given by Dr. Wassan Saad to 4th year electrical engineering students. The lecture covers information theory, source coding, channel coding, error detecting codes, error correcting codes, and linear block codes. It discusses parity generators, the Hamming distance, encoding and decoding of linear block codes.

Uploaded by

tareq omar

We take content rights seriously. If you suspect this is your content, claim it here.

Available Formats

Download as PDF, TXT or read online on Scribd

0% found this document useful (0 votes)

100 views38 pages

Information Theory and Coding: 4 Electrical Engineering by DR Wassan Saad

Uploaded by

tareq omar

We take content rights seriously. If you suspect this is your content, claim it here.

Available Formats

Download as PDF, TXT or read online on Scribd

Information

Theory and
Coding

4th Electrical Engineering

By
Dr Wassan Saad

Lecture 7

Information Theory and Coding Dr .Wassan Saad 4th Electrical Eng.

Information Theory and Coding Dr .Wassan Saad 4th Electrical Eng.
Recall

Variable Source
Length Codes Extension

Shannon Huffman
Fano Code
code Code

Information Theory and Coding Dr .Wassan

Saad 4th Electrical Eng.
Information Theory and Coding Dr .Wassan Saad 4th Electrical Eng.
Recall

Part 1: Information Part 2: Source Part 3 : Channel

Theory Coding Coding

Information Theory and Coding Dr .Wassan Saad 4th Electrical Eng.

Outlines
Introduction

Error Detecting Code

• Even & Odd parity generators.

Error Correcting Code

Basic definition

• Systematic and non-systematic codes

• Hamming Distance
• Hamming weight
• Hamming bound
• Hamming Code

Linear Block Codes

• Encoding of Linear Block Codes

• Decoding of Linear Block Codes
Information Theory and Coding Dr .Wassan Saad 4th Electrical Eng.
Introduction

Information Theory and Coding Dr .Wassan Saad 4th Electrical Eng.

Information Theory and Coding Dr .Wassan Saad 4th Electrical Eng.
Information Theory and Coding Dr .Wassan Saad 4th Electrical Eng.
Error Detecting Code
Information Theory and Coding Dr .Wassan Saad 4th Electrical Eng.
Error Detecting Code
Information Theory and Coding Dr .Wassan Saad 4th Electrical Eng.
Information Theory and Coding Dr .Wassan Saad 4th Electrical Eng.
Information Theory and Coding Dr .Wassan Saad 4th Electrical Eng.
Error Correcting Codes:

Information Theory and Coding Dr .Wassan Saad 4th Electrical Eng.

Information Theory and Coding Dr .Wassan Saad 4th Electrical Eng.
Information Theory and Coding Dr .Wassan Saad 4th Electrical Eng.
Information Theory and Coding Dr .Wassan Saad 4th Electrical Eng.
Information Theory and Coding Dr .Wassan Saad 4th Electrical Eng.
Information Theory and Coding Dr .Wassan Saad 4th Electrical Eng.
Break
Information Theory and Coding Dr .Wassan Saad 4th Electrical Eng.
Linear Block Codes
Information Theory and Coding Dr .Wassan Saad 4th Electrical Eng.
Information Theory and Coding Dr .Wassan Saad 4th Electrical Eng.
Linear Block Codes
Information Theory and Coding Dr .Wassan Saad 4th Electrical Eng.
Encoding of
Linear Block
Codes

Information Theory and Coding Dr .Wassan Saad 4th Electrical Eng.

Information Theory and Coding Dr .Wassan Saad 4th Electrical Eng.
Information Theory and Coding Dr .Wassan Saad 4th Electrical Eng.
Information Theory and Coding Dr .Wassan Saad 4th Electrical Eng.
Information Theory and Coding Dr .Wassan Saad 4th Electrical Eng.
Information Theory and Coding Dr .Wassan Saad 4th Electrical Eng.
Information Theory and Coding Dr .Wassan Saad 4th Electrical Eng.
Information Theory and Coding Dr .Wassan Saad 4th Electrical Eng.
Information Theory and Coding Dr .Wassan Saad 4th Electrical Eng.
Information Theory and Coding Dr .Wassan Saad 4th Electrical Eng.
Information Theory and Coding Dr .Wassan Saad 4th Electrical Eng.
Question

Information Theory and Coding Dr .Wassan Saad 4th Electrical Eng.

Thank you

Information Theory and Coding Dr .Wassan Saad 4th Electrical Eng.

Lecture 7
No ratings yet
Lecture 7
38 pages
Lecture 8
No ratings yet
Lecture 8
30 pages
Convolutional Codes & Viterbi Algorithm
No ratings yet
Convolutional Codes & Viterbi Algorithm
26 pages
Digital Signal Processing - EC3492 - Important Questions With Answer - Unit 4
No ratings yet
Digital Signal Processing - EC3492 - Important Questions With Answer - Unit 4
9 pages
Internal Syllabus
No ratings yet
Internal Syllabus
1 page
Digital Systems Design - EC3352 - Hand Written Notes - Unit 1 - Basic Concepts
No ratings yet
Digital Systems Design - EC3352 - Hand Written Notes - Unit 1 - Basic Concepts
58 pages
S S 2 Marks
No ratings yet
S S 2 Marks
36 pages
Poriyaan: Connect & Engage
No ratings yet
Poriyaan: Connect & Engage
10 pages
UPSC Electrical Engineering Guide
No ratings yet
UPSC Electrical Engineering Guide
7 pages
Combinational Circuit Design Guide
No ratings yet
Combinational Circuit Design Guide
65 pages
Electrical Main Syll Ias
No ratings yet
Electrical Main Syll Ias
3 pages
Poriyaan - Electromagnetic Fields - EE3301 2021 Regulation - Notes 1.bin
No ratings yet
Poriyaan - Electromagnetic Fields - EE3301 2021 Regulation - Notes 1.bin
86 pages
UPSC ESE Electrical Engineering Syllabus
No ratings yet
UPSC ESE Electrical Engineering Syllabus
4 pages
Department of Electrical Engineering
No ratings yet
Department of Electrical Engineering
14 pages
UPSC Electrical Engineering Syllabus
No ratings yet
UPSC Electrical Engineering Syllabus
3 pages
ESE 2021 Syllabus Electrical Engineering
No ratings yet
ESE 2021 Syllabus Electrical Engineering
4 pages
Syll Lec Elecroeng 29 09 2014
No ratings yet
Syll Lec Elecroeng 29 09 2014
2 pages
Microprocessor & Interfaces Guide
No ratings yet
Microprocessor & Interfaces Guide
6 pages
(Official) IES Syllabus 2023 For The Electrical Engineering (EE) PDF
No ratings yet
(Official) IES Syllabus 2023 For The Electrical Engineering (EE) PDF
4 pages
Poriyaan IMQ
No ratings yet
Poriyaan IMQ
27 pages
Syllabus of Ph. D. (Engg.) Admission Test (From Electrical Engineering Department)
No ratings yet
Syllabus of Ph. D. (Engg.) Admission Test (From Electrical Engineering Department)
5 pages
UPSC CSE Electrical Engineering Syllabus
No ratings yet
UPSC CSE Electrical Engineering Syllabus
2 pages
Linear Integrated Circuits - EC3451 - Important Questions With Answer - Unit 1 - Basics of Operational Amplifiers
No ratings yet
Linear Integrated Circuits - EC3451 - Important Questions With Answer - Unit 1 - Basics of Operational Amplifiers
10 pages
My Resume
No ratings yet
My Resume
4 pages
Signals and Systems - EC3354 - Important Questions With Answer - Unit 5
No ratings yet
Signals and Systems - EC3354 - Important Questions With Answer - Unit 5
10 pages
Mtech ECE 2nd Sem
No ratings yet
Mtech ECE 2nd Sem
33 pages
Operating Systems - CS8493 2017 Regulation - Semester Question Paper 2022 Nov Dec
No ratings yet
Operating Systems - CS8493 2017 Regulation - Semester Question Paper 2022 Nov Dec
4 pages
Switching Theory and Logic Design PDF
No ratings yet
Switching Theory and Logic Design PDF
165 pages
Electrical Engg. 2nd Year Syllabus
No ratings yet
Electrical Engg. 2nd Year Syllabus
23 pages
Karnaugh Map POS Minimization: Example
No ratings yet
Karnaugh Map POS Minimization: Example
13 pages
5 - MSC Theoretical Computer Science Syllabus
No ratings yet
5 - MSC Theoretical Computer Science Syllabus
56 pages
EE-1201 Course Syllabus
No ratings yet
EE-1201 Course Syllabus
1 page
Vignan'S Institute of Information Technology:: Visakhapatnam Department of Electronics & Communication Engineering
No ratings yet
Vignan'S Institute of Information Technology:: Visakhapatnam Department of Electronics & Communication Engineering
94 pages
Ese Ee PDF
0% (1)
Ese Ee PDF
4 pages
Digital Systems Design - EC3352 - Hand Written Notes - Unit 3 - Synchronous Sequential Circuits
No ratings yet
Digital Systems Design - EC3352 - Hand Written Notes - Unit 3 - Synchronous Sequential Circuits
52 pages
Poriyaan - Physics For Electronics Engineering - PH3254 - Hand Written Notes - Unit 1 - Crystallography - Bin
No ratings yet
Poriyaan - Physics For Electronics Engineering - PH3254 - Hand Written Notes - Unit 1 - Crystallography - Bin
49 pages
B. Tech. Course Structure & Syllabus, Electrical Engineering Department, N.I.T. Silchar
No ratings yet
B. Tech. Course Structure & Syllabus, Electrical Engineering Department, N.I.T. Silchar
55 pages
NIT Silchar Electrical Engineering Syllabus
No ratings yet
NIT Silchar Electrical Engineering Syllabus
55 pages
Minor Electrical-Engineering
No ratings yet
Minor Electrical-Engineering
13 pages
UPSC Electrical Engineering Syllabus
No ratings yet
UPSC Electrical Engineering Syllabus
3 pages
(For Both Objective and Conventional Type Papers) 1. Materials and Components
No ratings yet
(For Both Objective and Conventional Type Papers) 1. Materials and Components
5 pages
Paper - I 1. Circuit Theory:: Electrical Engineering
No ratings yet
Paper - I 1. Circuit Theory:: Electrical Engineering
3 pages
5.5.10 Electronics and Communication Engineering (EC) : Linear Algebra: Calculus
No ratings yet
5.5.10 Electronics and Communication Engineering (EC) : Linear Algebra: Calculus
4 pages
Ph.D. Eligibility Test Syllabus 2014
No ratings yet
Ph.D. Eligibility Test Syllabus 2014
2 pages
Lab File (Ramsingh)
No ratings yet
Lab File (Ramsingh)
5 pages
EEE 5th Semester - HVDC and FACTS - EE3004 2021 Regulation - Question Paper 2023 Nov Dec
No ratings yet
EEE 5th Semester - HVDC and FACTS - EE3004 2021 Regulation - Question Paper 2023 Nov Dec
8 pages
Signals and Systems - EC3354 - Important Questions With Answer - Unit 1
0% (2)
Signals and Systems - EC3354 - Important Questions With Answer - Unit 1
12 pages
Electrical and Electronic Engineering, Information Engineering
No ratings yet
Electrical and Electronic Engineering, Information Engineering
4 pages
B.Tech ICE Course Syllabus
No ratings yet
B.Tech ICE Course Syllabus
6 pages
Digital Systems Design - EC3352 - Hand Written Notes - Unit 4 - Asynchronous Sequential Circuits
No ratings yet
Digital Systems Design - EC3352 - Hand Written Notes - Unit 4 - Asynchronous Sequential Circuits
16 pages
Ph.D. Admission Test Syllabus Overview
No ratings yet
Ph.D. Admission Test Syllabus Overview
22 pages
Syllabus For BSNL TTA Exam
No ratings yet
Syllabus For BSNL TTA Exam
5 pages
Math4 EE Report
No ratings yet
Math4 EE Report
3 pages
ETCE New Syllabus Final
No ratings yet
ETCE New Syllabus Final
83 pages
Translate PDF Files To Any Language - Smallpdf
100% (2)
Translate PDF Files To Any Language - Smallpdf
4 pages
Source Coding of Discrete Sources: 1-The Average Code Length L Must Be As Minimum As Possible. This Average Length Is
No ratings yet
Source Coding of Discrete Sources: 1-The Average Code Length L Must Be As Minimum As Possible. This Average Length Is
17 pages
Chapter One 1-Random Variables: Dr. Mahmood
100% (2)
Chapter One 1-Random Variables: Dr. Mahmood
60 pages
2 - Operational Amplifier Application
No ratings yet
2 - Operational Amplifier Application
5 pages
امثلة عن الفورير سيريز
No ratings yet
امثلة عن الفورير سيريز
27 pages
1-Operational Amplifier
No ratings yet
1-Operational Amplifier
2 pages
Computer Techniques Engineering Department: Dijlah University College
No ratings yet
Computer Techniques Engineering Department: Dijlah University College
46 pages
Chap 7 Solutions PDF
100% (1)
Chap 7 Solutions PDF
34 pages
Transmission Line Characteristics (Coaxial Cable) : Objective
No ratings yet
Transmission Line Characteristics (Coaxial Cable) : Objective
4 pages
Loan For Nuclear Power: Number 034 Originally Published: August 2003
No ratings yet
Loan For Nuclear Power: Number 034 Originally Published: August 2003
6 pages
Decision VIII.4.e - Rivne - INSESSION - As Finalized 9.12.2020
No ratings yet
Decision VIII.4.e - Rivne - INSESSION - As Finalized 9.12.2020
3 pages
PID01 April 09110 Appraisal 0 Stage
No ratings yet
PID01 April 09110 Appraisal 0 Stage
16 pages
Frequency Response of A Circuit
No ratings yet
Frequency Response of A Circuit
5 pages
PSPICE Frequency Response Tutorial
No ratings yet
PSPICE Frequency Response Tutorial
3 pages
Digital Circuits: Multiplexers Explained
No ratings yet
Digital Circuits: Multiplexers Explained
14 pages
Impedance and Frequency Response: Experiment 2
No ratings yet
Impedance and Frequency Response: Experiment 2
66 pages
Amplifier Frequency Response Guide
No ratings yet
Amplifier Frequency Response Guide
50 pages
Digital Circuits - Multiplexers - Tutorialspoint 1
100% (1)
Digital Circuits - Multiplexers - Tutorialspoint 1
13 pages
سيركت
No ratings yet
سيركت
13 pages
Maclaurin and Taylor Series: This Report Is Submitted To Fulfill The Requirements of The Mathematics III 1 Semseter 2020
No ratings yet
Maclaurin and Taylor Series: This Report Is Submitted To Fulfill The Requirements of The Mathematics III 1 Semseter 2020
8 pages
Ampere's Circuital Law Guide
No ratings yet
Ampere's Circuital Law Guide
12 pages
Electromagnetic Theory
No ratings yet
Electromagnetic Theory
35 pages
Frequency Response: Key Concept: Small-Signal Models For Amplifiers Are Linear and Therefore
No ratings yet
Frequency Response: Key Concept: Small-Signal Models For Amplifiers Are Linear and Therefore
10 pages
Ampere's Circuital Law States The Relationship Between The Current and The Magnetic Field
No ratings yet
Ampere's Circuital Law States The Relationship Between The Current and The Magnetic Field
11 pages
Maclaurin Series: and Taylor
No ratings yet
Maclaurin Series: and Taylor
14 pages
Waveguides Written Report
No ratings yet
Waveguides Written Report
10 pages
Pro3 Series 3D Printer Specs
No ratings yet
Pro3 Series 3D Printer Specs
1 page
Top Networking Interview Questions
No ratings yet
Top Networking Interview Questions
20 pages
Passwords and Notes Manager in Android Application
100% (1)
Passwords and Notes Manager in Android Application
79 pages
IT 237: Web Technology I: Course Objectives
No ratings yet
IT 237: Web Technology I: Course Objectives
2 pages
Wireless Communication Dissertation
100% (2)
Wireless Communication Dissertation
5 pages
8MP IR Dome Camera Specs
No ratings yet
8MP IR Dome Camera Specs
5 pages
Xi-Cs-Aps-Sample Paper-2024-25
No ratings yet
Xi-Cs-Aps-Sample Paper-2024-25
3 pages
Quadratic Time Bound for Palindromes
No ratings yet
Quadratic Time Bound for Palindromes
2 pages
C++ MCQ Question
No ratings yet
C++ MCQ Question
192 pages
Error Code Pal 50
100% (7)
Error Code Pal 50
11 pages
StarCam Controller Board Connections
No ratings yet
StarCam Controller Board Connections
3 pages
Transport Layer in Computer Networks
No ratings yet
Transport Layer in Computer Networks
31 pages
Project Report
No ratings yet
Project Report
38 pages
Real-Time Power Theft Monitoring and Detection System With Double Connected Data Capture System
No ratings yet
Real-Time Power Theft Monitoring and Detection System With Double Connected Data Capture System
19 pages
LKPD 2 Procedure Text
No ratings yet
LKPD 2 Procedure Text
2 pages
YT3300RDI5200S Rotork Valve Positioners Datasheet
No ratings yet
YT3300RDI5200S Rotork Valve Positioners Datasheet
2 pages
7-DBDesign (Schema Refinement)
No ratings yet
7-DBDesign (Schema Refinement)
30 pages
AIX Performance Tuning VUG May2418
No ratings yet
AIX Performance Tuning VUG May2418
50 pages
MicroProcessor Exp1
No ratings yet
MicroProcessor Exp1
10 pages
Software Testing Basics for Students
No ratings yet
Software Testing Basics for Students
34 pages
BT1000 Operator Panel Manual
No ratings yet
BT1000 Operator Panel Manual
70 pages
AI DVR Quick Start Guide
No ratings yet
AI DVR Quick Start Guide
23 pages
Juniper - Premium.jn0 664.65q DEMO Downloaded March 5th
No ratings yet
Juniper - Premium.jn0 664.65q DEMO Downloaded March 5th
47 pages
Pending IT and DevOps Positions
No ratings yet
Pending IT and DevOps Positions
1 page
Unit I
No ratings yet
Unit I
8 pages
Android App Developer Profile: Azharul Islam
No ratings yet
Android App Developer Profile: Azharul Islam
1 page
Lucky Transformation Project Report
No ratings yet
Lucky Transformation Project Report
15 pages
DELL - Latitude 3490 3590 - LA-F115P
No ratings yet
DELL - Latitude 3490 3590 - LA-F115P
5 pages
ESPEC MVI56E MCMR Modbus
No ratings yet
ESPEC MVI56E MCMR Modbus
3 pages
Chapter 6 IoT Platform P1 Software
No ratings yet
Chapter 6 IoT Platform P1 Software
33 pages

Information Theory and Coding: 4 Electrical Engineering by DR Wassan Saad

Uploaded by

Information Theory and Coding: 4 Electrical Engineering by DR Wassan Saad

Uploaded by

Information

4th Electrical Engineering

Information Theory and Coding Dr .Wassan Saad 4th Electrical Eng.

Information Theory and Coding Dr .Wassan

Part 1: Information Part 2: Source Part 3 : Channel

Information Theory and Coding Dr .Wassan Saad 4th Electrical Eng.

Error Detecting Code

• Even & Odd parity generators.

Error Correcting Code

• Systematic and non-systematic codes

Linear Block Codes

• Encoding of Linear Block Codes

Information Theory and Coding Dr .Wassan Saad 4th Electrical Eng.

Information Theory and Coding Dr .Wassan Saad 4th Electrical Eng.

Information Theory and Coding Dr .Wassan Saad 4th Electrical Eng.

Information Theory and Coding Dr .Wassan Saad 4th Electrical Eng.

Information Theory and Coding Dr .Wassan Saad 4th Electrical Eng.

Information Theory and Coding Dr .Wassan Saad 4th Electrical Eng.

You might also like