0% found this document useful (0 votes)
62 views48 pagesITC Mod1
Uploaded by
Sohan sCopyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF or read online on Scribd
0% found this document useful (0 votes)
62 views48 pagesITC Mod1
Uploaded by
Sohan sCopyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF or read online on Scribd
established baie Pericemance eb Communt ut 6) Lystend
Wenner obo eslabrched tne meakurment of ingecenall 89 |
UO Q basic mathemalical “Prokabilitic model
ex ons) ee US
Laude naan Toles ek Inlo™
yo
““wathenvilizal thentut ital apple = MODULE - 4
” CHE VA B tt ¢
SHEVINAD 8 Auge
in) : [Camilin|Pege |
Loformalien Theor y Doe tt
Tomedutioy > Claude © shannog Know a4
St 04, In powmaction theory’, 19 1948 be. pustobittes
Paper wWiitin 1the ' Mabbemeidti cal henry Of Grnmunttaking |
tty whl We established bowie _pestpenance o, Coenegeint cing
fe : also he eas Ur ed cud, Scapresenbed Leafs |
19
Sf matherob ca} enpreiti ond (pubabibste made)
Be Combuniiabioe i eficed ox
the brankmi 45100 48
Foy one Porat by omothner gofat. the cotanfng of- ma
=Heq_f interoating theory is mess . =
© “Thtsd mersoye may be 1g Uedhtal mersaye Such af Vebess,
: ‘ foes
Current power Lpeeh rolssoge pi coure long ae
Music message the,
> +
Ource rel ery Preduces these a
oprmatios fowxco?
essanes, i Glled as
“|
is
i
e 4
topeimation Source are essited “uks fia Cole aories %
Dahle berenatiog Source 5 —> Analog enkelrnath t
$0
Lateran
Ce, which emits Lnterroecki on Continuously. Suey os
5 pebtls by micro phone TW G@mera gta
ems G00 oF ve Conf oUHUs etediicol Uoave as
ODIs, a_blene
eke Lo, terrmedhion Source o>
“inter aft on i
» fee
= = Probeto; bia) pein the thiidunt
Ad
Exist
rT} oer pbobue Pabst
iit) jan a Glphabel- Prababrlivess > > If Abe Aatetisne is prof
bo Rasoges fo Enakish la
—*Porxe peg
SExy Letter “e —E apptons
ae
mloo| Tale Ps — -
The wale at htth Ihe telehese = prec
ALE ate hte Lys
saoultas . Cf the tiletite — epunatis ok ane “feed
he SX O¥ 10 Symbols [tee then the Sontol matt &
BE be Le ted fees :
RRS than Some _lyflers appear
han Others
more often 4b ellen than 4 tbe feller
atts by Toe nition topes 9 Aypatee] Leg utace (05 be Chard
4h figorbe a lf
[RS errno rr eee “gi tb Sygettes
me Letters appear ned poss DMHhey
p 8 a word Starts ith a ned leer wilt
be Vy"
—attal
_ = chda red ery Comditioual pip babi ti
= above Pararoctltins _ we (an
_eeernress ght moedel 4 the Lojprmation Source,
pb Stitink popes reAG 9 bymlsal dequence (24 be Cham
ie seu ence 3 yosbel
i ee
1:
a Sopree = oo. eyed
eriets discrete eetiape fymbsl 6) Sx Ss
eI
~Th|
yoko] [enceler | [marsmitier |__ le hanne), pete E
Lescuw,
AiSume _cnteymatio) Lowe | & @ dcr
shal bie F_Octuny ence be at Ps Ps
Suro 9 alt there probe
Prato 4 Psa --- + "|
000 2 s4mibely _Jo-—burousseg)” i
Souxcd “tobe, 12 Topur th the fource eng
ts a. }squence 5 Source Symbol, doom the Source §=($1S2 S94)
= V a -
[octund ab a walt 9 3 _Gpratolls [pec ere
_ecthe.
Syabollt inte a bfoary Kytuence o nied de by abGant
Gdewords & the Symbols to
|__CodiSrin, Ub Preferred °" of (he hee CYyrcieny 3 trank mi £8%00
fhe Stools which acer OH Caual probabibhU are AdCiyne d
as
Spurce @ntoder Converts the . Sequence Er une
e lnpul™ Sequences Boraory
iad Lensth Codetord and those Bpaleala whieh oceux wBUy
Une
= Conte
gal Probski thes axe atisened ith Vertasle Lengess
| _
Prmagmf it Couples thre i ~
fang) in the channel. § dome times it Coupler the”
st tpl reg
ctennsiducer clovetly ty the channel. For tfclenb Lenin
she fog ctanal must be prooty 4 modltLy
—SStod. Operation of trantwttior included am
$i Uarfog. and:modulation.
*Fhemdst topertanl operation is madulafisa which. te
ed
thegropet es 4p the Pransmitved Staal by the chang eb
tin eto Heute. Fa Canen Wane.
19,
aprsotisce decoder Conv verls the btnayey oubpule of toe ca
ne detodan bee a Nar
eae
Tibthe hundian 4 tbe declare b te Canieds ine es
ab ints a Syment Stquence: andthe | fuoiblon 3, “the
Uiver fs fa Gloukity the Symloal Sequence and. mash te
=the Cowreck Sequence.
reo, ‘Inigsmotion * 12 a
s Meoumenent Eh intprmatiod ty yoey “NeceIan
Yoh and Compare the Mofeecnot'09 Contecnt= 7, VautOus
ges emitted by cup Endernorbion Source.
® L. fe 002 fe Commft
the transmitter Wht probabalile 7 octtsresce "een te
we Soy. we hove Secelved eo ‘ernount= 04, Lntere mek 00) a
‘ '
bo te given ey
E
(Kk) = log TD
+ Figen this defination ue. nobice: that intgwnation fe inverels
Sona fa the protaloitthy, Of Bccurence 3 a0 event id
event thet has Least pro lols tile 4, ace urence Canvey
fn Lofermatioy when it eccturg
(1 Depsoding updo tbe boate fo which the begartttn tix
“__wWa E
art fy -the bose is 2, the Lojermation ig to bie
Xa)
1, the bo 2 jatipn iS to Hartely o Dee.
I} re loose ete intention fs to
“__ttlewever 0. on intermation te bite {conte
pose we have ‘a ae i syerempaaki On) Sowece.
emis cx bony cligit o oa 4 with oo equal
maa eweny 4 secoodt
|_ lndormatwoo Comrvorged Lay. day lS rge Canned beoghiu
p nessage. MUA Contato Contato annul Of —— von 8 06)
Igy bas ty be at Leask o_
Ik 20 ey
| 2) 2h the probabil 4 the Occurence sureoce 4 4 Anowenk
|__oal cenexpend fins, Lnderrenaity'09 cama _ ye ewenk!00), 4
} be lo tie
pap ed tea Eg a
Tuly-the lowésk pos idle value 3, ae iseenaion %
v
Pa eee
if D when] i mettion 2 transmole pe Lnep eacliis~ - bmaboole . ten Hoe
ie Lichfematinn must be equal to the Siam A
a foluad Seb Lujermedtion i.e
x Sen m.) = Sim) + Dgos)
Lew bene’ fowrte ori remarry LUs Source 4 —>
fr _|gource te Solel tn be memoryless th the Tgaiead
| outpdl= Ob Gury insteunt elves not & depend upoo redo
Syren Oulpb, 3
dupe Contidler a oliserele memumlers source ent
Cero Sa,$3 2 ce With each Lembo hw bro”
i a Dbyintte Pro bab hile a O(curence given by
| Py IPod 2. Pays thon athe indornakion Converged ety
Catts| gmmbal vheq he OcceerS “jp given by, U6) £Gs)
idom [es 1 by
T
g 5
LE Binary “Sytteny has tu Symbols Oand dane da
itn Prow—aLibbes 0,6 and OY. Despoctively ftod nthe
es? eApoostina Seth: in grenation oy 0 4 A bid!
el infr-metinn _ ie gfveo by _
My 2 toy A a
te
Belh infromation \0 «
Jo = bogs
i}
= alee L lon 1.66 = 0.2901
Ter “06 “toan 0. 4010
oa loya ?
0.1369 mr 4 eee
rad Source emitting to Symbols So “and $1 with: tre
Ty = ley = ly = loans = 13219 Wis,
1 Bets “Obey oe 1_
Cdvvespooding gvoloaLib bes Yu aod V4 reaped vely . fread
e Selh-voter mation op the Symbols io 1) BASCW)- Deak
i) Nob _ i
Giveo i d
PG) = He PG. =. Vo
StU Ladprmakiog t Sypatool o_o bite age
des toy Tk
Tes . Te toe, & sae
2 eae, me eae
[eo = 0.415 bite]
doy = ae = ee eas = Meaty = 2 bite.
. TGS "te Tas ;
‘Tsety Lander mots 9 of Syne To. bee i given by
2 HS gy oe 7 20.602 decaki
i may Tt d
Sal Andee 05 ) te Sipentack Ve Toa na Abie
Dye tege te
lose = tay = lag = 4386 nate.
‘ Oey 4 he
aie 2% dice js rolled Simultantovaly “the @uttome of
vst alice is Contidored to oe & Abo 3 the etond
|. three events are ined as J
oy 3]
SD Such thak (ry) ib auly divis i
Sut Hat Gry) 16 an even qumoeef
oy), Suh thot Gry) = +t
eNeal Convt soo7e Later roa’
jen WHO roakhe mabila) Calalben 7
So)" |=. tind whith event Cooveys More loteematiog. we
fesse find proleabbbes Oe doe event, To tnd Pprold )
= bi Riff os ffod. the sobs % Soumple spase(o and ever
P@.¢R at pllows
= GH) G2) 19,04) 159) 00,6) 9G aee 2.5) Ob) _
3) 6.2), 6.3) 64), 65),64) GN. ©) bs) Go)
__4.8)_ 46) G1), G2) Ga) Be aXe (61) © ca (G3)
Khe) 69) ger} eee a
1205), (1) 04), 65),G6.6) 2) &5) 6 6.4)
62>, (66) }
{hy G26s) 6D e666.) (3), 65) 2 (iu) Ge)
Gu) Go, GS) € ou) OF
fd, 6), 25)
(0-4) 43) G21) $ [Camtin|rase
Date L
—fa
SX Oar
leps ct = laps = tgp, 36,.
O% ly (pe) 'y i
leas! 2 logs
Oe oP
pe ateove @lculation th
— Fe cncitales hak the event 4
of eee
YAvéroge Inppr mato Coxstent Entropy) th Sy ratools ty
Asn Endopendont Sequences(a zero soemowy Source)
The Avera infor malies Comteg: Ouro the transi
Ok Soy atven Logtentm aime is Viewed @8 the ox, ected
Villute 4 “the tntyrmatiog and is clertved as qollows:
ET ee ae
—=@otier a Source emi King Symbal 6-6, S500 Sot
With Probabllibes pe {Pups Py ees pect veley
do us _ConGdor c leng inde pende m= Sequroce 9, lonath
oo ks ent teat oy” the
U
Souxce, then it Cmbains
1
Pit number % yenbobs os $4
Pl number th Symbols a So
he seth intewmation 6 Sa is ven by
ets o% Spek 5 Sy _ .
Geis ean Ll bite
OPE Lenbur = feetolt So_Gojains Pallego- = —
ae Humbue ee Spnbols of Sy Containd ® bite
Js =ths te bad self ingermation Ck Source {% tthe Surp
Bll hase toirernattienn codlinls Us atven by,
tie =L[Pi lal Ley ks Pel ay
pe athe ee
t Piles. bib
us| toe euevage: bolermation ots Hoe Soltrco. ern d betes,
L Lb onbols ig tended Loy HG) ond t& also called”
OL Etro wh8un tb iver by
i H® = Thteb
i | c
| Khe = ele 2 log to]
nasil
z
4
Pile | ib [Symbol
ted
wd oS ‘ant fee SE ik olow
word be Symntoa | eee $b Ven oF
if :
x te ‘ ra :
=|Pilese 1 et iL a 4
HED =|Pilose +5 + Balps Pt Fi loye pet le loge fe 2 lege se
HE) = It Inset 4 lope a bleh, 4d loge a 5 lage
BO iets eat ete aot CO
\ Gree patlegeY 0lasl4e St blase® kaos $Omache ns
H@|= D3 U6 10.259 40.209 40-31 40.363
4G) = 1-Sbo) nods Jharr,
Average teraction vata fe
set
Ree vs, H@. =! dx SG) = Lees pate Iker.
Avenabe: Utermodion fo tH saver: fy.
me 1 Vv
ly
HG) = ER eos Paley
H@ _0e670l, Hanley | .
au = inebing = 8 frog lus Neuter volta ce Cental Gras eoabe ite (|
@ beeen mae Htavolls the [Eaminfe, i] 7
A e_tte taken On only tse ve eg (Ome
Sp =6.—T. = SI 12 Voblks whith aespertive Probaeites ff
; ' - A my je a
STS Se 7 Lath Vollage th ve tarcloct soho
Pen recorder, Find the Avene Sut Lander enti 69 Abhotta
= fone Abe veterd_in tems of tts [Lovet
'
WS= eng: 7 Cr
| HE = 2.410 bf |revet
@)_fitod relatienship between Hantleys, nabs oud ets,
+ BAX dwehave From depinttion o, Het cao 0 and ‘vit!
T= _legta 1 —Hanileys
gs oat, —- 6
a Ds tagat bits —— 2
= lee Vp) nats] 22 ma Os
Sce_—- ©
Wy Fb «? © comms
4 Hort = Pls \ga(Ve) bits [: fr pal (ay
: 'saro Ye) PATS)
“lo
tule = = gal = Gag \—= Loge
=lesro = typ =
( Lap )
Hane, = leato c luglio > 3.32 Wits
Lona
[Avowtley = 3.20 be]
————— oe
is
2nd |Frore ep? ®
ddak= & = VP) = la P= leat
Nog dV la Log 2
‘ey ye) Welle ) lige? aS
Anab = loge = lose = 1.43 bits
Q tea a
toaks = 1.Gy3 bits
GQ) fthad te Sntrort 4 source tin nals [Xymbol of a Souve
tot emi 6ne Outs four dymbols 4,8 Cand Din a.
—Slobistelly tndepadeal Stuence ateh pacam bee +
Val Ye, cod Ye.
S00" | “the eobvopy 6 the Source th quven by
= 7
HG) = bao leet. nee ples = Ast bide)
Buk we Bnoow
Loalé = 443 Gs, => 40s pepe htt ole
£443
fe Clots] dur te. = (4.t 693) Srgnbet
pe pees es Ct) C.cn oat [peel Lode £4 the Sowrce emets toon Lyn
e Oubpul oF am intermabt SoU. (omtoPes 160 Lrntods,
18.95 wohke a ng a t by, 2 e —
face and Bema hatns WIRY aReclosbinl Sy o
BHee, tar. Céad _ ftod ine 9k AN ETOH enjgreneli on al ole
50d [second
Ee elicoy, “ib given by Given m2 10 pm biym [Lee
iP Map —= ie Ge pase tga
Hleeag wadgrmatron robe ip aivéo a ' oe
[Re = TE tl eyton) |
aE
4 G_Chinv ert pulie 4, duration ame Gnd dok ty a-duraton
4 & ul dems te Probability o dob to Mall Of that dol,
Ce
vo Rs = % H® = [vooox
- [Ra = 10090 bits [eee]
A Code is, do i» compnsed a, dole and dothes ane Aeby Lea ragh
jblors tnglcth olpbaboet. The darh te wepresentd dey
den ims duration % gap [e atven in “‘eebwoan the
Sujo bole Cobetal® C1) Self intormatiion o adok and a dash.
i
Entropy 9, oboe ~ dash Code. Hit) Averroge’ rake op inbgrmacivon ,
&d) | Geveo .
al Patwh = 1 Paste —CO :
We Noe. thal
Pdet+ Puavs = 4 — @
| SubstNi 0° © io O
i
Poor + I Pbok = 4
Fact (4b) = 4 => Pe (2ye4
Pu aloo ve tee
pee =a
abopve. Pek vals tn -
“Pdaohy = Iv Z =
xs
Pau = ve | = 0-22 (Camin|rge
) SAparaatin sydet ond A ETE,
Aa ley = 0. 7
Fast = lg 5 — = leg oO &
i St tee 3 = 15849 bite
Rg eae |
_ it) Eero oy the dot_daw Code tS
ui) = Cpl) — Els hale
ae ty) pr tae Fao
2 yn 8 + led = 0.4182 alent
tit) Blom the Probabibbes ~ deband daw it te clear Hak tor
three Symbols transyniteed , ure wll be One Symty
9, dhity end. Ie 9 dete with tneduralion % dash is
md and thab } dot ip ims and wlth ims gap &
bokwken bp Succevtsve eymbols
“axl total Of Arms + /4ms.s 4st dink 4 2mb4dos >) sens hime te
Sequered by Grankmit 3 Symbols
[Syma vale rp 2 3° = 3 = 3009 =4286 bm [pee
=m Ie
Axel wa yale 9 ndermotion is
a Qe uw HG) = AFG 0918
set in
I a
mM () Code ip Composed of dots cod dashes. Atsumtne tat a
dasin te Stinres as iste ase clot aod has one tetra tre
probake lity of oceerence Caleta tbe -
t) 7He Lsclermrat oy in “aolot aul a dah (ii) Average
Lufdantion $ clei dard Code iii) Average vale of Lefora
te d dot lost fox 40m See Qad —this-hine allowed
eon Lymleo)s. Wen
Toh = = Pot © (Comins
Ca
f -- [Ydor= % [= ote eoere|
L pall oleove folet value in Uw, We pele
$
x a ee
Rey
I ee eo
+1) 0} internation 9 a dat ancl a daih
| b= log t = ln tt _ Wes ov: by.
SS pee ie al
Daath = laa! slog log = 2 bite
T © Paanh S85) “a at
i) _eutropy 9 the clot dosh Gade ts =a
= flog t= ae blog ie
FOSS Pi = Bi ba Pauley parE ~
His) = 4 lap ap ley e = o.8ia bits|Smtol
it) Flom the Pratabrl Bes 3 ae and deih te is cleas Mat for
ymholt Henimitted, there will be 3dee and 4 dash wih a dol
fpr tom-tee_ a cath spr Bometee and 4om-sec Aap_io bebiteon
& gf
Succeive Symbols ws
1. Thad & (lor + tom siom-lbupabv Oona 2 10D 19 kee time tehugusred
ty transmtl | symbole
| Simtel rab = 4 = Gelooe = 40 fonby [dec
(5°)
a 10d%y
Avera vote cinders od is :
Qe =v HG) = Goxo,8NS = 82.452 bulkec
[Raa Gea] tats lhe
: A) binary source is emikfrg 5 ee ae
7 Se BS cnet 4° With Polat
: B thd 4 -p) expect vely , Plot the xa
o @ ages Ver sits P sist
Sd® oo Par =P Pa = _1-P
Bubroyy % the biowry Source t given by
= : 2 ate +
7 Eagar Piss hia Baty “a
4 {s) = aoe = ale
plog 4 G-p) Bay : =
dik Peola HE) = 0.) lop L 40.9 lng lL = 0.464 bits] Sop
Sat Go4
Peoxr HG) = orlug d+ 0.G log L = ‘onfa2 wits [yen
on c
den =o. él r = 0.471 bits
(peo HO) =poclea t+ oueleg- = A bite lyme
Pood HG) = oblige 4 Outylogh, = 0-071 EHS leprp
prom. H@ =acrlogd—o.3leg b= 0.984 Lats Hen
|__ P2048 H® = onl + 0.2 leg + = eee bts Keen
Peo.4 H® = Oa beg 5 001 lng = 0.469 bits ferey
H®=0
PP and HG) we Go plot qmph as
rn BUtetsive to thet :
Om a heck op Grds.-
c " the Cond ae a ta
fade. Hol rmUch inbormatd cto You —————
kh ve Wd q
oD Lh ttomat dy you rewive: ty you wre ld tak Holand
Ow draw. talon acel
i
A) Muh tnjernot) oly you reaBve th you ane teld tat the
dew d YOU didn Ww an ace
Ob aden) TS th endahorend? d
potent ght Menge dco Pipada! fe Suing Mer Cent
ra A eet 4, plot Corel Comsuts 52 Cards.
(i
PThewe ame (2 Spada’ Conds ty a dict, 5 52 cand
st Pepade = IS = Oo
52.
Heth infront) Lepnde = lo T= lag
U
| i) ~foexe are _& Beek ip a dene 9 52 Candas
[-
a
Pept
Jaco =
5a
Lace = legge 2 leg 5% = air bibs
There te only Ge ate % Spade 3 a deux 4 So Conds
Pace spade 4 ;
s2
Ta ripe = lS? = TTL
Lace 4 gpacho “Shaqpete {op 1
Tate Spode = Tpade) + Lace) |
EEE
ea
$B the Guteomtd Corlinks mlitere ave > Spode th ~the
Lu Calgon? Gntints 4 merge Spalle 4 ace.
6 date ben te tossed wepentedly, Lote
Az feyent 9 gilling 3 btads Ouk 4 otrtale ?
es
B= fever os gelling Sheada uh oy 8 tufale 1 |
Ch vent Comveys more intermati'es ? Suppxt your |
Wert by AumertGl luther, Suspective cumouk. a |
Nott; om + 4 1
# pad @ ley Uaty “A the Concept > btmomial |
nuaber ob, Jronds
rear ty ond
= robaliblt a a 20.5
— 4 4 = Petal gully Qttllng teel
; 4 \-P =
=0.5
Wobavilits distribufien union {e given by
POD sg gt ght
etal Given
fe were
POE 6, (sy?
Ga
Fert: fied out Abe Proboabiti bey 4 ound
idbrt bution. —
mal random Vanitatde Co 40s
ut (ores te Wind crdart.
ln Page
& (ote
l —
| ae | Bi) |
I 25] O.5Y x05)
\ ~-3! 6s)!
j al = SxUKBrany O.0age- = O.Ago-
, Bn ang x oxy Ei
| Gide: for Wenk B. i XS O28
[- Re = (sO?
| = 8! x05) x@5
51@-5)!
= ee X-3:40baonIE = O, 2197S
oh Sul, Tadpret o WenkA. Sy = slggl = boa 3 =héTe 68
SU catemuition 9 Aenk Las bgt ag nash
ee {| Eotropy oes
O70 -bthe yoopendi
ia Comiations purb'oo
entropy 5)
rolaobail; Js ‘
_ : Jy Prorat lS, poy ry erey
Asinh= Vor alae My ki ta the thal Co, 2) cd
a
wot 4, ibt_anyurtats,
- tbe kource femaim Lome toverpective
the order “fo Whth -Ihe Lyenlools are anrvanged dows np
nit ow E
sft —the_ ounces 2A. So 4 Se with probaleil he
ee tet a
eS
ae eu |
a. —C pies sat have the dame enbbrayry —
i i —_
|g HG) = H@) = HG)
2) “Extremal Propedly > Entropy has ao Wppee bowed, he
Condition upper bound is owtropy 7 a fource wilt be
bt ae Se
Mewimum ih afl tks Lymbol probabil bu ave equal.
4 det ug derive the exprerston jpy the mapia uc enbie ‘
| “ a Source by Considentor terse 109. = HG)
: ¥
Jo} ca
sautliplgng eore ta bot Cicher by fog EPI we gee
cH Tat & hin be) Z lage Cp: (4- £ [a
pe FS al
Pop 4) @ LHe: -vepreute Jogg. LEG) depplace to
Gp ete gel logg-H@) tea C1-tJ (Camiin[rone
; Pals
Ata g-— 1G) 70 :
H® < lay
2 Upper ootend Oy the cubiepy i given lay
Syn :
ove tuabior Shows thatthe eutoty alabns amar
=m value shen all the Source fyraoold Ie Coere
LGUs Bo batale.
i Boles epigeneg = = ~The Opies eouy ao Lagernali'on
go
Urece ib derined ak the “ratio 3 te af enass ~ talernatd :
seayeal oy he. Source aosthak: of tbe enayl muy
“bu
make | Opbin injermd? and cb apler bY
a Rng = SNe we IH HG) = HO HO) x 100
HO) mae H© mas
Notes
$7 The So wece epicienty As) ¢ curd Source fad
(Ras) Gre lun Coeprrensest io Porcntane. {
© padstiwh oealy > AMUBWG aes
bet, sol Sabi cb, tie Cndib'on af Pbe, eops
Hay > 4G)
—- [HOT EAS]
std equation uditalies that the ped Bonfng. a a
aby Sut. Symbols Gannok deur eobes te! eutty
dud ul) fe eiven ley
i
Sule b Piet 0p) lae ! 40 PD) fe ba GPO
: Pree tp Jt Be
CPD 4 Py Loe (1ep) — ~~ -- }
Pp Pe OR) PG j
“Gs eth the vule § addi f vile Jor tne pllosatee ee
Call siss Ss suit wth p= Vv Vs, Yin, Yo
GD Eulmepy % Source is
L
3s 0
GaS 4) log i> + Ltogio. = 1 6ace
a 7 12 .
4 [H@ =). 6zce] bg Knbot
| 4 Py tae (Py )
| a-p) V7 gy
aad barat (Ys) lun Yo) Vin) ten) aby
g sf ww) Ws) Oo Uns, is
= se [bis oles ,
wisi 1% fame ag HG) .°, HO@= HG)
|
a
"
yI-
qe
— Con Bde a Be pecan te the aes
potas ~, 8B Ott ¥ nea [Camtin[rse |
pesealalihce Ont, OS: ¥ Outs. at pee Lt :
Se tpcieney cunal wed i wt FE
Spathe Lovee. Ve given ley !
h© = Ohi l >
=r Rp; = Ort tag fru, OUT AE eot osha.
[R@ = rei bits [ 275625"
to ood tame
anwunber 4 fraaes fous ule = 256x356, ens! 2056) =
215625 Smee
Since each frame is_equiprovatite then oery Lafgenatd
Connyuged bey each frame a - =
le
| HO my = gt = lag age" = anseacks 255 |
H)may = 2-205 vie bits|frame
Given Bo frames [see
the average. spermaden rote ts
es =e, HG) man
= 30X220Ex if
Qc = G6.1S K 1 OHS hee ee
Single Py pichivre ray lee b.
| Or co tes a
ge see ty roe | Pop” 20S spon Cotfmale—T
Su)
: iG mgud Malgle Sorightnoss
Conyahgesel ky ome prckire
os”
th,
Se “that eae. dol-s eg ee oN ny Rte 4
robs, Uwboske bs He vdon|
= eae ee
_|_ Num oery “ats =5oxbop = 3xl0
INLumb ew “ 8 chive {oldie = jontoxcsa=——=0 2g
a rtnsenisien op piclitve she eure Oboub-
olds xin’ pinels| fame. frra goed _ yeoroduitien f2_
brightness iat Neceary eal
axe lequally Ut oly te Sctwir, Find the "vate 04, catgrmat) Mp
one! plcbire by be tronimitied Cory 3 wileakes , bchat
i th the Source Ushi ren 4 tri § Prabhat bene,
f cn?! Given
OY» Aume all hue Levels
t fe 4 7 =
Se = i.
"Swi a et Richio ia
fH Piel ome frome = 2.95%)6 é
Re Fh pamefusile = aeap een 2 (ay
—DASx lo dimes
{Ady frame Ts equtprobalete , then the mayinnten tule
& vu
MO ney = Day = Log 2) ; oS 225 106 Lag 12:
— 2
[H@ muy = 81066 wid |i 48 [ph chy wa ng prtion nite fs
[Comin]
a. HOw, loess
= p> ei Srp eeete®
etn 6-966 vice
\So
: [Rs G46 bitskec
eee
ojH
Entensien of Zero Memory Source >
Consider a. Zero memory Source embteing. foo §&
deumbols S&S, whith Probauibbes Pi & Po “eapedk vl. H
Surb that Pi¢Pe= 4 ~The extropy op the Sotesce a
given bey : \
HE) = Pi lea apt Do lease ——f1)
wftthen the secood order entengion oy the Source S
Ys denoted as s-
Now the Source s* will have our combinabions ak
Si, $1$2.,Sa$) end $292 anh Cones pend wey To
Lutes are geven bY
=f 61S) = PED PGi) = Pix P=
Si$o = PG) Péa) = fix ls= ie Po
S26) = PG») PG) = foxPi = Piha
Si = PGs) PG) =fxh= fe
lS oe entiopy of the Second owlen: extension
b
ource given by
pet
te = erg
Ssh “gh a ee a Pa dog yu
=p lag (2) + 2 A + f leq -—
Pa Pes alee! 3. Wd.
Hee) = 4. H()
=n. KG)
[ws Lol general the ot orden erlbewntion a He Souace
5
ae Tn Ly phe Opel = z Baler Pe pas Toole
Gene Li Phos ed os of ln Font Peas
E
pei
Peete |
Ta |
pe ga ay
———
4 G2 = 0.45% WE |tynbet | ——G)
Kor oldious 9 GF 640, bu cen Hoh
[G
a
pstolew the Stale diag
Pram 4 the mantav Louse ¢
Hert. Compal @ sto¥e Prollauihdes (i) Bbopy
Ly Gtake (1) Ent z ch the. Source, >
; Z i oy: From Stoke
t Wridten ag
PA) + 9@) + POF PO 1 — ©)
Fron 9 ©
PO) — 0.6 PG) 20.5 PO) => pOU-16) =0oPO
x %G PES = 0.5 Rb)
pa) =5 20) —©
Using, above pe) in og @ we ae
R@)= 0. z PCD) 0.5 PO)
2 oS APD Zz
; Pe (b-068) = OF KO
PO oy =0-€ Pw
Pe = ze P®) —| ~ P@)=P@
Subshtiing tne relation 15 £). We gel
2| 5 p(p) pa + ZPD pm =
|
TEE po =f
ee g
(13) p@m= 4
G7
pO) == 2S ew)
TSR
Pal shove PO) Wet © 6@ ie wh as 27S is oe
poh _groke is given
So Geke
mes
SFT care
ob age rls loge 20.9703 4
x gece A bits [doyro bof
= ———
eee avers A bits [yen
i_edy the Souste is giveo by
9
HD = h = KPa tthe Palo + PH + Pow
‘=I
RG) = 57 x 0-9709 $2 vl 4'S n0.5709p 2H!
1g 4 1g: S
| H@ = 0.2838 LitsKyn |
(a6) Fby the Prarorder roarnepp medal Lhovds fo pigtere, £9
the | ctate Probaikbes, -e.lrory 4, eno’ Stele and
OF
2D Ry ty the Source
Wrettten as
pO = 22 FIDE OR PQ 7
PG
pos pspO sew 0a —
rl pPOr PO tPO= =i
_ G0 s- | Fron the Ste Tagen, Sul quiboce Gane
Coa Kiem 4 1
G-o.2) PO = 0.0 Pe) comet
D-@ P@ = oa pe)
PO = 2 p@o= 4 PO =G
i &
=O
a 0-2) 9@) = oa PO
j-————f@= 3 p@ =5___.
Subst: bake a? Ag Bi iow? 4), We getm
; PO + = Pe) +'p@> =1
= a
Coo i
p@x st
jg
g
pe =
Pak alcove 0G) value to 6) &© we gel-
pars 1 A€ 20 2 od Oe se on |
3 13 6 RB TS
A Trae [ [P@ = 33]
f a] oo
er op lot ta wk ib Given by
P= Eile
le
Ha = d.olog pk 0 Blog 7 = oTa2 bits| Ge> Gar tt ees,
/3
23( k(t z NE ~
eee
2? From the state dingnum Giate egutiond Gan be tortie, aa
ids SPO + PGs” €) ie
Pe =
P = 3. Po+t Py ——@
—
We Boow thet
PCD+ Pad = A
Bor] eg? (1) &
fa - <2) Pw) = = pes
+ pGd=4
LL PG)
G
ii = = Res
cai)
Publ above PG) ty 297 a we.
E oe
F - ae Pel Pee = =a ell Eon, toe eae State is
even Bye
[Comin]
Ht = _ Pilea-F.
nz ai oa 20.9193 bits [Sym
Has 26.5 34 4 2 08s wieleyo, TT
[Catropy S “the Sounce le given by i = 31m
ios tee eras 2 iit Pa Ma 4
|
|
2 Ta
H@=H= 309163 + 4 x0.9N3 -
7 a
[t= 0.2572 weslsyo | —G)
Consbrution 3 etree diagrann.
—-
© | Fiore lp 9, 38¥ stage ree
HS
RK | diogvanm there ave 3 paddbl
-- SByXKE
4 ’ 21g AV Mesoyts 9. longtfe 4 a
a
6 aS y ponding’ Yo bation
4H ZZ ax PO = Bxk = 2. j
| i Zz >= @ zzz a .
Gk ay AYE POD = B.S 3: ot
r dl ig pO 294 Te
d= Feb ne) = 2!
sane
x pO “Average sjpnetion link
7 qx Kymloal io epeasegio Grkt
a is zoning ene Symiol ts aven ty
NEO ee Ge Cpa
z + 7
eB BZ be ay ort
yey are
Gye 4.557 Bits [
