|__Enformection They. and. Coding: oz |25 Prove that _Seusce_entrepy As _mavtimun_ihun_monageh cise _Inaaringe __ || _eqaal pret ae — et‘ be ho, of Kowece Aymbols A tne —Hhay ase equiprobable, boul 2 ff ¥n z t Hox) pled. tog CC pews) {| al I i 4 I s ae : ca 1 nxt _log, (Wy) __Usin, Ho) 2 Ing, (A) when equi probable. sree ae ees f(x) = — (0g, 2s a lone function. E(x) & flex) : plx:) tog, (xy) £ —hoq,( £, ST ) fon Hor) £ = wg, (nx 2x) ) Hiv) € -lo9,( 4) Hlx) € (09, (n) bit /aymbel Example. dot ot; = fv,, 4 0 Case 4 equi probable, P(%,) = Pl%.) = 0-5 A(x) =2x 0.5% (09, ( Yos) = 7 bit /gymbol. ‘Signatur[eeto reel oz Case 2 i Pl, Je 0-6 Plo) = 0-4 MO): 06x Ing, (Yag) + 04% toy, (hu) = 064-4 4 0+ 3 20.968 bik / symbol ut Pn run a Aymbols ase —_eqau_prolatte. a 2. || consis i Noha bi lit fo.S, 026 o.126 01254, olcutabe ounce entropy. Lot. Riek, ney st Fe Hy ty eG Plu): fo-S 0-25 oe o125% Hod: “2 ple) tog, (Yous) vl 50:6 40.5 + 0.345 + 0.335 2175 bits / Aymhot 3.1 @iver on Awan channel tit & ku? bandwidth and the noise pow to"!* _po/me. The Signal power Soquired at Hre Pecriuts is O.l mW. Determine the channel capacil Sel. Given Biz & khe Ne—= to"? w/ne 3 = tot w = AL My XB = &XID Ww hannen Capa, = 4x x lo9,(1 +O, ) exe Signature...arr = 4000 x leg, (25000 +1) C = 5%4 Kbp Channel capacity = 58.4 lbp: FG the given message pmbabilities . Construct Shannen= and Cede_tree and evaluate the loding ce ficiengy. - Ba pepnnoe ieee ee erie ik are ey P(X;) 0.03 Of 0.0% 0.4 0uS O15 0-7 Shannen- Fang _teding | Sypahel N z Vv Xu 0-4 Oo 0 | x. O15, O 1 - Xx Os ! Oo. 0 | iG Ot L 0 cL Xz o.t 1 10 x 0.0% { 4 2 © x 0:03 (Te ed x 1114 + 0:03 2 [Link] os oi Xs t1t0 & 0.0% Xq Oo Og x. o4 2 OS x 100 0.15 Xy 110 3 Ot Signature...Hide £ Plt) (oa, (Yup, ) 20.112 $ 9.3321 + 0-33214 4105 + 0-522 40-2605 22.424) biK per Symbsl f= 2.55 bits poa Symbol. H = a S. || Re peok He question 4 Conkideaing. bujgman Ceding kehnique O)_ And. Compase Hn _ ef. edency of both Hae enteding Schemts. Ansel] Hubtenan Cooling Symbel Probability 7 x am x x cee — 04 — O14 —~ 9g —oO.4 0.6% x O15 —— ois 60.2 4 £0.25 60.35 Sony Xe O15 Ou ois tto.e 2 tho.25 £ Xe o.1 ot ois) o.15 21° x o. t—L}o1 25014 X 0.08 2 oa St Gg x 0-03 2I Symbd __Cedeword __Gedelungth _Dyobabilite x Outs Ge 0-0: x; 0000 4 Ont Xs O10 4 0.0% Xe 4 4 Oe x. ool 3 oul xX Oto 3 OnlS xa oooL + o-1 Signature...2:5 biK/ eymbol aggre a3a7 ———— 99896 OY 7 6 Hagin aoe _obscave thal __the _ePRicienty Huffman ds geeatcr fh. _the __Shannen= Fone Caching, tp 2 rrp : 1 No. (ovels Cm) = 16 H Rake) Sepeatitien f- pic haaes (A) = 32 pes second. Seudde Entropy HUt)= Ax (09, (m) ee 2 2x1o8x tng, C16) HOY) = 2x 108 bit pea pictuse Avesage ate of information QR 2 A x He) = i - to =_256 MP: —____||_.", Average vase OuUie = 256 Mbps Signature...Ps a eligi dunce having a yt dat_ond- det. $§ det duration i 0-2 sec and dash dusation is __ 3 Fal the det_dusation. The pYobabihty dots eccussing js__twice Heat of dash aind tht Ame behween Syrabos is O24 Cobculabe tae information rate f Hne felegsaphic Loudio. ef. Given Dot 7 = 0-2 Je Path dusatien ta. 20:6 hee Spating dusation ts, =02 = Piobabilisy of dot = & 4 Pldot): % Probability dosh 2 Ys + Pldash)= Vs Tes Pldot)- tase + Pldath)- toa + tepactn = Sx ty o6%2 4c. T, 2 0.93 Sec f QR 2 Vr = = L845 Per gotond. [Heys PUD 09, Cen) £ (44) + 4 09 Un) » OUR bik ma bo. Jngormadiin wape R > Ax Hy) > [849% oUsS 2 [642 bit gee Signature...bam | pom oe | c io i can be eneprested. Cs. Blog, (ict swe) Where 6 indicacles channel Gandlusidte. Ans Cz 6 (og, (1+ swe) a SNRI- Signal Pew, Noise POWeA . + channel Capacity let aectinid signal = S40) its rato Squate value= _al5 tab Noise powes = iB mean Zeusate value > ASN ee een i Asa geen: ba = ia aes Us e Se,_4nformoation = log, rinse = g log, (r+ 3) jeune, 2 } — en aie 2 Kw, C143) 2 ae orrelilte js = @ Signature: ee oe ZB 7c, S ES log, Ct $ C= B. log, C14. 5)Orb + O.49 + 0.6 + ov 154 bits /Ayrabol OISSF + 0-423 + O52) -+ 0216 + 0 Sonige el bits / Aymbot. nos £47220 = 92. ZzHt) CD org 22 LSS9 bis ol 49, 2) 1.985 2 Ls sq bids /symbol- H = Y8.05 7 A Hh sat A Hrecrund F A discrete _meorhiyless binaty Leusce produces Louk m + 2s) % 1 ilthe a4 013 0-2, 0+1 9. Coltulate A identi fs t Aentaincd tin Hae memages ( pant Land (r%, x, 2, >, ). ese ee eee ee 4 Plu) 2 Love, O13 oty Hix) = pra): bog, ( Yer) in 20.5227 + 0.5210 + 0.4643 + 0.332) H(z) = 246 bi K/Symbot. Elo, 2, 2%, ) = bog, C Ape x42) D) = leg, C1! fog x01ax ou SiamipgiGit/arc 2) Ll, 2, % 5): 6. to2 bike Signature...ox P| | Cay 265 ts ate) = log, Cate ad) ; 2 eg, (sx 0-370276S.)— 1 slog, ( tapi) 29. 2p! bibs . 12.1 _(engidea_Q__Dis crete _momedly less Aysiem x, Haak 12a ___— : 2 i -v 7 2 z | x (OO eea tea 9° 9. | ty OL to id 100 hy. to 4t doo 110 ; 2, cz 110 410 tit G) Cede -T = = 00 | m =O4 x,- 10 . | eaeeghy kod eee ee pleas pe etre qt te te é£ft _ 12 fr Signature.TAR ag Ket a anaes + 2+ 5 £ t 1 4 7 1 Oo fede - TL Kraers Inequolitiy, % = 0 iZa yan amicus _ ket x,- 100 = z i ae 7. x.- 110 a x, ae Kingh 4 inequality Labisher. Code -T ewigte. (edo - TV 2% = 0 apts tnegualiky %- 100 2 3" Z 7 4,-110 ad m2 ttt x pA 0-835 ef Kratts dnequality fotsbes. (odo IW emis, Signature...Ao prefix free Cocks. La AMAL 2 Eid Gode -T Xs in Hye Prefie of 26 LA Geode -T >. +__the Pref, of 2, € (3 Endod tha allaing bias tag Let ie | aenithm. 1111 0000-1100 1.0.10 £00 1100 004 111.000 z ri tra discuss ies lena An fi1i1fdo000 f10010 140 Loo t100 001 tt1006 Signature..Hi Ooo £ bf 00001 OO 4 0 ae oaott oOo 1 4 =O on010 Ode Or 0, oO 00000 (olkentouae 00 01000 Otjo-: 4110 00 100 Orit of OL oor (2) eye Oe Oud) O10 OLt1o0 toot 100 ootto 10 1.0 1100 o1100 J On fod Oos miner Zi tit 00 4014 710 ooo o1010 Disadvantages + ee IL € High om in : neLhicient. # Slew Cemprersion and Necempressign, he Performance’ evv Amoll fileA. 0° # Adaptability 4nuss,s on 2 oe Rome dats’ # Sliding Windew Te chrique 4 Trie = Based Hictenosy L£terage. # Hy bric approackus_( LZw ~ Lempec-ziv- Welch ) t Dictienasy petetng TeLhnique. k Parallel “ PlowsSing & Hardiwase Acceledation.Prove 45) = 104.1) 68 ah | andj, Prov that LC: x—and_y 032 tne tandem Vasladrtes- _____— WTneAe. {____1(¢ 15 WI2—€-£ Peary) 9, bs BO) ey Baye's treBiom 2tates that, PC x fy) = P(e y) Ply) 7 ! Sioidaaly Pl yl): PC-¥) € POD) ‘ Pl¥.y)= Ply) -pCx/y}) =@® H Plx.y) = P(x). P(y/x) —>@ ubsthabng @' in (- 4 > fCe,4 43) = £ (og. PCH) PCY) 4) : = mC) (et eys oe € tg, PCY) > @ i P45) | substi uti in : G(x 43)= tog, __PC45)- PLT 95) es | ee, PLL )- PL95) Gx oy l P(x: fy3) 5 PCe:) 7o I Gempasing RMS. & @ with @ ke % and y ose inkeschenged. | “OF (us y)= 6 Cys x) [SIgNaTUEe ronson =Find dhe deceiver_prob prmbability distnbubien PCxy1_of following a 4, => ‘0? p. 4. —> 4 ( orey State vole] 4? Gao RUE pert No decision cer (ew 2 ; be made. P(y/xj_= [U-P Pp oO f ° e (i-p) ‘Signature...‘Melesmine HO. Mev, HEXAN), HC YLe) Ord HLA |_A__tha following —channel_madtixe, Gonsidesiing eee 0s P(e ne ee | OS asi | . L205 Xe 4. | Se : isa jammed e luevye € ptx:) tog, (4) | ist = 042 + 0.52377 = SH bits / symp Pla ds € Pls, gy) = EPC) PCP) 1 roy = : | p(y): 0#x0.3 40.0 = 0.24 Plt, ) = 0-2 ¥ 0.2 + £.0% ou 0.3 x 003 = 0. * P (43) = 0-Fx0.3 = 0-21 = | HUn)= € Plyi)- bog Gia) O: 444) + 0147 29 + 0.4443 [244 bits Jeymbot. | elas 452 PC Is /xi). PL) = fo.2x03 0.2¥0.2 Oxn3) [0.24 006 © el O-xou fx04 . Oxne |=] 0 Or 0 Oxo% 0-3 x04 OF xorg) © 0.09 Or21f HOcy) 2 0-494) + 0-4 743 + 05294 + 0.2435 + 0-3126 HiX¥) 2 2-05 bits /symbot Signature...H(%/ x4) = Plz: 43) bg, ( = =9 Petey! etre x tog, (Vas) donee, {Zao la m.08c es, €'Zoa) +021 (09, ('/a.9) 5_0-0F792 4 0.1393 + 0.1543 + 0 (08 HOYLL) = 0-42 bi /eynbel P(x, 45) = Pl *i/ 43). plas) PCx; - ) = O.2 0064 9g ] 45 f om 0-55 a “ CfA. 24 OY sg fo-21 [2 fo24 0:0 o.55 °°? "Yozr { ea ey 6/55 o] poo wh, 0 | [| o 55 a] A(x/y) = Pix: 43) log, ( Hema » 9 7a} 20-1917 + 0.2350 + 0-193F 20-6) bike / fymbet. Signature...(Data Eccles E> An input alphabet (source) Consists of (00 Chasia c HAs. (@) 9 the Code words are encoded by a fiked (ung, lade, | determine the Ryuired ho. 44 bits ~A encoding. . Slo fet ud assume that (0 of pho __chasae tess OAL egnally a Likely. and tat Coch occuss with probability 0-05. alse Lane a ee ee Cibely Heteamunt the cwtaage number 4 bits acquired fo ( fntede tis Uphabek Using a Vasiable (ung Hs Huffman cade. ll Given, Toda chasactere Cm) = 100 | yo. bite Cn) aquired = [leg,(too)] Piao Gow FP 4 |@ 1. 7 bik ane seguized 6 encadiing intake of fitech Gung th teding. : Mb) PlL%,)= P(x,)= ++ - Pltig)= 0-05 _ P(x, )2 Ply). - +=» Plt,.)= 0- 00555 i 100 i Hide 2. Plxid: lo, Gt). rea + T = (ox 0.05 x (09, (eas) + Fox 2:5 5 eg, ( ma0ss) = -(609 + 3.4466 ee eee A Censidtied_to_be too. then the = 569 bite / £ymbet. = SF bits Jey mobs tt 6 £malles than the _longty jn Case of fit (ung ta lode C4). Slgnature nese meroel 22 19) || A speech signal js Aannpled at 2 ku and Codecl taitts dikferentiad Peo +the Outputs of whith beleng to a ok Of Light Aymbotas. The Sym bos howe the __fetlewing _ Prpbabilities, fou, O29 atS, o-) 0.05, 0-03, 0-01, 9-014. Neteamine the _sousce_eritrepy . pla Colculake Hae Boule entropy ie Batt ieee ge 6 Ral, a fot, t,t ee, XG a 0-4, 0.25 0.15, Ol, 0.05, 0.03, 9-01, 9.019 & 7 Hor) = Pl). low (ax) Tet SOS22) + 0.6 + 0.4105 + 0. 22 + agibly O15) % + 2x 0:0664 = 2.287 bit Symbol. FE thy m ‘ Hy )= (og, Cn) ~ lag, (2) 2 bits / dy mbel. : 20.\| Mesignos wish te +trantmit voice ot 32 ib thspugh 0.[aom[" 23 We know _thad. Blog, (t+5NR) _ Cc 2 32xioix leg, (1001) Grae 29-9 Kbps | The _clata.__Cannet be _trantmitied eaadh Pree thfuougl ——— this channel To _todintoke the rantmum snk fA esa free trou’ missifia — i 4 pS sci eps, oak ne ——{|4n this Case we fake 32 vip? = 3x 1p* (09 (1+SwR) a SNR = (624-5 by 162g Eo 5 Mo nk, —? @ SYR = MB q = *hRaE @ ubstiinte @) in (OD ‘ce Swe xB it Rp afee 93-95 = lo x [9g(93-75)= 19-71 dB Signature...