0% found this document useful (0 votes)
41 views20 pages

Big Data Analysis Notes Unit 1

unit 1 of big data analysis

Uploaded by

yanmaygharat24
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF or read online on Scribd
0% found this document useful (0 votes)
41 views20 pages

Big Data Analysis Notes Unit 1

unit 1 of big data analysis

Uploaded by

yanmaygharat24
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF or read online on Scribd
You are on page 1/ 20
r Onrik a AN | | ) DT _Inbioductton lo big data Fyivhol is bg data 1 list and explarn the has — ital which ts — 9g dala eles bo large amount of date_| andthe __dabe which is ineveasing rapidly _ _ays— the time Pous. —Tratein_determining value of dala Along Lchatac tershis of bg dab and Gntlrackaved dale.) "| analysis “of doba and be proces {Monge 06 ove tsk of big dale anctai bevithes of a dole | Molume— - _ Size of date, plays avery —_crueiat Pius aa ‘les tal. tele = Toda ho i+ -bto [oes The Femi be CIB exahyle CFA) 2) velocity ——_— L ~ velocity —telen ta — ___i fast dabei Real me doa by __deerde. dabo or = ai! _dobo i _ pale iyhe—108 the speed generated and analysis 1s whe the, bas Hing Measure, Or the, of hoy, PLO Rag) Craig} in many 9pplicatron such __ae trading, ney —ond lot _seclal media pont bot S) vonly — there __ave__diffeven ot sbiuctured XML, Ison), _gr_unstrue bured Clexb, video, audit various _Suureer ——sensurt__foeral 4) ve rectly 4d __tancerlcinily Dala such kindof dala ster Coalabasel- Seebstruc lured Cin: images Can come from Of website, hooks medio. —sealing with date SU pally —it___sheved, inconst ten cres, and oi LL invel éacompe [explain challenge; with big data fehitsa: “Ul storage dale ts _gyowing _ rapid on _the. and becouse of that processing date seem, complex unstructured date shoved. In bradthenal data bare big concern when tb comer tp __bfg data __ hecaure we hare linve the date trem hackers and come data plat forms hove peor Mata quali, SIF ae gual, in data 1 Larcurate, _complele since the dabn grow ks hecome _diifficale | ko maintain data thak ——Hwe must implement dala cleansing | land vol/da hen proces | Seelabilit, : Ay the dake gro 1__it__imperteht Wie impreve ow —_sytlem to handle dats increasing — cf —data.__which make ib more castly and __complex__ le __manage 1h Ava li bilit. —— Noe eee ee ae to__-devide_whebhe, | iL_alo hele a Gabo otal bay Fy explain challenger with big date c-data— 8 daba—_&\__Measuy | . size The bd on 7 ye cB. petebybe (PA) or eye, ANS slorage inter. : ‘ cxabyle CF The dale ts _gvowng _rapidly__on the "enh daily basis _and__herotse of that a velocity = speed of handling and procestng date. _t—eem, \velectly—relex ate hs eed oroettt~—_heseme more _eampley _._unttrachuved — dots fast_—dala—_tt ge 7 toetted cannot ___be shoved _in__Lradibenal __dalasare Realtime aba analyst 1S crate) | in__ many ——2pplicalron such at —_Ladiing, “a secuviby ond lot “[seturily ip a big concern when __tb — “leome bg dala because ve have 9) vonl, —________—_— “Tsave the dala {rem rackere and came — there ave different kind of dala ‘sueh, Uorms carth Gs Sihacbured —_COakabasel- Se@bstrac lured Css” ——3- dala — lalla fee Ree or_unstractured Clext, Imagery socal media — thonl Loring Ta) pata quali, video 1 audit) — Nala can come ftom _ + | Pala quali, includes ensuring data or __vorlous _Soures’ _such as website, _heoks |arcerate, _camplele and __relah/e__since sense, Social media. oe Tthe dala grow Yond it become _drffcals - SS kg maintain data qual that 4). Verori en i | ___we must implement dala cleansing Veracily refers le the fi ea - qualily and ati —of_the date which __s tered. Lk intelva —— deg ins A = pling wt data incon ten eres, cum 4) Scalabiltl tncerainilrg, y | Ar the dats and valldaben proces gromt 1b important _ a ho unpreve tytlem Lo handle dal» { increasing C data which make 1k more costly an complex le _manage rl An. (5) Ava bli, = Pee ‘a [oer anil “he ton be Malle Za tne jos Maly ence Pate scones thee silk hole sbucturs ond —_ cl (use on Ue pal Ik feerat am, ths falare hen compere’ Ls comples salt smeared —to_Gl lial Ik make! use ne a ah athe que Le deal ith 1 queskien hal sil heppoee fi anbaspele "RT helm Le «wsieg dab eal _coue dace “vite analyte te vncome__—-undertlead eenent — dale —taaines. “UL har hig hes “campaved lo cbds pales va TL otecvact —Lrawdem the ELT Cexbarh wih wged fe tead Yanalien| dae_(e procex & wed re applicatien fer in beg brew of daha to dak Oe ene, ——_— a | @ Ai dake —analihey Hn ker ave Ripley, — bows are gg Fl [Belo —cerpennblie ef «da scent Tice. Spethe._ fe haan. Bead — ” oe dake ental (Bibi aeb of —bechneligts— — {jni_|Duba ‘iene —u_preces of e@ackng tow ee pre Uta fel TO Til dain Stewed TE 5, teal (et cre ured hy tet _malhemmaber hidden —pallan fom deloby_auing compan far basen slater and vary,” | stosticns_and___matherna teal _beebnigteer Gale anabs——— alkee lane dng — Ure hidden pale _—_Rerpensibililes inthe dala Ff Reka management - — LA dala scienist —calecl dela fom —vavitin a [aba ov lecaben —wheh is Raw formal Te the deh senha) Neve te menage all_ the date andthe alte _perlam sm. ———cleaning opera ten te maindeve — dake _quatib TO) Mabe visualization — — a dala (ent ho be creat tae TT Vineat —“vepretente tina the dota er | es Ihe —fesuil af the aba __snciysr bye ging tilt ike power BT | Ts)) analytical —_teciniges a data seienkst — has © develop meds — _ [Fan d—— algoritien de. _anderskond the - dae hnd hidden pa hers, _aberphet | yolatenshp —.epel — bends = {al nate Gwemane haba yienlsl Aer © mate sure thee ___| { The date pwde — apprepigle standards and y eeu yl the data gathered ‘S) Communicalen earn vcenbs rath be 0 920d Colt? a thel he cin atenent theres a Fi Ghali 1 —sullble longing — understs by —all_stakohaldn, ~ Gani th eam mente and —leadae Te deelop daa —2tealy et Fel whal are main phaser — of Lhe dae analy explain wilh diagram Dale —enakslical uh cyele Liscevery ale _ proper alien a ——redel — plonnirg 4) Discovery Inthe firsk phase dala stience (2ou._—tne problem and —_ then untetlond the prablem. Base 4 x [problem the, they gather? da.ba (rom Ceieassuurce im dferent—_feem@l ther ft develyp an inital hypalkest sich ecbrst lakes DiDala—pvepara lion Gir —sten all the iL_reguire erly = thak Lear __exenle to get rand box teat dna ave saw oper feline advo, Alone a) ade —plann'ng In Ds -team —chadies dale te —ditceven connec Hen et vaviatle, Then ih liam bald model bare 00 Meds als ‘ths —phare—lenm—oveale ob Lhak ——cewr—be— ue — for tia zing production and —teing — geal 4) Model sulting in ths phase del fe ominim, esting —and_—_pradkc tien evealed the team que evaleale whether —cqnvenl —kaale— ee dent te tun the made, orf enviranmeni.— lon, ii help tbe tun derstand the past vobal Be—netd— matt laren Ih yotlatonede Ik shew bee Vint oo tike on a pach et ees rete thee Fesell to wv) Bagonibe analyte Ta cittehlden—in__der_te In Diagensie—anahike we Cxamto_dale vetemmevaelne the __resull_1h_sucee le geld endackon ding of ada se lun—-haye ap Dre_—_crt Len ~ | eeatlly happen er fean behind — past _ever se dovelp in phere pone heatthtere il —tdentite the cater = - of high eabiend re admin “a |Prediclve Sabo — In this Jand gnalits ue Con _predes ©) opera crate a Ih thy beam ptadueer — (asl —veparb —_ presesabin and tod they Giza fen ___|__ the la luve Joase nth: past__date ese ck pigjeci te implement te mate | _ eg weather rece ~ ina preductén —envinamenl TG Preertpiive cna | ty ths nck only p_predcet the — (aluwe even bub ale we il _adeffers “recommen deter fee — ° Big dale — cnalyhes Tt Ans y— dela —crolysh rele he prow berl rest 7 gf examining —leige and —dliflren) deta seb) eg produch pn fo uncon den pattern —unkrow [= 5) Reet time — anes — sortelaben —markek —bander__and__obber veg brads — — busines —inletmabig gpg rap —— toe adres —apalltal bethovgua | ae = = fo ertracl nahi tom val amown — —— of dale thal” Ivadibingl dake —p¥otenng — - _ _ let ahi — pal he abe Eo hone | _ ellen bal - —_ Nps of big dale oralst /cleafration | Ebene arta ae tale colt dale _evenligy ms ‘wate sherk 7 1D Aglemiclly, Sot k stake 7 A coll shale —_veftre:__be_—_tempovGny, flee ol dale shoved in —ditliibuleed _~] (omean Syke —rméy—exgertiong | 0)| sola ben: be ik tla. even whan ag] bs oe given due Le _exberngy Gi lpava lll ike dade upd er —typleny >) thus the shale —of the —rysheny | = x_n toll alan |— — Even lene, “| the Sl —evenlealiy cents ce ik vereisng —inpyt the dala | — ferynNere but Lp _ cance ie reeelve inp cansitens, of sll td —evenlually —censilence erly pitem— te pent —high'y —cvallable ej inant Lents ure” evenlghy yore Bascal oval Lb reled sytem thal Tin even in pretence ny fiance - ave detuned * here system detgned Ic __handle —reques even if wome ned or CMPIMeA nec n i 7 pate. Predict ond Oy aan by An A bg dale —lpeline 8 6 iL_aske © Dudemaiion ‘ eee ingestion inte gale in —pipelite. th can cnd_—unslclured date logs APT. alter a the ~ inteyabed dela under aled date yon proces dove date sener deslinaln “ate = operalty pipeline nicer fin yale fhe moy involve yenslorme bon, gad ether option analy ay slerag sj _slovage Pracssied dala is shore taka _slore 4 weatehewe s on —ergeninatcas —¢ | Analyt | anelystenl toate and —Tapplied le the cored =| insights patina and 9 Vimelfeaton the —_erull al the in__vimal_formal iL easier —_for_shaked ‘and at ipon__the Date A tater ean cleansing ville. dale vepiessalied aderstond techniques whith — dilvenl from ano \her — grour, ~ analy dle 9 expla dele het _—Batiddr a tell 2) | Dake Alstribu Vow a sede ling dala [voce the "s ale — - Tie bere in deinen dito ve jeri Tar per cham [Fer veduee tne bivcele laa ~ [dusk ——pracen (acai stored aifata—shotag ua ie ached and caplet anu be e vedun dane fry faba ar ep@h ture i lis make acy Heed longi ee - (age —ameunh of dala in __a_diimivled | obs - Oo annals a“ Tin —hndogp sek is ony —comeulaben bask ib Jeagned lo _hondie big dato cand petted. __jahr _—moy te 4 ue Sn mig reduce —_pcciatomig Pte | caveral Last _pevfermed __on Fealures 9) Programming longue - - Otte foult—telavonee | Fanil Lalor | stbe com puLatisn re iis = atl 1 bow cash Rear | \anguoge —~ wida_—_high— : Ai ibs —prapimemng 1 aay ala — grote : — 4 “huge” Clea —shoreg. “an nat _ - - SL dughly —vahanble ss || foul — tolerance — ? Gecasue—theve the —tystem Hedge pitcipla z + decorme — (aul jee] _ dala —ov_nod nie — 11 Telustening ‘mining iL wll system Teanga ep — lenge _proctans oad —— dala _thich having seme —ealure— Z : work —alleca don greop spettfea bin oF Zi so__thel —@ach—_pagrane. ‘fe each grup have fear atk 8 « te a => 1 pla ubaled —sherage ——ond_—eride ably Je cached in We memory > Any Tealure ol ip — Memon, caching bes — inact specduga in oxerabten and Lng —ibsralive —exmeling sic sendned fey mcbing — leuing anys? APlis a clleclen of eneraitar sed (or —_cveabien ._trnifermaken export el RD | n-opetsled Goan Wrerlorimelen ners ferma kins here opeatin thal ave — oglied leon eriking R00 tr ova lon ol_nen 2p tal sh) aD J Action are —aperabion thal will teary them — tlle —duer_ prog ai inalton af ait paris ttca In_ankeck af ol map rede —medet.—m feaadouakin whe ‘reduce ii en. aalton en te Lrenslorma tion alley as —_a__fimelion te each alyert of RODE ger wale whe ayeel of kop ooo NCh tn _ovapnteg of pertain agg te date —operR FB Eeplain the cancel of compabrg nll Key Cempatiog — with Key involve ashg ve identiiew. cr key. te eieienly menage, crgenine, and proces_lovge volume: of dak. order__ta —andentend dale lem seek Ewe need te undevskead relation between key/value pairs and —_paraile) ~ leampuling In” map reaver + all date i —[atuckeet as Key balan in beta Ine map and reduce ata ey con maintain —lcrtraten has clhendy heen reduced ol one in dale flew, autsmabeally —— ceresp resulta! fg—requived — fr — cempluish Thy Compound Keys As long, key —are : hahohle there it 0 te woe —_inkeges ov ching. Canpevable — types mal have ele be determine equ some typer_eot Key and _orderity Hoghable—_lyre—_8 eve immuled'e types wA‘thmecns we canna make thenges AQ —ath—-R¥y of them tebe Ge con -be—-mALable Shen they Lub bul hwhabe tuple th_iemabadle- rulable — typer such gels and diclanerm can __becume _mmatsble se

You might also like