0% found this document useful (0 votes)
31 views14 pages

Big Data Notes

helps in revising concept
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
31 views14 pages

Big Data Notes

helps in revising concept
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd

calolaiovs.

a ponputa prugom

)
) Stuctwued
Seni
)Muli
Structuued
Btucud
ujtlnatructucd

Pro cs 4 wsuals.

) Define Big
Big
Data ond clacalon
Dala and itb Chaactesbu
o Data [1o).

Dine 3v'b and theu


Big data catuaS o
Tlst al
3)

Data wsed in the tolla ng


4) Houw e

nd Jeauices uing
anayta
numbu
)
Chocoat Makding
aled autom atl
Caimyong
chscat
th
turng nadinu

and predictie atom


ative

ii) Automatite Comyonert Cutome Suwice


maintainene Seluityenting vendig
maintainanle and sinuic
Conneted o cas and

to
pecldig monitaing and
prditsn
Hi) Netla deta
iw
Data hta
Bug,
iy
Zhy

es
Butin
New

data Schemas
uith
ont
aweciale
Data: and
Confotm
OShuetuddata They ale inkstrictuied
sbuctued data
medcb.
data I5-07.
and
date ond afpend.
pda
eteival,
delde, data
isut, fata
Sata enahle
to
Indeing fot data ecuity.
sclobility
ond cduuiptän
ensgpian
d smantia
Semi- Ghuctn uhch sepoate
o othu motke, vecddh and kelds
taqo
Cantain
elenent
data
uuthin

E: XML 4 JSoN docunb a seltianal


3uch
asoiott data modes,
Data do nit

det ob ases.

Mult Coctusd

e multiple tem at data, e


Rfo to data Consistng
Stucluied, beni- atuctwed o tudued dala.
.psta dou not poses duta featu Auh an a toble d

datak A.

.Fond tn ble ypes such as TX. Csv

ea: Mebile data

Deyn
Big data

data i high velmey high -vdsity d higt


iq injoónaton that eque neo folns
.ta
sckems ceulay enhan ced decion moking, inight dicay
pces opti miaten
and
ze is beyond theabilt,
to data set hhoe
Rekes
databae satwale
typical

manag analy

data sct so
Collection ALL.
nad data ihadante

onta
Chaactestis.
. Volume: Relatd to ie & data
data

Uauety :
: Ceryuy
ualty
avality f data
data Captuied ,which can'valy
Vaacity

) Tlutsr ate big dila'leatua


3VA 4thei oelioakm.
lly
Big Data Tipcs

)Soial Netweks (F8,Inta ete)

)Tans oclion data 4 Buineu prcess (Uf,


cd
CaLd , light booking, holel booking te)

3)

u)
Cutomel

Machine
mate

gereuted
data.

data ( densels,log
)
data (not)
S) thman -qncated
Big Pata
Dat Clauiliation:

O Data douuces (thadtinal) :stavctued data


(taditiena)

Bug
Data

Dat
Bolmato

Souces :Strut, utus muk, seni

Big Data tolmat

5)Data Stotu stuctue


Aata rates

( 9 Big

Data
oata
data praug

Big Rata tandking


anahyis

wag
met
methado

ods

chaigna:
Dati

Follauig

analyb'a.
)hie
4
data
ylain stuc
tudent
du'a,hieaachial
Decolds at nieuity
eltimips

&) Conidu te unage ex Bg Data tot a


5
Ca

Asme manfachuney
in S
Conyang cach medi b aValabde
madid Caws,4
tolect
coles 4s Cayy inp
hadu. The
entu lr
4 compont
wutmes 4 salu
modes.
Centre fd ole
sauice
His data.

Proceuing
4 Patalél
Ccalalty
in Cleos

Sealabilty
enabda

to
4
hoñle
ota
t wolblad
ay

a ydn wok.
te datat.
pa mast with laye
ogpliuthion the
epnglee
Pooeuing meens Scolirgp
means
scalalhty:
Vatical

Capabitia.
4 ioatrat on to
epeng algolthm
Ale
th at uBu
CuChit cttue
ect wklo,

sali m.
the
soalailiy hecd e
4) Cylais Holjota
4 Vutial
mausthon dta?ronm
by' conadig
latjo
rvuing ate
Pnulld taut
Mauvly pat
CpU,
ODatihding

te
tate

canputig
padgms
olel w clad gd
dtaset
ot

,
clate

Catilutd
compudng big 4ed by
pocew4aay
hititted ahayee high

cubith
ditnibutd N
2
Chnputidg
2
Paulld

datbute node

ten t bol cinpting that


a type
haed "proceuing
puouids debieeo
n denad
Conptn 4
ethu

Featules:
en
Stalaly,
aCtoutaliáty
,boved'ntidt

serSeuice cen be acced fuan anh


4 Cloud
od tae theough the Itend.
Cland
Clod esoulces Can be bS, ElahCp
Azue o Cad stoct
[EO), Mianegt ot Apocke
Apoche
ito 2 tundoneta
claud Secn Cank claifd
a Sesuice (i aas)
we an
Otngcatuct See,uice CPaas)
Platoln suuice (Saas)

SAAS
PAAS
LAAS Uoed ky end
lbed by
0od by [us
chitect
devlopes
qivs accey
hetwelk
qives acus to uy to end uss
Gives aCcew tothe timeeuenmet
Ces ike hictual to deplayment 4
reO

CAcces plition
t a Sesoce

3) Tt s a secc Madel that clad


model that preudes compung
wituslizd cangug
u intend.
tepmet tin that hodt
to
yeoetcu Sojte
Cmeolel] auailate
Make
to cient,

tchial Some knauledge sNo voquiement

handles
knoulcd.
Crekoild urdutdi

9t has aud 19 32'. theement


devd comgat
en emet medel

ANS, sun, v Clod Faebok

ehne.
ota
)hs wital
clond salotle
smivat to
salalle Suit DF buinw mad 4
ifevel

Compty
Cutu
Duik butd karge scale
Cou bgenizaay
•eletagnou Coopeatie
Single adinistat'sn

Data
ib ehatactuito
Evelutan

Stictui
DevgingDota

Data can be tolet.


big

data soces

tatadis,pre-pacuirg,
Acqtenin gtandata
at Jeuves,cutu cad o
Dota stdag

(9) Data -procuin

aud boy.
datandts Dotoatt ungs: nalylica(re
Etpott oj

to clad,web BPs,Bs, tal-tine,


Data Kraledge
ete schedded Gatcbo),
do covky

Byocosngin.
Areuingtaagy:
MapReda ce He, Sehedad
Püg,Spauk 4batchy o procung
hyoid

No sLdta td
Hadog MegDn
Coniduations Giatoted Hbant
Cawand
Pata tolmnat,
tscaling, sa
Canpiuimgmanagingt
Asta,
selg-healin),
pouk, meses

and data compion


Re-poug
Data Jematies
validaon,
Cauch as epoce,
fayu2 etad load
gte, oonakn batcheo d
preod Jal tine
Data Tranola
(ELT)

ctuted,
data ann
lngutisn utuctwed
ingabion
dita
ytenal ouco
data
Data
(tenal

Relany
dota
yecnt
Recenty

) Cange

Rliabibty

Rat latugty: Naudangcosbng


data evet ito wsclble le
Data nae, atlics, Mig 4 Duplatvalaa
casér
Conidu the

ming Valug and


the noue ,outticu,

aha ohtainad feam'


dupl'at

mauie
euie
Roten toat
Sue 9rou

peltel
Shina atedarce
Data
S)Sat neducion

Pata eichmet

at kandliy
How do dote tuclwed, bmi-tyuctwd

SL moddy

) bxeat scheme

>) Coeate Catalay

)bmL Coat manibdion lergag)

) pata ntif tangg


(pins:
Log
4 seauiy humas
mechine -gnutd dta
Sytms wing 4
Tha
Stouad'dte 4 data kon bihn procas (ee)
buinee ind'gnce (e1).

Ritibutd Databau Mangenet Syten

• Colectisn t logially inteueled datalaes


tu nethot,

In-Menoly Colmo Folmat data


data
AA colun oonat n-meny -llegs lauta
ony a fas columy a toble need
yetrral hen ih

4) checalto n
in
cay
belone

Aou sala anays

in
colea

atae Colun imemely


)[Link] databass

) Hadap
clusteu

pleto,
ita
vit) Clad
deta
vii) (ndiidnel dita
beta
x) Muti dininenoat data
media
x) Coia

4,Machael
[Link]
Dough Cuting.
Coe
HOFS
Ditibutad
telage

Mapy duccd Cormmorn


dadhited dtatd
uiiti schedalig

ytenn jawa -bocd


HOFS: Hadaap ditttd ile
o dota. on the
yden tole au kindh
daitibutd kle

disks at the claute.


nadd in Hodopt wiy
poganng dota
Naprdu avl:Selhsau lag

4 betcha
paaled [Link]
YAtN: Soau
e mangig
tuks d sub
te at
otthe
44 kandles te meanet
schedulig
etau.
auniy
ditibuted ko paualled
oyten
ttodaep
22 YARN- based
edua va?
Map

ale'

np.
ode Cotay the
Hodag
Common
Comnon: The madb
Hadong othe

Sade.E: Hadeop Connn produ va

Java Rrc 4 ile bosed data bntuo.


.Hadg itibhdd eSytm (tor)
Leduce VI
OMay

Keduce V2

syakiN

&Dfoutk catsalabebe4hal
Rebut duign

O Stole 4 protew Rig data


Distibutd

Lealty
autt tolelane

You might also like