Unit-

tin to te; Unterstanny Ie chetl, Runninoy

ohema on ad and hero

cndatantiy
on 0itt.
Semantsi Drteadtion to ttine

Data yes
Bemono,u

HIVE DDL
wo
alUE Svfpts:e
DmL and 4lE
uth ve bate
staleme nts,

alni kin lorgung

ndev on

and
-ing statemenz Cwafr
sfaenenla
ard manfiplatinlanyuage
them on hie tourínal
aunning
and
Hit g
Command
and

Jrtunduutm
to tunei)
wnyehous e Sudam torieh
a data
bul
atuuted.ata It.is a

& ucd to analuze

wu
-the top ohtadoopt
aubook.

-He paode
te

Jasne
otinslity
datasels
leszing
a staibutt

SQL Ke qusds talud

fntenna ly Convetecd

the
skip the eqliernert
Hirt, ue an
Map Koluu pyami.
ompbx
(DDL)

haripulation Languan(Dm) ard sen

Deneuti (unt)
 Tenl
uwe;
Ihee Ahe

at and scalable

•Tt
imply tnjmu
Spank jobso datane

3tored in 0fs.
Suh au plan
Tt alleun guntStrag
tent Reili and HBoe.bk
It

Can
operate
n Cempsessed daa toud

Suppostugedained Huntiors (UOrs)whe

Can poytu

.ie ,mot Capalbe arding roal- ime dato

transautan

4tike qusidcontain
 oene betuon uve and

HIRe

Hve

by Data
Andyd Propamrners
Q. Tt ollus Sal-ke 2. Tt oUouohe data
quevie
3rTt Can bande Stru-3. T
Con bndle em
etiyel data Stsutwed dati'.

Tt wots bn clint -d
4pfe uaty

than tive.

Q: Utectanding ve shell; ho
ARue shel| (-1fe CL)Rs an asential Component

pathe
used n B
bult o
ve 5 a Anta unoe housäna trartuoh
SQL ixe
top o.ttadoop1 enabieg
Oistotbitod
datasets stored. n 410R (4laaoop

e Shel paatdec an nty

yti). The.

xhnkrand
and mansge
ntesact uith re Jun qudes
 Key -fentoyes o ie chell

.tove uses a Calleo ve l ee

la to SaL

Can
Pegm opevations
ik SELECT,KOSEPT

dataset .
and Jow bn Jage

auel queru63 to
tre
o shltanlates
that on
MapReduu, Tez or Spasuk jobs

abtsat -the

3. Sehema - on-Read:
data at
ine fne
to
•fve applis Shemas
osut ine schmo

traditisnal Rn)
n
enore ment

4 Dala magerent
ehe (usoe inn Chale dsp? ad

aly teblas dugne pautts') rd rarag,

the metasore.

Dned 6unttbru ) ertand fntinality

 (ommand n 4ve shell:

tve shell
+ Stastng
1he cormant
Use

ive.
Dotabauesi

s
SHO DATABAt

3. a Databaue:

atabae-ame j
USE

a tab

-en
(Cl1 |0T,Co)2
CREAE TABE -tatteame D fELDS
DELimTE
STRI) Ros foMAT :
As TEXTALE
TERMIADATED
By,sTORED
unto Tabe

S JDTO
-path
LOAD DGIA IATH hdfe

TOBLE tablemame;

Doto!

Sa)
table- nane WHERE coll>loo)
Rom
SELECT
 the shell:

Bauh

-Aduantanes
et;
g ie ghell;

Sealabity
4: pnatisn

Use CaseA n

3Bauh

seo peormane
CUsre.

Rmirol tuibitity
 bve în big data huolhea

and ire On aa haclnp

-Apauhe
doth e

clat sets
aund
auabgn

Set ptie
a funtinnal hadop
To
beause lve uies bnOfs or
enuiooment
ar Ru
torag

Psugequotes

1) Dotal hadmp ( &et up

ive
ü), Iatal! Apauhe
.netatore
the

Pratallalun
eap:
4fve
the Apauhe e webtas

the tre tathol

hire by
the hine cit -m
dtting
and
point to the hatop ucoy
clatabaAe
matoetoe

HDES anct 4RN Seuwlca

gtat-dfs .sh
.sh
Staut -yosn
 launn the he shell

Basb

hine

1s up
nce the tve en,louonment Set
set jola

hae 3lapt to se
-A. load na nto re.

:Cveate adatabaue

CRE ATE DATOEAE anytus-db

USE
analytis -db,
Cuitome dat
toY
Q. Cveote a jTable A tablo

Sal

CRLATE TABLE cutorneys(

name STRG )

STRINSd

)
Row foRMAT DELIMITE D

ALDS TERMATED B4

9ToeE D As TEXTLE :
 the Tadu: Assune the data
unto
Dala
3 lmd at dto | utomer- CA0!
HDfC
Rs stored in
l
LonD DATA INATH]data
JTO TABLE
Cuitoner-Cav
Custome)
the Dalal
B.

Jo?lng Tablu
or Eysideny
and bukatrng
C. Use

2 Revetingta

8. Opbnize

Ue
Quy
Tex

poatitian
or
k81sutinn

Pauunng
heuionengine:

Vetoizd ny
eneton
baseel ptimzatn
ire sth othey Toot.
Shtigate
suaAStion

). ET Ppelinesl
 entt the hire chels
when done

Bash

Sehema on scd cund Shema wsits

Schema on-Readi T ?s the n data inweal?.

dat
.In thus suhema,
stho edh et
dentiy eath
has to
-the
Thia
moe jowatile.
doto ohihmre
shen the data
Sehema uaed npnlatin
but he dato
not he

a paionity
whih makes it, ay
tuo on the Same data. The
suate
shera made tadoop
this
Ule

popalar
n today buinan Slanvss

sÜema on Reod:

uu thebnett
data ko be
the

Consumeo.
the dato
t enhantes

o the ai labil
dala
 Stere
untse
e unorgnisd dal.

påadnntagi
tine noeatina
o invet
% seqjuiud
-on- oud
Lnlo
hena
to ok o
ad idntity
-the

peunt
Shema
in t
is a litte enpet utilzeon

Cset data sut Data APeheArlia)

3cherma -On-Reao

-bhie tor storng

a ho

data nto databaes Tus has puouidud

sophiatea lat s
enhane traditinal
rey
a mauiar coay t handing

Schena0- Reoy peLou dis

the buises àn bg data and anaytia:

 ho

in but

intestud sheh makes

dnto
unteneord
sijetion o ny yebdala
with orne alotatins usith clote aund sooay.
a Aata

-Adimta

> hii approauh helps to onpn the elatimship

blw data poita

dauibad the cwnltoel
suhera being
-) As the

Can stout ts oot.

mmakes etore dume

data

ehama ounuino

or woho
Sernf - stautwye er unataubod data

nt apget itfoy this ppouh

 Weute
data dlala
schema
Colleet

3hma - on- wata.m

: Tntrdution
to hive Quy log
(4ieaU) fs a Sat -he
ive
qny -Aprhe hive,
a date

quey langng too bult ,n thbp

ard
wase houg Wsers Pgo
hadoop
H mousPve
dabasets

and manag Conitru

wng ianitiay
S
tored dn HOß

tie Ql
why Ue

Use
makes
Aostrouti

utth
dlatabaeknodg
Redue Tez
Map
-the

pank aneealionhgn
) Scatatle nd levble?

tandan petahfa data

cust ahema -on-ead

uppots SLhema toutoe
and gemi- Stoutuyed dot

usth the, Hadoop elol

and can be ertndu with custom Stupts

ard kooy ike

UDfs (uct duined kunutions)

Tablua pren

.
Ky
hema
Data
eatuus

'on

Abstrailn
Rea
-ire SQL:

3: L like

4: Data maipulatirs

5. qalimization

tonpatilay
CommonHive QL peratien

i Data, beyition lanuage (oot)

to Oosy the stouctiat

tive 4obes chd data baies.

) Cveate a dntabse
- CYente a table.
Ato a abl
.
- Psop

Lo
a tnble

data.
quny and
(Dmt)

manipihaie
data

Tnueat dat
Qy dala

in ablea

8. Dato Quey lacge (D)

data
Used tpr

eubsets or
dota

peyorane.

data inso
brganze
tlkoy
pastitins.
buksta within

3 y, micatienu

vetonoc eneutusn
3 Enable
pestomore
 Paotee

2. Buinea
Inlettiyenie.

Dala oe houe Intnation

umitatn)

tatniy
imid Tsanaitin

)sRL Featuu Gaps

tive -
Hive Hadoop

Eneutin,
Engune
Radu

Doivey Tat ToDkey

A Map Redue

HD
mea
|Compla SLore
Whme
Node pta
Node
Q. Semantielangnge

Semantic Sus o the

lnga bh the Conuluuta
comd
and command
intjpsatalio
ard .Tn
n a
ole
ploy a Crulal
Semanti
dula pcoleing y'g
byatia datasata
dive datehases

trangnmten tmeoke
ond comptatiena) ataoi'and
enlee that ditut
Semarcti
Scule

Lioung nd

sermantis on
y Wal duined
analypt
to toc
data
enabi conmplaaitin

than -he
undyny
talhu

leat Sermutu

3ernantics llows quty ege

undontanring
pank

plans mpasing peogomg

osutin

longng

hou) o
mot
what -to getsieve
 On dala
dala Tnaripatation

Colurons)

Join,

Senantie üntoputatien:

t-Ategle and tont. ous (toT(*)).

feoeduby or funtional sermantia

and R

Ppe) ordala maipulationblandia

usth delasite

eoutut

Smantetoptatiy
flla tunatin
a mathod
Apey

Speije anguag (Ds):

3- Domain- or &a - on -taobop
Tool e -Aph pg
tailoed
jntindue etomhmantiy
plsttoum
sale analtiu

Semantc antpoalalion
 ard data

Conatuts àn BDA)
Sernnti

- schoma
tutes Qe
Deqinitirn.

Semanties dojne
dojne how
how datan
Aata

desbed and innpebd

Semantiesi
Q. Guewuy
and eatienships
cpoatien
spee
data
uitnnthe

3. Dotaaw Semantia. Spasik or

ink,tohue
tools iks Spaisik
oud
Semantiu dese?be

vmatint.
tanito
Semantiat
y. Šlaution
ho quoy
DucsGbes enoonmet.
a dt hted
eneutoi

challenge:

Trade -ott
Pafoumane

3.
3. Htre Data dye
clanigid
Au
kollowr!

Cempbiiyoa

co-Column Tyear
column dat
Calumn
e wedas ot
yp
Qs

ove: Thay

be Speißed wBg ateyd

Tntgon data kyr
the data sanse
data tupes tNT,
ushen
ned o wsed 81 6)3T.
-he Tang
9s SmaUey than
the do $ smalen than

able degit

-tye

Ehampl

Jos
S

BIGLNT L
 Stbng ype dnta byps an be
doute quota

t (onains tuo datn typ:

Nasious CHNR dala
The poleig

DaTA TypE tent

I to 6 355
AReHAR
CHAR

Tine stamp'
uor tRrmeulamp
taitiona Bappst
Lippoi
nanssend
pliion
usth optinnat,r y44-MM- Do
-fornad
alamp
ta. Trne mm-l

hh:mm: 8$:frrfe
Datsi:
Ce doucutocd
in yearlmonthlaay
vedu 4444 - mm-DC
DATE
jumat

Deiinals 'as Same as

Jhe the
Java

8Sa Deulnal

and erampl
uale )
DECMMAL lpesion,

deumal (
to 0).
 dota
tolledi halueau
an ànstane

strut
2a:Pn
AE <nt,,dnde asoay < ting

bi sthg

Q. itea
itale ae

te
nathing but mb

data
points Genavally thi tye
de8a ponts
with

but Hoaig
Deimal pe deta ia mothing

than Do BE
point Value
Jaßnal
The
datto

appoinaiy
-to6
3. Jull Nalus

uaues OLAe
Buptad by
yau
 The tm plon dto type oote u olous.

wsed he
the sorne y

in tive

thuy

Ldata-tpe
SynaniRRH

t Jaa maps.

n ie ae Grnilay

Map
-type,data tpe>;
Syntan:-mAp<pamte

Stutsi
s iilay to Lomplex
ve
3tuet
wth omments
dotn
CommENT
datatype[u
Byntan TROT<oamei
Col- Comment,

(shot)

i
t. ive fbalements
Comipla, „anto
n
te then eneutol
wieh
the
th
data.Hvee
o paeoes
the tacoop elusty mate

katwa that
?nledo Tmany
 tor bug olola naliyi
nolyia arndudiig

haitins(uo).
Uiey dejined

uith DOL
Dm
Statoment

latmeno
the data steuttoe in hue
ha deuabeA

hema chjut,
allbing
oratloihg
daleting
by ceating and
pasttan
-tabu, iuos
Suh au deitahess
gtast ulh
opL Statments
hire
buiKat. most
L'DRoP ad ATER.
cREATE gtouuutioe
the Keyboovde data
Kubonde
wed to dagine

aHe StLECT,
Om sttiments
The mai

DELETEand POA TE .Drnl

SERT Sal tatimert
?s a

wth and
maipulat
that the
datiha and
Stouutge
the quch Cuate
hern
ard delate.
geod, upadae
 and them
3. hive soals
hie Aemina and lommandVine.

be Saved uoith
hive solpt gle shotd
1he
enabe the enetus)
entenion to Gatrte

oll be eneuited
euited wng ths Sodpt .Iy
hat table,
wwill
-tbies sarae eot to -the
tahle
dota
lod-the
deauobe

and atere the daa Km thes tatble.

vee testiad and

them keem

Commad ne .
woute the sipt
|. hive sipti
uith al entncon
be
-the jle shauld
guudo qedit sample
he Comanl

he
Corn mard s to

the hive suipt

ampeisal
Comand
he f [home Coudeta