USE OF BIG DATA AND VISUALIZATION
IN IOT
BY
R. K. Jena
CAPGS, BPUT, Rourkela, Odisha
BIG DATA AND VISUALIZATION IN IOT
A Brief Statement on IOT
When a set of anyone, anything, anytime, anyplace, any service,
and any network gets connected, it creates a situation of Internet
of Things (IoT).
Data sources for IoT
BIG DATA AND VISUALIZATION IN IOT
The most basic architecture of IoT shown in figure below, which consists
of 3 Layers, named as follows
Application Layer
Network Layer
Perception Layer
BIG DATA
Data that exceeds the capacity of conventional Database systems
Too Big, Moves Fast and does not for into the structures of the
Database
Thus, we need an alternate way of processing
BIG DATA
5 V’s
Volume, Velocity and Variety of Data Generated
Data Generated by Humans, Machines, Sensors
Veracity of data and making Value out of it
Volume, Velocity, Variety, Veracity, Value
BIG DATA
Moreover, with further advancements, scientists have reached to
10V’s of Big Data.
10 V’s model of Big Data
BIG DATA
Interrelation between big data and IoT
BIG DATA
INTEGRATION OF BIG DATA AND IOT
IoT consists of devices that collect the data
This data is useful to us, as it can help in solving may
problem in one way or another.
To analyze this data, various big data analytical tools and
techniques can be beneficial.
BIG DATA & IOT
IoT and Big Data Analytics relationship
IoT data is a heterogeneous data
These IoT devices will collect, gaze, transmit, analyze, share the
real-time data, which changes with every millisecond.
IoT data has three features
It consists of an abundant amount of terminals, which generate
massive raw-data.
Raw-data generated by devices used in IoT can be in any form,
but generally, it is unstructured.
IoT devices generated raw-data are useless if not examined.
BIG DATA PROCESSING
To manage IoT Big data, the process is broadly classified into four
steps, described below
The first step is to manage different data sources of IoT, i.e., IoT
sensor devices, where sensors in a device interact with each other
with the help of different applications and generate highly
unstructured, semi-structured, or structured data.
In the second step, data generated by different IoT devices called Big
IoT data is collected and stored by the Big data storage system. This
data is based on the 3 V model given by Gartner.
In Big data storage system, this IoT data is converted into shared
and distributed Big data files.
BIG DATA PROCESSING
After that, it applies different analytical tools for analysis of
data like Hadoop, Map-Reduce or Spark, and many more,
which are further discussed in the next section.
In the last step, the report corresponding to the injected
data is generated and presented to the user.
BIG DATA PROCESSING
DIFFERENT PLATFORMS OF BIG DATA ANALYTICS FOR IOT
Big Data Analytics needs some tools and techniques to
transform IoT structured, semistructured, and unstructured
data into metadata or comprehensive form for the further
analysis.
These tools use algorithms that discover patterns,
correlations, trends over various forms of data.
After analyzing the data, tools are also used to visualize
these outcomes in the form of a graph, tables, pie chart, bar
chart, etc.
BIG DATA PROCESSING
Tools used For visualize
Apache Hadoop 1010data,
Apache Spark Cloudera Data Hub
Dryad SAP-Hana
Apache Drill HP-HAVEn
Storm Hortonworks
Splunk Pivotal Big Data Suite
Jaspersoft Infobright
Apache Mahout
Big Data in IoT Application Areas
Healthcare Systems
Food Supply Chains
Smart power system
Smart home
Smart environment control
Safety and surveillance
Smart city
Safer Mining Production
Transportation and Logistics
Firefighting
Challenges of Big Data in IoT Systems
analysis
capture
data curation
Search
transfer
visualization
querying
updating
information privacy.
IoT and Big Data: Challenges and Applications
Countless things empowered to collect and exchange data are forming a
totally new network – internet of things – the network of physical objects that
can gather data in the cloud, transmit data and fulfill users’ tasks.
How IoT big data can be applied
Big data challenges in IoT
Big data processing in an IoT solution
Conclusion
IoT generates a lot of big data
which can be used for real-time monitoring, analytics, process
optimization and predictive maintenance etc.
However, it should be kept in mind that getting valuable insights
from huge volumes of data in various formats is not a trivial task
It is required to be ensured that sensors work properly, the data is
securely transmitted and effectively processed.
What is more, there is always a question: which data is worth
storing and processing (as soon as both these processes are rather
expensive).
Industry 4.0 Technologies
Generally-speaking, Industry 4.0 describes the growing trend
towards automation and data exchange in technology and
processes within the manufacturing industry, including:
The internet of things (IoT)
The industrial internet of things (IIoT)
Cyber-physical systems (CPS)
Smart manufacture
Smart factories
Cloud computing
Cognitive computing
Artificial intelligence
Industry 4.0 Technologies
