0% found this document useful (0 votes)
38 views19 pages

Module-4 Data Collection, Storage and Computing-Cloud

Module 4 covers data collection, storage, and computing using cloud platforms, introducing various cloud computing paradigms and deployment models such as SaaS, PaaS, and IaaS. It discusses IoT devices and their integration with cloud services, emphasizing the importance of edge and distributed computing. The module also highlights key concepts like virtualization, resource management, and the advantages and concerns of cloud computing.

Uploaded by

menonsanjay315
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
38 views19 pages

Module-4 Data Collection, Storage and Computing-Cloud

Module 4 covers data collection, storage, and computing using cloud platforms, introducing various cloud computing paradigms and deployment models such as SaaS, PaaS, and IaaS. It discusses IoT devices and their integration with cloud services, emphasizing the importance of edge and distributed computing. The module also highlights key concepts like virtualization, resource management, and the advantages and concerns of cloud computing.

Uploaded by

menonsanjay315
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd

MODULE 4 (9 HOURS)

Data Collection, storage and computing Using a Cloud Platform-Introduction,

Cloud Computing Paradigm for Data Collection, Storage and Computing-Cloud


Computing Paradigm,

Cloud Deployment Models-Everything as a Service and Cloud Service Models-SaaS,


PaaS, IaaS, DaaS. Cloud based platforms-XIVELY, NIMBITS.

IoT Physical Devices & Endpoints-IoT Device-Building blocks –Raspberry-Pi -Board


Linux on Raspberry-Pi-Raspberry-Pi Interfaces (serial, SPI, I2C). Raspberry Pi
interfacing and programming examples using python (LED, switch, sensor, serial,
SPI, I2C devices). Controlling GPIO outputs and displaying sensor readings using
web interface/cloud (Python programming is required only for assignments and
projects and not for examinations. Other end nodes and platforms can also be used).
DATA COLLECTION, STORAGE AND COMPUTING USING A CLOUD
PLATFORM A few conventional methods for data collection and storage are as
follows: ● Saving devices data at a local server for the device nodes
● Communicating and saving the devices’ data in the files locally on removable media,
such as micro SD cards and computer hard disks
● Communicating and saving the data and results of computations in a dedicated data
store or coordinating node locally
● Communicating and saving data at a local node, which is a part of a distributed DBMS
● Communicating and saving at a remote node in the distributed DBMS ●
Communicating on the Internet and saving at a data store in a web or enterprise server
● Communicating on the Internet and saving at data centre for an enterprise . Cloud is a
new generation method for data collection, storage and computing.
Devices or sensors network
data collection at a device
local-server, local files,
dedicated data store, at a
coordinating node, a local
node of a distributed DBMS,
Internet-connected server of
data centre, server or
distributed database nodes or
a cloud infrastructure.
CLOUD COMPUTING PARADIGM FOR DATA COLLECTION,
STORAGE AND COMPUTING
Different methods of data collection, storage and computing are shown in Figure.

The figure shows


(i) Devices or sensor networks data collection at the device web server, (ii) Local files,
(iii) Dedicated data store at coordinating node,
(iv) Local node in a distributed DBMS,
(v) Internet-connected data centre,
(vi) Internet-connected server,
(vii)Internet-connected distributed DBMS nodes, and
(viii)Cloud infrastructure and services.
Cloud computing paradigm is a great evolution in Information and Communications
Technology (ICT). The new paradigm uses XAAS at the Internet connected clouds for
collection storae and comutin.
CLOUD COMPUTING PARADIGM FOR DATA COLLECTION,
STORAGE AND COMPUTING
Following are the key terms and their meanings, which need to be understood
before learning about the cloud computing platform.

1. Resource refers to one that can be read (used), written (created of changed) or
executed (processed). A path specification is also a resource.

The resource is atomic (not-further divisible) information, which is usable during


computations. A resource may have multiple instances or just a single instance.

The data point, pointer, data, object, data store or method can also be a resource.

2. System resource refers to an operating system (OS), memory, network, server,


software or application.
CLOUD COMPUTING PARADIGM FOR DATA COLLECTION,
STORAGE AND COMPUTING
3. Environment refers to an environment for programming, program execution or
both. For example, cloud9 online provides an open programming environment for
BeagleBone board for the development of IoT devices; Windows environment for
programming and execution of applications; Google App Engine environment for
creation and execution of web applications in Python or Java.

4. Platform denotes the basic hardware, operating system and network, and is used
for software applications or services over which programs can be run or developed.

A platform may provide a browser and APIs which can be used as a base on which
other applications can be run or developed.
CLOUD COMPUTING PARADIGM FOR DATA COLLECTION,
STORAGE AND COMPUTING
5. Edge computing is a type of computing that pushes the frontier of computing
applications, data and services away from centralised nodes to IoT data generating
nodes, that means at logical extremes of the network.

IoT device nodes are pushed by events, triggers, alerts, messages and data is
collected for enrichment, storage and computations from the remote centralised
database nodes. Pushing the computations from centralised nodes enables the
usage of resources at device nodes, which could be a requirement in case of low
power lossy networks.

The processing can also be classified as edge computing at local cloud, grid or mesh
computing. The nodes may be mobile or of a wireless sensor network or cooperative
distributed in peer-to-peer and ad-hoc networks.
CLOUD COMPUTING PARADIGM FOR DATA COLLECTION,
STORAGE AND COMPUTING
6. Distributed computing refers to computing and usage of resources which are
distributed at multiple computing environments over the Internet.
The resources are logically-related, which means communicating among themselves
using message passing and transparency concepts, and are cooperating with each
other, movable without affecting the computations and can be considered as one
computing system (location independent).

7. Service is a software which provides the capabilities and logically grouped and
encapsulated functionalities. A service is called by an application for utilising the
capabilities. A service has a description and discovery methods, such as
advertisement for direct use or through a service broker. The service binds to
Service Level Agreement (SLA) between service (provider end point) and application
(end point). One service can also use another service.
CLOUD COMPUTING PARADIGM FOR DATA COLLECTION,
STORAGE AND COMPUTING
8. Web Service, according to the W3C definition, is an application identified by a
URI, described and discovered using the XML based Web-Service Description
Language (WSDL). A web service interacts with other services and applications
using XML messages and exchanges the objects using Internet protocols.
9. Service-oriented architecture consists of components which are implemented as
independent services which can be dynamically bonded and orchestrated, and which
possess loosely coupled configurations, while the communication between them
uses messages. Orchestrating means a process which predefines an order of calling
the services (in sequences and in parallel) and the data and message exchanges.

10. Web computing refers to computing using resources at computing environment


of web server(s) or web services over the Internet.
CLOUD COMPUTING PARADIGM FOR DATA COLLECTION,
STORAGE AND COMPUTING
11. Grid computing refers to computing using the pooled interconnected grid of
computing resources and environments in place of web servers.

12. Utility computing refers to computing using focus on service levels with optimum
amount of resources allotted when required and takes the help of pooled resources
and environments for hosting applications. The applications utilise the services.
13. Cloud computing refers to computing using a collection of services available over
the Internet that deliver computational functionality on the infrastructure of a service
provider for connected systems and enables distributed grid and utility computing.
CLOUD COMPUTING PARADIGM FOR DATA COLLECTION,
STORAGE AND COMPUTING
14. Key Performance Indicator (KPI) refers to a set of values, usually consisting of
one or more raw monitored values including minimum, average and maximum values
specifying the scale. A service is expected to be fast, reliable and secure. The KPIs
monitor the fulfillment of these objectives.

For example, a set of values can relate to Quality of Service (QoS) characteristics,
such as bandwidth availability, data backup capability, peak and average workload
handling capacity, ability to handle defined volume of demand at different times of
the day, and the ability to deliver defined total volume of service.

A cloud service should be able to fulfill the defined minimum, average and maximum
KPI values agreed in the SLA.
CLOUD COMPUTING PARADIGM FOR DATA COLLECTION,
STORAGE AND COMPUTING
15. Localisation means cloud computing content usage is monitored by determining
localization of the QoS level and KPIs.

16. Seamless cloud computing means during computing the content usages and
computations continue without any break when the service usage moves to a
location with similar QoS level and KPIs.

For example, continue using same cloud platform when developer of software shifts.

17. Elasticity denotes that an application can deploy local as well as remote
applications or services and release them after the application usage. The user
incurs the costs as per the usages and KPIs.
CLOUD COMPUTING PARADIGM FOR DATA COLLECTION,
STORAGE AND COMPUTING
18. Measurability (of a resource or service) is something which can be measured for
controlling or monitoring and enables report of the delivery of resource or service.

19. Homogeneity of different computing nodes in a cluster or clusters refers to


integration with the kernel providing the automatic migration of the processes from one
to other homogeneous nodes.

System software on each computing node should ensure same storage representation
and same results of processing.

20. Resilient computing refers to the ability of offering and maintaining the accepted
QoS and KPIs in presence of the identified challenges, defined and appropriate
resilience metrics, and protecting the service.
The challenges may be small to big, such as misconfiguration of a computing node in a
network to natural disasters.
CLOUD COMPUTING PARADIGM FOR DATA COLLECTION,
STORAGE AND COMPUTING
21. Scalability in cloud services refers to the ability using which an application can
deploy smaller local resources as well as remotely distributed servers and resources,
and then increase or decrease the usage, while incurring the cost as per the usage
on increasing scales.
22. Maintainability in cloud services refers to the storage, applications, computing
infrastructure, services, data centres and servers maintenances which are
responsibilities of the remotely connected cloud services with no costs to the user.

XAAS is a software architectural concept that enables deployment and development


of applications, and offers services using web and SOA.

A computing paradigm is to integrate complex applications and services and use


XAAS concept for deploying a cloud platform.
CLOUD COMPUTING PARADIGM FOR DATA COLLECTION,
STORAGE AND COMPUTING
23. Multitenant cloud model refers to accessibility to a cloud platform and computing
environment by multiple users who pay as per the agreed QoS and KPIs, which are
defined at separate SLAs with each user.

Resource pooling is done by the users but each uses pays separately.
CLOUD COMPUTING PARADIGM
Cloud computing means a collection of services available over the

Internet. Cloud delivers the computational functionality.

Cloud computing deploys infrastructure of a cloud-service provider.

The infrastructure deploys on a utility or grid computing or webservices environment


that includes network, system, grid of computers or servers or data centres.

Just as we—users of electricity—do not need to know about the source and
underlying infrastructure for electricity supply service, similarly, a user of computing
service or application need not know how the infrastructure deploys or the details of
the computing environment.
Just as the user does not need to know Intel processor inside a computer, similarly,
the user uses the data, computing and intelligence in the cloud, as part of the
services.
CLOUD COMPUTING PARADIGM
Cloud Platform Services

Cloud platform offers the following:


● Infrastructure for large data storage of devices, RFIDs, industrial plant machines,
automobiles and device networks
● Computing capabilities, such as analytics, IDE (Integrated Development
Environment) ● Collaborative computing and data store sharing

Cloud Platform Usages

Cloud platform usages are for connecting devices, data, APIs, applications and
services, persons, enterprises, businesses and XAAS.

The following Equation describes a simple conceptual framework of the Internet


Cloud: Internet Cloud + Clients = User applications and services with ‘no
boundaries and no walls’ …
CLOUD COMPUTING PARADIGM
An application or service executes on a platform which includes the operating system
(OS), hardware and network.

Multiple applications may initially be designed to run on diversified platforms (OSs,


hardware and networks).

Applications and services need to integrate them on a common platform and running
environment.

Cloud storage and computing environment offers a virtualised environment, which


refers to a running environment made to appear as one to all applications and
services, but in fact physically two or more running environments and platforms may
be present.
CLOUD COMPUTING PARADIGM
Virtualisation
A characteristic of virtualised environment is that it enables applications and services
to execute in an independent execution environment (heterogeneous computing
environment).

Each one of them stores and executes in isolation on the same platform, though in
fact, it may actually execute or access to a set of data centres or servers or
distributed services and computing systems.

The applications or services which are hosted remotely and are accessible using the
Internet can easily be deployed at a user application or service in a virtualised
environment, provided the Internet or other communications are present.

Virtualisation enables provisioning for storage, network functions, server and


desktop in execution environment of multi-platforms and servers.
.
CLOUD COMPUTING PARADIGM
Applications need not be aware of the platform, just Internet connectivity to the
platform, called cloud platform, is required. The storage is called cloud storage.

The computing is called cloud computing. The services are called cloud services in
line with the web services which host on web servers.

Virtualisation of storage means user application or service accesses physical storage


using abstract database interface or file system or logical drive or disk drive, though
in fact storage may be accessible using multiple interfaces or servers.

For example, Apple iCloud offers storage to a user or user group that enables the
sharing of albums, music, videos, data store, editing files and collaboration among
the user group members.
CLOUD COMPUTING PARADIGM
Network Function Virtualisation (NFV) means a user application or service accesses
the resources appearing as just one network, though the network access to the
resources may be through multiple resources and networks.

Virtualisation of server means user application accesses not only one server but in
fact accesses multiple servers.

Virtualised desktop means the user application can change and deploy multiple
desktops, though the access by the user is through their own computer platform (OS)
that in fact may be through multiple OSs and platforms or remote computers.
CLOUD COMPUTING FEATURES AND ADVANTAGES
● On demand self-service to users for the provision of storage, computing
servers, software delivery and server time
● Resource pooling in multi-tenant model
● Broad network accessibility in virtualised environment to heterogeneous users,
clients, systems and devices
● Elasticity
● Massive scale availability
● Scalability
● Maintainability
● Homogeneity
● Virtualisation
● Interconnectivity platform with virtualised environment for enterprises
and provisioning of in-between Service Level Agreements (SLAs)
● Resilient computing
● Advanced security
● Low cost
CLOUD COMPUTING CONCERNS

● Requirement of a constant high-speed Internet


connection ● Limitations of the services available
● Possible data loss
● Non delivery as per defined SLA specified performance ●
Different APIs and protocols used at different clouds ● Security
in multi-tenant environment needs high trust and low risks ● Loss
of users’ control

You might also like