9/27/2023

Data Processing System

PRASUN KUMAR GUPTA

GEOINFORMATICS DEPARTMENT
INDIAN INSTITUTE OF REMOTE SENSING

ITEC / MSc / PGD - 2023

GIScience Module (Oct 3, 2023)

PRASUN @ IIRS . GOV . IN

Contents

• GIS – a little bit more

• Hardware
• Software
• Network
• Data

1
 9/27/2023

GIS

Source: ITC Study Material

Disciplines of GIS

Source: ITC Study Material

2
 9/27/2023

GIS Usage

• GIS can be used for:

 Scientific research  Environmental
 Asset management Impact Assessment
 Urban planning  Resource
management
 Cartography
 Natural disasters
 Criminology
 Protecting wetlands
 Archeology
 Pollution
 Sales & Marketing
 Etc…
 Logistics

Source: ITC Study Material

Source: geoBuiz-2018-report

3
 9/27/2023

Components of GIS

Components of GIS

4
 9/27/2023

Hardware Requirements

• Computer
 Processor
 Hard Disk
 Peripherals – video
• Printer / Plotter XEROX ALTO, 1973

• Scanner
• GNSS Receiver

AKASH TABLET, 2011

System Design for GIS

(Hardware)

Hardware: Generally Hardware is being accessed

by six factors.
• Affordability (Cost of the machine)
• Scalability (Vertical or horizontal growth)
• Reliability (System performance, Average down/recovery time)
• Connectivity (Network capability)
• Security (Protection from hackers)
• Accessibility (User friendliness)

5
 9/27/2023

Moore’s Law

“The number
of transistors that can
be placed
inexpensively on
an integrated
circuit doubles
approximately every
two years”

- Intel co-
founder Gordon E.
Moore, 1965

Hardware – Processor trends

6
 9/27/2023

Parallel Computing on a GPU

GeForce RTX 3080

VIDEO

Tesla K80

GPU’s for GIS / CUDA

• NVIDIA GPU Computing Architecture

• Latest GPU series (Tesla H100) deliver

~1 petaFLOPS of processing power operations

• GPU parallelism is doubling every year

• Programmable in C with CUDA (“Compute

Unified Device Architecture”)

• Softwares desgined to run on GPU’s

 Manifold, Matlab

7
 9/27/2023

IBM 305 RAMAC, 1956

IBM 305 RAMAC, 1956

• Random Access Method of Accounting and

Control
• Storage capacity – 4.4MB
• Weight – >1 ton!!!
• “The storage capacity of the drive could have
been increased beyond five megabytes, but
IBM's marketing department at that time was
against a larger capacity drive, because they
didn't know how to sell a product with more
storage.” –Currie Munce, Research VP
for Hitachi Global Storage Technologies (which
acquired IBM's storage business)

8
 9/27/2023

1981 1989

512 GB/ 1 TB

Storage trends
100/128 GB

• Storage
• Managing
 DBMS (Database Mgmt
Systems)
• Old (Flat files, Network &
Hierarchical)
• New (Object Oriented &
Relational)
 Spatial Databases
• Oracle Spatial
• PostGIS with PostGRE SQL

9
 9/27/2023

I/O

Digitizer, Printer,
Plotter, A0-Scanner

Scanners

iirs

10
 9/27/2023

The scanning process

Optical Mechanical Scanning

Drum scanner

Flat-bed
scanner

iirs

Working principle

A digital scanner illuminates a to-be-scanned document and

measures with a sensor the intensity of the reflected (or
transmitted) light

Light source
Paper

Film

Sensor
Light source Sensor
iirs

11
 9/27/2023

1-bit scanning

0 1
0 1

iirs

8-bit grey mode scanning

effective bit-depth or number
of greyscale levels

128 120
136 142

iirs

12
 9/27/2023

Scanner output

The scanner output is only a digital copy of

the source document in raster cell values

 Data are NOT structured into classified

and coded objects

To obtain this, the data have to be vectorised

and further structured

iirs

Resolution Concept in Scanner

Suppose the Scanning resolution is:
0.05mm or 50 Microns or 508dpi (Dots Per Inch)
508 Dots are scanned in 1inch
508 Dots = 1inch
508 Dots = 2.54 cm

Hence Size of 1 Dot = 2.54 cm / 508 = 0.005 cm

= 0.005 cm = 0.05 mm
= 0.05 mm = 0.05 * 1000 Microns = 50 Microns
1micron = 10-6m = 10-4 cm = 10-3mm
Therefore 1mm = 1000 Microns
iirs

13
 9/27/2023

QUESTION TIME

Image Print on Paper of

10cm x 10cm
1000 x 1000
Pixels

1. At What DPI the image was PRINTED on the Paper?

2. What is the SIZE OF 1 DOT on the paper – TELL IN MICRONs?

YOUR TIME STARTS NOW

Expect your answers within 5 minutes

iirs

ANSWER
Image
Print on Paper of
1000 x 1000 10cm x 10cm
Pixels

Q1: At WHAT DPI the image was PRINTED on the Paper?

The output paper will contain 1000 pixels in 10cm

1cm = 100 pixels

So 1 cm = 100 DOTS
2.54cm = 2.54 * 100 = 254 DOTS per inch = 254 DPI

Q2: WHAT IS THE SIZE OF 1 DOT in MICRON?

Size of 1 pixel/dot = 0.01cm = 0.1mm = 100 Micron
iirs

14
 9/27/2023

I/O

Source: ITC Study Material

Peripheral evolution

• Video!
HUMAN COMUTER INTERACTION

Examples
• Pranav Mistry – Sixth Sense
• Jhonny Lee – Wii Hacks
• Holographic displays
• Google liquid galaxy
• Roll able displays
VIDEO • Gesture based (controller free) access
• Nano quad copters (search & rescue)
• Tangible Landscape + Immersive
Virtual Reality

15
 9/27/2023

25 Years of Computers

2015
CPU: 3 GHz
Mem: 8 Gb
Disk: 1 Tb

Source: ITC Study Material

16
 9/27/2023

Standard Configuration
(Academic)

Source: https://sites.temple.edu/psmgis/computer-recommendations-for-gis-students-and-professionals/

Standard Configuration (ESRI)

Source: https://desktop.arcgis.com/en/system-requirements/latest/arcgis-desktop-system-requirements.htm

17
 9/27/2023

GRID Computing

GLOBUS
Middleware

BOINC 29.8 PFLOPS Apr-20

Folding@home 1.1 exaFLOPS Mar-20
IceCube via OSG 350 fp32 PFLOPS Nov-19
Einstein@Home 3.489 PFLOPS Feb-18
SETI@Home 1.11 PFLOPS Apr-20
MilkyWay@Home 1.465 PFLOPS Apr-20
GIMPS 0.558 PFLOPS Mar-19
Source: http://en.wikipedia.org/wiki/Grid_computing

Next What?

18
 9/27/2023

IaaS

• Cloud infrastructure services, also known as

"infrastructure as a service" (IaaS), deliver computer
infrastructure – typically a platform
virtualization environment – as a service, along with
raw (block) storage and networking.
• Rather than purchasing servers, software, data-
center space or network equipment, clients instead
buy those resources as a fully outsourced service.
• Suppliers typically bill such services on a utility
computing basis; the amount of resources
consumed (and therefore the cost) will typically
reflect the level of activity.

https://aws.amazon.com/marketplace/desktop/search?category=GIS%20and%20Mapping

19
 9/27/2023

Cloud technologies (GIS)

ESRI CLOUD SERVICES MICROSOFT PLANETARY COMPUTER GOOGLE EARTH ENGINE

MAPBOX QGISCLOUD & OTHERS AMAZON OPEN DATA

Software

Source: ITC Study Material

20
 9/27/2023

System Design for GIS

(Software)

• User friendliness(easy graphical interface)

• Functionalities (Effectiveness & Efficiency)
• Compatibilities (operating system friendliness)
• Updativity (changeable with versions)
• Documentation (help on the software functions/algorithms)
• Cost effectiveness (more functions with less price)

Major GIS Software:

Proprietory: ESRI’s ArcMap, MapInfo , Geomedia, Leica, ERMapper,
Geomatica
Open Source: QGIS, GRASS, ILWIS, and MANY MORE.

GIS Software – Categorization

• Desktop GIS
• Web GIS
• Library
• Database
• Mobile GIS

21
 9/27/2023

Software for GIS: Leading Vendor’s Products

• Autodesk Autodesk World Desktop GIS $1,995
www.autodesk.com Autodesk MapGuide Web-based GIS $9,990
AutoCAD Map CAD mapping $4,250
ArcView (AV) Desktop GIS $1,195
Arc/Info Prof./Indus. GIS $10,000
• ESRI
AV Business Analyst Business GIS $11,995
www.esri.com
ArcIMS Web GIS $10,500
MapObjects/ArcObjects Spatial Objects for VB
Business Map Pro Entry business maps $149
GeoMedia Desktop GIS $1,500
• Intergraph Geomedia Pro Prof./Indus. GIS $7,500
www.intergraph.com Geomedia Web Map Web-based GIS $10,000
Geomedia Network Networking modules $2,000
• MapInfo MapInfo Pro Desktop GIS $1,295
www.mapinfo.com Mapinfo MapXtreme GIS apps. Server $24,495
MapXtreme Java Web-based Server $24,495
Source: PC Week MapInfoData Target Pro GIS for marketing $695
Old Statistics
Just for the idea Ron Briggs, UT-Dallas POEC 6381 Introduction to GIS

GIS Market Share for Software (%)

VENDOR/YEAR 1994* 1995 1996** 1999***
ESRI 30.3% 32.5% 35.1%
Intergraph 24.1 26.5 28.3
MapInfo 5.6 5.1 5.5
GDS 4.9 6.5 closed
Atlas (Strategic Mapping) 4.9 Now ESRI
IBM 3.3 abandoned
Enghouse 2.2
ERDAS 2.2 2.7 2.1
Genasys 2.1
PCI 2
Autodesk (autoCAD) 4.7
Smallworld 4.3
Other 20.4
Total Software ($millions) 495 548 591 845

GIS Industry Totals for 1999: $6.9 billion

GIS Vendors Software: $845million Resellers: $320 Hardware vendors: $735
GIS vendors hard/service: $655 Services: $4,400
(For comparison, Microsoft had revenues of $23 billion for FY99/00)

Source: PC Week
Old Statistics
Just for the idea Ron Briggs, UT-Dallas POEC 6381 Introduction to GIS

22
 9/27/2023

Source: geoBuiz-2018-report

Terms used with respect to

Software Licenses

Source: Steiniger S. and Bocher E. (2008) An Overview on Current Free and Open Source Desktop GIS
Developments, Int. J. of Geographical Information Science 46

23
 9/27/2023

Some Popular Open Source Tools

in other fields
• Word processors - OpenOffice.org
• Web browsers – Mozilla Firefox
• Drawing – Inkscape / GIMP
• Scientific applications - R Project
• Media Player – VLC
• HTTP Server – Apache
• Learning Management – Moodle
• Security – SSL

47

Open Source Geospatial Tools

• Desktop GIS: QGIS, JUMP, ILWIS, uDIG,
gvSIG, OpenEV, SAGA
• Geospatial data management and analysis:
GRASS-GIS
• Spatial databases: MySQL, PostGIS
• Command line utilities: GDAL/OGR, AVCE00,
GMT
• Internet mapping: GeoServer, Mapserver
• Data visualization: GGobi, Mondrian, GeoDa,
Geovista, grADS
• Spatial catalogue: GeoNetwork

48

24
 9/27/2023

www.qgis.org

Advanced QGIS functionalities

https://twitter.com/geomenke https://twitter.com/pkg_se

https://twitter.com/map_andrew

25
 9/27/2023

Geo-DB Organization trends

• G/NSDI
• Data discovery / Data Mining
• File Formats
 Standards - OGC & ISO / TC 211
 Libraries - GDAL, OGR & proj.4
• Catalog
 GeoNetwork

25 Years of Networks

Source: ITC Study Material

26
 9/27/2023

Dial-up modem to 3G/4G

56kbps, 2000 3.6Mbps, 2011

akamai.com/html/technology/dataviz3.html

Geospatial Data

Source: ITC Study Material

27
 9/27/2023

Sources
• Direct datasets
 Aerial Photography
 Satellite Imagery
 GPS
 Wireless Sensors
 Crowdsourcing (VGI)
 Field surveying
• Indirect datasets
 Topographic Sheets
 Storage media (CD’s, Flash Memory)
Freegis.org, OpenStreetMaps, NaturalEarthData,
Bhuvan, Glovis, EarthExplorer, GTOPO+SRTM(DEM)

GISAT
ONBOARD KNOWN INSTRUMENTS

High resolution Multi-spectral VNIR imager

• ISRO is designing a GEO Imaging Satellite (GISAT). Hyper-spectral VNIR imager
Hyper-spectral SWIR imager
High Resolution TIR imager
• GISAT will carry a GEO Imager with multi-spectral
(visible, near infra-red and thermal), multi-
resolution (50m to 1.5 km) imaging instruments.

• GISAT will be placed in geostationary orbit of

36,000 km.

• GISAT will provide near real time pictures of large

areas of the country, under cloud free conditions,
at frequent intervals.

• That is, selected Sector-wise image every 5

minutes and entire Indian landmass image every Longitude 93.5°E
30 minutes at 50m spatial resolution. Estimate of the satellite's footprint, assuming a zenith angle of 75 °

• GISAT is planned to be launched soon.

28
 9/27/2023

GEONETCast

• Objective: Global Coverage for near-real time

data dissemination

• Accessible for user in remote area or with poor

internet capacities

• Cooperation between NOAA, CMA,

EUMETSAT, WMO

EUMETCast Overview

29
 9/27/2023

Coverage

Generic EUMETCast Solution

EUMETCast (DVB) Standard Hardware - indicative costs C-band
antenna

30
 9/27/2023

High Speed Networks

NATIONAL
KNOWLEDGE
NETWORK

Crowdsourcing

• Volunteered Geographic Information (VGI)

• Examples:
 UshaHidi
 Open Street Map
 Wikimapia

VIDEO

31
 9/27/2023

Source: http://www.spatial.maine.edu/~max/Bari/a3.pdf

Source: http://www.spatial.maine.edu/~max/Bari/a3.pdf, www.esri.com

32
 9/27/2023

Final Requirement - MANPOWER

Capacity building initiatives in RS and GIS: A review of

International training programmes and courses at IIRS

Senthil Kumar, A., … and Gupta, P.K. (2017). Challenges and models in conducting space technology courses with
multi-ethnic students group - Assessment of International courses at IIRS & CSSTEAP. 38th ACRS, New Delhi. 2017.

33
 9/27/2023

Types of cost

• Quite often training, consulting,

customization, maintenance, data,
etc. are grouped into Services, as
separate from Software and
Hardware

• Proportions have changed over time

Source: http://courses.washington.edu/geog469/Lec_2013/LecW5_T_Bene_Cost.ppt

Flip-side

IMPLEMENTATION ISSUES: COMMON PITFALLS

Failure to identify total costs.
• The GIS acquisition cost is relatively easy to identify. However, it will
represent a very small fraction of the total cost of implementing a
GIS. Ongoing costs are substantial and include hardware and
software maintenance, staffing, system administration, initial data
loading, data updating, custom programming, and consulting fees.

Source: http://unstats.un.org/

Source: http://unstats.un.org/unsd/demographic/meetings/wshops/Zambia_8Oct07/docs/Commercial_Supplier/Presentation%20GeoSpace.ppt

34
 9/27/2023

Topology in GIS

Topology
• Topology deals with spatial relationships
between features
• Topology is a mathematics approach that
defines unchangeable spatial relationships
• Types:
• Arcs connect to each other at nodes
(Connectivity)
• Arcs that connect to surround an area
define a polygon (Containment or area
definition)
• Arcs have direction and left and right
sides (Contiguity)

35
 9/27/2023

Why topology?
• Topology and spatial relationships
• Ensuring geometric correctness of the data
• Detecting and correcting digitizing errors
• Carrying our some types of spatial analysis
(selections, network analysis)
• Find all light poles that are inside pasture
• Find all the plots adjacent to a river
• Network analysis

• Topology can be “stored” – topological data

model (geometric correction of the data)
and can be used for analysis on non-
topological data.

Importance of Topology
Network Polygon
Connectivity Adjacency

Topology
poorly
defined

Topology
well
defined

• Topological or topology-based data are useful for detecting and correcting digitising
errors (e.g. two lines in a roads vector layer that do not meet perfectly at an intersection).
• Topology is must for carrying out some types of spatial analysis, such as network analysis.

36
 9/27/2023

Topological relationships
using set theory

Topology (Set theory)

37
 9/27/2023

Spatial relationships

Question:
What is the relationship
described here?

38
 9/27/2023

Dimensionally Extended 9-
Intersection Model (DE-9IM)

https://en.wikipedia.
org/wiki/DE-9IM

Common Digitising errors

39
 9/27/2023

Topological Correction in
GIS (preventive)

Topological Correction in
GIS (corrective)

Source: QGIS
Documentation

40
 9/27/2023

References

1. Introduction to Geographic Information Systems, Kang-Tsung Chang, McGraw-Hill Higher Education

2. Principles of Geographical Information Systems, Peter A. Burrough, Rachael A. McDonnell, OUP Oxford
3. Geographic Information Systems and Science, Paul A. Longley, Mike Goodchild, David J. Maguire, David
W. Rhind, John Wiley & Sons

Q&A

prasun @ iirs . gov . in

41