Lesson 2 - Designing Web Services and Web Maps
Lesson 2 - Designing Web Services and Web Maps
edu/geog585)
Home > Lessons > Lesson 2: Designing web services and web maps
Overview
How do you start with some raw datasets on your computer and create a beautiful interactive web map that can be enjoyed by thousands of
Internet users? This lesson will give an overview of how you can approach a web mapping project. The remaining lessons will get into the step-
by-step details of how you make each part happen.
Objectives
Identify the pieces of hardware and software architecture used in web mapping and describe the role played by each.
Recognize the roles of basemaps and thematic layers in a web map, and identify examples of each.
Critique the layer construction and architecture of a web map.
Log in to the GeoServer administrator page and preview layers.
Checklist
In this course, you will be using QGIS and some command line libraries such as GDAL to accomplish these tasks. GeoServer also has a web-
browser-based administrator dashboard that you would use from this machine.
In some cases, your web map may be designed solely for the use of people within your organization and may never see the open web. In
this scenario, client applications may also reside on these desktop workstation machines.
a database and/or file server holding all of your GIS data. This machine might be equipped with redundant storage mechanisms and
regular backup scripts that prevent the loss of data.
In this course, you'll be using folders of shapefiles for some of the exercises. If you had decided to use a database like PostgreSQL or
MariaDB, it would also go on this tier.
a geospatial web services server that has specialized software and processing power for drawing maps, responding to feature queries,
and performing GIS analysis operations.
In this course, you will use GeoServer to host your web services.
a web server that acts as a web entry point into your organization's network. This is also called a proxy server. It is protected by firewalls
that shield malicious traffic into your internal network. It's also a place where you can put web application code (such as HTML and
JavaScript files) for your web maps.
In this course, you will just be using GeoServer on your local machine; therefore, you will not install separate web server software.
GeoServer comes with an embedded “servlet” called Jetty that gives you a simple endpoint to your web services that you can locally access
for testing. In a more formal setup where you wanted to reveal your GeoServer web services to the world, you would have a web server
such as Apache that would forward requests to GeoServer.
In this course, you will put your web applications in your Jetty home folder (if the application uses GeoServer) or your Penn State personal
web space using the PASS Explorer application (if your application does not use GeoServer). The Penn State IT staff has configured your
PASS space to be a safe web entry point for your files.
many client applications that use the web map. These can be apps that run on your desktop workstation or they could be mobile apps.
The clients may be based within your network, or you may allow them to come from outside your network. All clients must be able to make
web requests through HTTP, and any client coming from outside your network must have an Internet connection.
This is the tier you usually have no control over; therefore, it's important to design for different browser versions, screen sizes, ambient
lighting, and so forth.
In this course, you can use any modern web browser to test your apps and services. You can also use a mobile browser, such as Safari on
the iPhone, to test the apps that you place on your personal webspace.
Again, when developing and testing a web map, you can certainly use a single physical machine to play all these roles. This is a common practice
that keeps things simple and more economic. When you work for a “real world” company with its own network and are ready to deploy your web
map, you will move your tested services and applications into a formal “production” environment where you have individual enterprise-grade
machines for each role, as described above.
Thematic layers (also known as business or operational layers) go on top of the basemap. They're the reason people are coming to visit your
map. If placed on the basemap, they might not be of interest to everybody, but when placed on your focused web map, they are the main layer
of interest. If your map is titled “Farmers markets in Philadelphia,” then farmers markets are your thematic layer. If your map is titled “Migration
patterns of North American birds,” then the migration patterns are your thematic layer.
Like basemaps, thematic layers are sometimes displayed with tiles; however, this may not always be possible due to the rapidly changing nature
of some data. For example, if you need to display the real time positions of police vans, you cannot rely on predrawn tiles and must use some
other way to draw the data. There are various web services such as WMS (which you will learn about in Lesson 4) that are designed to draw maps
on the fly in this way. You can use these for your thematic layers. Another option is to query the server for all the data and use the browser to
draw it. This approach lends itself well to interactive elements such as popups and is described in Lesson 6.
Thematic layers work together with basemap layers to form an effective web map. Interestingly, the thematic layer is not always the top one. In a
2009 blog post (no longer online), Esri cartographer Charlie Frye described a “map sandwich” approach, wherein a thematic layer (which could be
tiled or not) is placed in between two tiled basemap layers that give geographic context. The bottom layer has physiographic features and the
top layer has labels and boundaries. This is the “bread.” The thematic layer in the middle is the “meat.” The Esri "Light Gray Canvas" basemap in
ArcMap and ArcGIS Online uses this technique. FOSS technology definitely allows this approach as well.
Your map may include several thematic layers that you allow users to toggle on and off. To accomplish this, you can use a single web service with
multiple sublayers, or multiple web services that each contain a single layer. However, to keep your app usable and relatively fast-performing,
you should avoid including many thematic layers in your web map.
Try this
1. Open your browser's web developer tools you used during the previous lesson and open the Network tab; then visit Bing maps [2] on your
computer's web browser.
2. Pan around and switch between the basemaps (drop-down menu at the top right), and note the different web request URLs displayed in
the table. These will appear quickly as you interact with the website.
3. Click a row representing a request, and then click the Response tab to see what came back from the request. If you see an image, it means
the request sent back a tiled map image as a response. Other times you may see JSON and/or other text.
4. Now turn on the thematic layer for Traffic.
How is Bing displaying these layers? Why are they taking this approach? At the end of this class, you will have a good understanding of the
different options that exist and their advantages and disadvantages. Feel free to go ahead and compare Bing's approach to that at the site HERE
WeGo [3] (layers can be accessed at the bottom right). Do you notice any differences in their approach?
Interactive elements
Web maps are often equipped with interactive elements that can help you learn more about the layers in the map. These can be informational
popups that appear when you click a feature, charts and graphs that are drawn in a separate part of the page, slider bars that adjust the time
slice of data displayed in the map, and so forth. Some web maps allow you to edit GIS data in real time, or submit a geoprocessing job to the
server and see the response drawn on the screen. Others allow you to type a series of stops and view driving directions between each.
These elements make the map come alive. The key to making an effective web map is to include the interactive elements that are most useful to
your audience, without overwhelming them with options or making the tasks too complicated. Even a little bit of housekeeping, such as including
user-friendly field aliases in your popups, can go a long way toward making your map approachable and useful.
Interactive elements are the part of your web map that require the most custom programming. The amount of interactivity you have the
freedom to add may be strongly correlated with the amount of JavaScript programming that you know how to do. Open web mapping APIs such
as OpenLayers and Leaflet provide convenient methods for doing some of the most common things, such as opening a popup.
Later in this lesson, you'll examine some web maps and discuss the interactive elements they provide. You'll also revisit this subject in Lesson 6
as you begin using the web mapping APIs to put all your layers together into a web map.
Getting some practice with identifying web map elements
Let's get some practice identifying these elements. I will walk you through two simple web maps and point out the basemap, the thematic layers,
and the interactive elements. Then, in this week's assignment, you'll get the chance to try it yourself using two web maps of your choosing.
The first map we'll look at is www.gdacs.org/ [6], published by the Global Disaster Alert and Coordination System (GDACS), a cooperation
framework between the United Nations, the European Commission, and others to share disaster information and alerts. The web map on the
main page showing alerts for the last four days is relatively simple in terms of interactive elements, focusing on displaying disaster related
information and providing links to more detailed reports. This map has been created with OpenLayers. It is similar in scope to what you will be
creating in this course. Take a minute to open this map and examine it.
The map offers three different terrain-based basemap options serving as unintrusive backdrops for displaying the thematic layers.
However, when you zoom in, you will see that at a certain zoom level the basemap changes to a typical road map version, similar to what
you are familiar with from Google Maps, Bing, or OpenStreetMap. By inspecting the network traffic in the browser's network log while
panning around and zooming, we can see that all these basemaps options are loaded as image tiles using URLs like this one:
https://europa.eu/webtools/maps/tiles/osm-ec/11/1139/1066.png
The "osm" in the name here provides some clue that the tiles for the road map basemap have been created from OpenStreetMap data.
The map has a larger number of thematic layers, most of them for displaying disasters of different types (fire, drought, flood, etc.) as
icons/symbols on the map. When you zoom in, you will see that in addition to the icons there are actually vector features like polygons
representing the events (including detailed past and predicted trajectories for cyclones). In addition, there are raster layers for rain and
clouds. These two thematic layers are relatively easy to find in the browser's network log because they are also brought in as image tiles, in
this case from a local ArcGIS Server installation using URLs like this one:
https://www.gdacs.org/arcgis/rest/services/GDACS/daily_rain/MapServer/export?F=image&FORMAT=PNG32&TRANSPARENT=true&SIZE=256%2C256&BBOX=-180%2C-90%2C
In contrast, to the previous URL for the basemap tiles, which used nested folders for zoom level, x and y coordinates of the tiles, we here
find bounding box coordinates and other information encoded as arguments following the '?' which are then decoded by the server and
used to produce the requested tile image. How about the other thematic layers? It turns out these do not come as images but fortunately
they can still be identified relatively easily in the network log because the URLs for the requests contain abbreviations for the event types,
like this:
https://www.gdacs.org/gdacsapi/api/events/geteventlist/MAP?eventtypes=EQ
These requests are sent out immediately when the map is loaded and the response from the GDACS server always is a GeoJSON file with a
text specification of the vector features and their geometries. These vector features are then drawn by the web browser. You will learn
more about client-side rendering of data from GeoJSON files in Lesson 7.
The interactive elements of the map are a couple of buttons for zooming (top left), for accessing the layer switch control and legend for the
Rain layer (top right), and for displaying some general information and attribution (bottom right) confirming that OpenStreetMap data has
been used to create the map. Clicking on a symbol from one of the thematic layers will open a popup with information on the event and a
link to the full report. When you add interactive elements to your web maps, you will often add code that "listens" for particular events,
such as clicking, tapping, or hovering over a feature.
The second map is a web map at https://maps.nyc.gov/crime/ [7] showing the concentration of crimes of different types for New York City. The
basemap is entirely based on services provided by Carto (formerly known and still often referred to as CartoDB). The map is created in Javascript
using the Carto's API and elements of Leafleta.
The basemap is tiled and the tiles are loaded from a CartoDB cloud server using URLs of the following form:
https://cartodb-basemaps-c.global.ssl.fastly.net/light_nolabels/10/302/384.png
The tiles use a light non-intrusive design without labels. The labels you see are brought in as a separate tile set that only contains the labels.
There are three types of thematic layers that you can switch between under "Map Type" at the top right. The polygon based , choropleth-
style "Precinct map" layer and the point based "Crime Location Map" layer are brought in as tiles as well, using URLs such as
https://cartocdn-gusc.global.ssl.fastly.net/nycmap/api/v1/map/602523e471f3cd0e4b575fce24d1467a:0/0/11/601/771.png
In contrast, the "Heat Map" layer results in requests that are responded to with a .json.torque file, so text files rather than bitmap graphics.
Torque tiles are a special format that Carto uses for multidimensional spatial data. Finally, we can observe request of the form
https://cartocdn-gusc.global.ssl.fastly.net/nycmap/...15/3079.grid.json?callback=grid
that are responded to with another type of JSON text file that contains the information that is displays when you click on one of the
thematic features. Since this information cannot be stored in the thematic map tile images, it is clear that this information needs to be
brought in separately.
In addition to the standard map controls and the controls for choosing the "map type", the interactive elements of the web map allow for
filtering the data presented in the thematic layers based on crime type and a date range. In addition, there are elements that allow for
summarizing and comparing statistics, downloading the data and searching for a particular location in NYC. Clicking on the map will display
a popup with crime statistics depending on the map type and the thematic feature(s) located at this position. Double-clicking can be used
to zoom in on a particular location.
Other maps
Here are a few other maps you can look at if you want to keep practicing. Although some of these maps have very nice elements, I am
recommending them for their variety, not for their excellence in any particular realm.
TriMet Trip Ride Planner [9]
Downtown Alliance Interactive Map New York [10] (click on Open Map View at the bottom right)
NIU Campus Webmap [11]
From this brief exercise, you can begin to see the various approaches that can be used to put together a web map. Hopefully, you can look at a
web map and immediately begin to see how the layers were broken up into basemap layers and thematic layers. Whenever you see a web map,
you should also think about the interactive elements that are present and decide whether they are usable and applicable.
Figure 2.1b GeoServer installation folder after extracting the .zip file.
5. Now look in the subfolder called "bin". There you will find two .bat files for starting and shutting down GeoServer on Windows. These
scripts will look for three important environment variables on your system: JAVA_HOME, GEOSERVER_HOME, and GEOSERVER_DATA_DIR.
JAVA_HOME should point to your Java installation from step 1 above and should be set automatically. The other two need to refer to the
new folder to which you just extracted the GeoServer file tree and to the subfolder called data_dir in it, which is meant for storing the
spatial and other data to use with GeoServer. We could now go to the Windows Settings and define these environmental variables there,
but instead we are going to define them in the script files themselves. This way, there won't be any issues with older GeoServer installations
you may already have on your computer, and you will be able to simply delete the GeoServer folder at the end of the class if you want. So
please open the file "startup.bat" in a text editor (make sure it is startup.bat, not startup.sh!) and add the following two lines at the very
beginning. Adapt the path to the right of the equal sign in the first line to refer to your GeoServer folder.
set GEOSERVER_HOME=C:\Users\jow\GeoServer 2.18.5
set GEOSERVER_DATA_DIR=%GEOSERVER_HOME%\data_dir
You'll see a bunch of status messages appearing in a black and white console, like the following.
Wait a second for the messages to stop appearing, then go on to the next step. (If you keep this window open, you'll see messages appear
as you interact with GeoServer. This is okay, and may even help you with troubleshooting.)
If you get a Windows Security Alert that Windows Firewall has blocked some features of the program, check the top box to allow it to run on
private networks and click Allow access. Uncheck the bottom box, as public access will not be needed in this course.
7. Next, go to your browser and enter the address localhost:8080/geoserver/web.
This is a web page that you can use to administer GeoServer from this or any other computer in your network. You might be wondering,
"How did my machine get the ability to serve out web pages?" This is possible because GeoServer includes a servlet [16] called Jetty, which
allows your machine to respond to web service and web page requests without having a full-blown web server software package installed.
In an enterprise environment, you would install GeoServer onto your existing web server such as Apache Tomcat, and it is very possible
that you will need to do this sometime in the future. The process is straightforward enough that I was able to do it following this
instructional YouTube video [17] even though the video is not in English; however, for the assignments in this class, please use the Jetty
server and only attempt the Tomcat install if Jetty is not working. My intent is to keep everyone on as close to the same environment as
possible, so that I can be more helpful with troubleshooting if needed.
8. Log into GeoServer by using the username admin and the password geoserver in the upper boxes and click Login. These are the default
username and password for the administrator account. You must use this the first time you log in.
9. Rather than working with files that represent an entire map, like .mxd or .qgs, GeoServer works with the concept of layers and layer groups.
You define a set of datasets that you want to have exposed on your server, and then you define what characteristics they'll exhibit when
brought into web maps as web service layers.
GeoServer comes with a bunch of sample layers already loaded. Let's take a look at those.
10. In the left-hand menu, click Layer Preview.
11. Scroll down to the Tasmania state boundaries layer and click the OpenLayers link.
Figure 2.5 Find Tasmania in the list of layers
This displays your map as a web service that you can navigate. The web service was delivered through the Open Geospatial Consortium
(OGC) Web Map Service (WMS) specification, an openly documented way of serving web maps that you'll learn more about in Lesson 4. The
map frame and navigation buttons were created through the OpenLayers JavaScript framework.
It's important to understand that you also could have done this by clicking the dropdown list and choosing WMS > OpenLayers 3 (or
just OpenLayers on older versions of GeoSever). Looking at this list, you get a better idea of the many different output formats supported
by GeoServer.
In addition to requesting many layer formats, you can request groups of layers together if they have been configured as a group layer.
GeoServer comes with a few preconfigured group layers.
13. In the GeoServer layer preview list, scroll down to the Tasmania group layer (symbolized by green squares). Using the techniques you have
learned, preview this in OpenLayers.
Here, you see three layers that have been delivered together as one map.
Figure 2.8 Preview of Tasmania from GeoServer
You'll return to GeoServer later in this course. This walkthrough just ensures you have it up and running correctly. If technical difficulties
prevented you from getting to this point, please alert your instructor.
Source URL:https://www.e-education.psu.edu/geog585/node/683
Links
[1] http://creativecommons.org/licenses/by-sa/3.0 [2] https://www.bing.com/mapspreview [3] https://wego.here.com [4] http://www.texastribune.org/library/data/texas-reservoir-
levels/ [5] https://apps.texastribune.org/reservoirs/assets/data/reservoirs.json [6] https://www.gdacs.org/ [7] https://maps.nyc.gov/crime/ [8]
https://npcn.net/npcnWebmap/index.html [9] http://ride.trimet.org/?tool=routes#/ [10] https://www.downtownny.com/map [11]
https://www.niu.edu/visit/maps/interactivemap.shtml [12] http://www.java.com/en/download/index.jsp [13] https://geoserver.org/ [14]
https://sourceforge.net/projects/geoserver/files/GeoServer/2.19.6/geoserver-2.19.6-bin.zip/download [15] http://geoserver.org/release/2.14.2 [16]
http://en.wikipedia.org/wiki/Servlet [17] https://www.youtube.com/watch?v=YEOA8WWWVCw [18] https://www.e-education.psu.edu/geog585/node/742