Maps Search

4 �
02 t�n
fro ez Evaluation Guidelines
m
�2 ar December 2023
y �17, ar�M Sa
a r sc
1. Introduction ..............................................................................................................................................5
u �O t
e b r
b y e I P�1 urda
[Link] Rating Tool ....................................................................................................................................................................................................5
F
y,� 54.9 nriq
� u 72 y,�F
[Link] Workflow da .16 eb
...............................................................................................................................................................................................11
r 16. Ma 2
t u . .25 rua
Sa 172................................................................................................................................................................................................13
[Link] Interface 4.9 ry�
�b 17
� M
I P
[Link]-Level Navigational Result Question an y�Os ,�202
.................................................................................................................................................14
riq car
[Link]-Level Rating Checkboxes ...................................................................................................................................................................14
ue �M 4�fro
[Link] Relevance Rating ..................................................................................................................................................................................15
art m
�ne
[Link] Relevance Demotion Checkboxes ...................................................................................................................................................17 z
[Link] Accuracy ...................................................................................................................................................................................................17
[Link] ..........................................................................................................................................................................................................17
2. Understanding User Intent .......................................................................................................................18
[Link] Types .......................................................................................................................................................................................................18
[Link] Expectation .......................................................................................................................................................................................22
[Link] Types .......................................................................................................................................................................................................22
[Link] Intent ..................................................................................................................................................................................................23
[Link] Location ................................................................................................................................................................................................24
[Link] Location ..............................................................................................................................................................................................24
3. Rating the Query-Level Navigational Result Question ...............................................................................25
4. Rating Result-Level Issues ........................................................................................................................25
[Link] Name/Title in Unexpected Language or Script.....................................................................................................................25
[Link] of Business/POI Results ........................................................................................................................................................................27
[Link] of Address Results ....................................................................................................................................................................................30
[Link]/POI is Closed or Does not Exist .............................................................................................................................................30
[Link]/Does Not Exist vs. Inaccurate Name and Address......................................................................................................................31
[Link] Relevance of Closed/Non-Existing Business/POI .......................................................................................................................31
[Link]/POI Status is PERMANENT_CLOSURE ................................................................................................................................31
[Link] Status Shown ..............................................................................................................................................................................................32
[Link] Shown as PERMANENT_CLOSURE .................................................................................................................................................32
5. Relevance ................................................................................................................................................32
[Link]-Result Connection..............................................................................................................................................................................33
5.1.1. General Connection .........................................................................................................................................................................................34
5.1.2. Abbreviation/Alternate Name Connection ..............................................................................................................................................34
5.1.3. Category Connection .....................................................................................................................................................................................34
5.1.4. Spell Correction Connection .........................................................................................................................................................................35
5.1.5. Transit Intent Connection ..............................................................................................................................................................................35
5.1.6. Special Character Connection ......................................................................................................................................................................35
5.1.7. Address-Result Connection ............................................................................................................................................................................36
5.1.8. Lack of Connection .........................................................................................................................................................................................36
5.2. Satisfying User Intent ....................................................................................................................................................................................38
[Link].........................................................................................................................................................................................................39
[Link] ................................................................................................................................................................................................................40
[Link] vs. Prominence ...............................................................................................................................................................................42 m
Sa
[Link] u Possible Results 4 �fro ez
....................................................................................................................................................................................42
2
IP� rda
17 Possible
[Link] y Results , � 20 art�n
.......................................................................................................................................................................................45
7
2.1 ,�Fe 1 �M
[Link] Possible
6.2 brResults ry� scar
and Greater Distance ..........................................................................................................................................46
a
u u
[Link] Areas
� F ebr 9�by�O ue
54 .........................................................................................................................................................................................................47
.9� ary�1
b ,
[Link] Ma– User y
nri �OIntent
7
sca �202Deviation
, ay .254. anriq
............................................................................................................................................................48
r d
[Link] for User qu Inside r�Mand tu 6
4�f Outside Viewport ...................................................................................................................................49
M
rom Sa 172.1
[Link] AddresseDoes Not art Exist ................................................................................................................................................................51
�
�ne IP
[Link] vs. Municipality .....................................................................................................................................................................................52
z
[Link] Results ......................................................................................................................................................................................52
5.15. Multiple Transit POIs with the Same Name ......................................................................................................................................54
[Link] and Transit Intent ...............................................................................................................................................................................55
m
4 � fro ez
[Link] Queries .................................................................................................................................................................................................56
2 n
[Link] vs. Stations ............................................................................................................................................................................................59
7 , �20 art�
[Link] Intent .................................................................................................................................................................................................61
y�1 car�M
rMismatch Sa
[Link]: Service-Level u a s ......................................................................................................................................................61
t
[Link] Relevance,�F
b r
e 9�Result
When b y � O I P�1 urda
eStatus is PERMANENT_CLOSURE ...........................................................................................64
u 72 y,�F
y 54. nriq Status ..................................................................................................................................................64
r a
[Link] PERMANENT_CLOSURE
d . 2 a .16 eb
t uM 6 . 2 r u
Sa 172.1PERMANENT_CLOSURE Status: Navigational Query......................................................................................................66
[Link].Expected 54
.9� ary�1
�
[Link].Expected
IP Ma by�O 7,�2
PERMANENT_CLOSURE Status: All chains closed in area ............................................................................................68
nri sc 024
[Link] PERMANENT_CLOSURE Status ............................................................................................................................................69
�M ro qf ar � u
e
[Link].Unexpected PERMANENT_CLOSURE Status: Open Options are Nearby ....................................................................................70
ar mt�n
ez
6. Name Accuracy ........................................................................................................................................71
[Link] Not Applicable (n/a) .........................................................................................................................................................................71
[Link] Names .....................................................................................................................................................................................................72
6.2.1. Correct Name ....................................................................................................................................................................................................72
6.2.2. Partially Correct Name ..................................................................................................................................................................................75
[Link]. Minor and Moderate Misspellings and Missing or Extra Words .....................................................................................................75
[Link]. Service-Level Mismatch ....................................................................................................................................................................................78
[Link]. Holding Name and Corporate Structure ....................................................................................................................................................79
6.2.3. Incorrect Name................................................................................................................................................................................................80
6.3 Result Classification ........................................................................................................................................................................................82
6.3.1. Correct Classification ......................................................................................................................................................................................82
6.3.2. Incorrect Classification ..................................................................................................................................................................................83
6.4. Can’t Verify .........................................................................................................................................................................................................85
6.5 Transit Names ...................................................................................................................................................................................................86
6.6. Parking Names .................................................................................................................................................................................................86
6.7. Final Name Accuracy Rating (Summary Table) .................................................................................................................................88
7. Address Accuracy: Components and Issues ..............................................................................................89
[Link] Components .....................................................................................................................................................................................89
[Link] Number .....................................................................................................................................................................................................89
[Link]/Apt................................................................................................................................................................................................................91
[Link] Name ........................................................................................................................................................................................................92
[Link]-Locality and Administrative Subdivisions ..........................................................................................................................................93
[Link] .................................................................................................................................................................................................................94
[Link] or State...................................................................................................................................................................................................94
[Link] Code .........................................................................................................................................................................................................95
[Link] .................................................................................................................................................................................................................95
[Link] Does Not Exist .................................................................................................................................................................................96
[Link]/Script Issue in Address ............................................................................................................................................................96
[Link]-Specific Issue ...................................................................................................................................................................................97
[Link]-Specific Issue vs. Correct with Formatting Issue .......................................................................................................................97
[Link] Issue ..........................................................................................................................................................................................................97
[Link] with Formatting Issue ...................................................................................................................................................................98
[Link]’t Verify ..........................................................................................................................................................................................................98
[Link]’t Verify for Street Number ........................................................................................................................................................................99
[Link]’t Verify for Street Name ...........................................................................................................................................................................99
8. Address Accuracy: Result Expectations ...................................................................................................100 m
Sa
t u 4 �fro ez
[Link]/POI
IP� rda Result ....................................................................................................................................................................................100
2
20 art�n
1 y 7 , �
[Link]/POI
2.1 ,�Fe Address Research and Resources .......................................................................................................................................100 1 �M
6.2 brOfficial
[Link] Addresses a ry� scar
......................................................................................................................................................................101
u u
54
[Link].Department � F ebr 9�by�O ue
.9� ary�1Addresses ....................................................................................................................................................................................101
b ,
Ma Missing y
nri �Osc �the
[Link].Result
7
02 r d ay .254. anriq
, 2 Street Address ..............................................................................................................................................................103
a 4�f tu 6 M
[Link].P.O. Box, quMailing
e r�MAddresses, a Sa 172.1
rom and Management Offices ......................................................................................................................104
[Link]/POI with Moving �
rt�n Locations ....................................................................................................................................................105
IP
ez
[Link] .................................................................................................................................................................................................................105
[Link] Type Results ..................................................................................................................................................................................106

2
 [Link] Result..................................................................................................................................................................................................106
m
4 � fro ez
[Link] Formats ............................................................................................................................................................................................106
2 n
[Link] Result ....................................................................................................................................................................................................107
7 , �20 art�
[Link] Result.................................................................................................................................................................................................107
1 �M
a ry� scar Sa
[Link] Code Result .........................................................................................................................................................................................108
t
u
[Link]/Region/Territory F e b r
b
Result
�
� O
e I P�1 urda
y .....................................................................................................................................................................108
,� 4.9 riq u 72 y,�F
y.................................................................................................................................................................................................108
[Link] Result da
r 16. Ma 2 5 n .16 eb
t u .25 rua
[Link] Without
Sa 172. an Expected Address ..............................................................................................................................................108
4.9 ry�
�
[Link] Features �b 17
.............................................................................................................................................................................................108
M
I P an y�Os ,�202
[Link] Without an Expected Address ...........................................................................................................................................................110
riq car 4�
e u �M ro f
[Link].Minimum Address Component ....................................................................................................................................................................110
art m
�ne
[Link].Official Address Present ..................................................................................................................................................................................111
z
[Link].No Official Address ............................................................................................................................................................................................113
9. Pin Accuracy ..........................................................................................................................................115
[Link] Considerations ..............................................................................................................................................................................116
[Link] Resources .....................................................................................................................................................................................................116
[Link] Imagery vs. Vector Map .................................................................................................................................................................116
[Link] of the Feature .............................................................................................................................................................................117
[Link].Half ’n Half and Tennis Rules.........................................................................................................................................................................118
[Link].Boundaries in Shared Spaces ........................................................................................................................................................................120
[Link] Door ..........................................................................................................................................................................................................122
[Link]’t Verify (Smallest Identified Area) .......................................................................................................................................................123
[Link] Rooftop .................................................................................................................................................................................................124
[Link] Buildings ...........................................................................................................................................................................................139
[Link] Property with Multiple Buildings .........................................................................................................................................141
[Link] Rooftops ..........................................................................................................................................................................................142
[Link]-Rooftop Rating ...............................................................................................................................................................................143
[Link] Rating...............................................................................................................................................................................................149
[Link].Single-Complex Campus ..................................................................................................................................................................................151
[Link].Dispersed Campus .............................................................................................................................................................................................154
[Link] Without a Rooftop ......................................................................................................................................................................157
[Link] Features ..............................................................................................................................................................................................157
[Link] Divisions ..............................................................................................................................................................................160
[Link] ................................................................................................................................................................................................................161
[Link] Lots and Structures .....................................................................................................................................................................163
[Link] POIs .....................................................................................................................................................................................................164
[Link], Tram, and Streetcar Stops ....................................................................................................................................................................166
[Link] POI with Multiple Rooftops/Platforms .......................................................................................................................................167
[Link] POIs with a Single Rooftop............................................................................................................................................................170
[Link] Transit Stations ....................................................................................................................................................................170
[Link].How to Establish an Entrance Polygon .....................................................................................................................................................171
[Link].Examples ................................................................................................................................................................................................................172
[Link] to Rate Results ..............................................................................................................................176
[Link] Address ..........................................................................................................................................................................................176
[Link]-Specific Address ................................................................................................................................................................................191
[Link] Address Does Not Exist ..............................................................................................................................................................199
[Link] of Interest ...........................................................................................................................................................................................201
m
Sa
[Link]
t u Multiple Query Interpretations: Beyond Viewport and User Location ...............................................205
2 4 �fro ez
[Link]
17 y 7 , � 20 art�n
IP� rda Queries.........................................................................................................................................................................................208
.16 ,�Feb Businesses.................................................................................................................................................................................209
[Link]-Chain 1
ry� scar
�M
.
[Link] 2 r u
54Businesses u a
..........................................................................................................................................................................................212
[Link] Business � ebr 9�by�O ue
.9� ary�1with Location Modifier..................................................................................................................................................216
F
M b y 7 , � � y , 4. iq r
an OLocation
[Link].General 2 d 25 a n
riq scar 024Modifier
�
...........................................................................................................................................................................216
a tur 2.16. Ma
u �
[Link].SpecificeLocation f
Ma Modifier
rom ...........................................................................................................................................................................224
S 17
[Link] Offices and Businesses IP �
rt�n with no Physical Location ...................................................................................................................228
ez
[Link]/POI does not Exist ......................................................................................................................................................................230
[Link] Queries ........................................................................................................................................................................................231
3
 [Link] for Distance with User Inside Viewport...............................................................................................................................232
m
[Link] for Distance with User Outside
4 � fro ezViewport ..........................................................................................................................234
[Link] for Distance with Fewer 2 rt�n Results...........................................................................................................................236
7 , �20 Possible
a
[Link] Queries and User y �1Intent r �M...........................................................................................................................................................238
[Link] Queries and ar Osc a Sa
uProminence .........................................................................................................................................................239
t
[Link] Query,�Fwith b r
e Location�b y � eModifier
I P�1 urda
................................................................................................................................................239
y 54for .9 riq u 72 y,�F
[Link] daResults
2
r 16. Ma Category
n Queries .16 eb
............................................................................................................................................241
t u .25 rua
a 72. ...........................................................................................................................................................................................245
[Link] SCategories 4.9 ry�
� 1 ..............................................................................................................................................................................................246
[Link] Categories M �b 17
I P an y�Os ,�202
[Link] Query: Parking ...........................................................................................................................................................................251
riq car
ue
[Link] Results with PERMANENT_CLOSURE Status ...................................................................................................................255 �M 4�fro
art m
[Link] PERMANENT_CLOSURE Status ...............................................................................................................................................255 �ne
z
[Link] PERMANENT_CLOSURE Status ........................................................................................................................................256
[Link] Query Types .....................................................................................................................................................................................258
[Link] Queries ............................................................................................................................................................................................258
[Link] and “My Location” Queries..................................................................................................................................................260
[Link] Results .........................................................................................................................................................................................262
[Link] Rating Tips ......................................................................................................................................269
[Link]’s the relevance when query is business/POI name and address and the result is only the address? .......269
[Link]’s the relevance when the query is a street name and the result is a single business on that street? ........269
[Link] do I know what the location intent is when user is outside/inside a fresh viewport?......................................270
[Link] do I know what the location intent is when user is outside/inside a stale viewport? ......................................271
[Link] full address result does not exist. How do I rate it? ...........................................................................................................271
Appendix: Release Survey ..........................................................................................................................273

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

4
1. Introduction m
4 � fro ez
2 n
Welcome to Maps Search Evaluation. 7 , �20 art�These guidelines will teach you how to use the evaluation tool
1 �M
and rate Maps Search results. a ry� scar Sa
t
u
F e b r
� b y � O
e I P�1 urda
y,� 54.9 nriq u 72 y,�F
a .16 that
For each task,tuyou
r 1will
d 6 . be
2 apresented with a search query and the results .25 ebare
r provided to Maps
S a
users. The goals 7 of
2 .
this
M
task are: 4.9 uary�
1 Ma �by�O 17,�2
IP� nri sc 024
a
• Search Relevance and Search 2.0: To determine how well the resultsqusatisfy e r�Mthe �f o
art ruser’s
m
query (result relevance) �ne
z
• Search 2.0 only: To check the data accuracy (name, address, and pin location) of the results

1.1. The Rating Tool

This is the web-based rating tool used to rate Search 2.0 and Search Relevance queries.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

5
Anatomy of the Tool m
4 � fro ez
2 n
7 , �20 art�
1 �M
a ry� scar Sa
Name Screenshot
u Description
IP� turda
� Febr 9�by�O ue 17 y,�
, . iq
r day 6.254 anr The task bar shows: 2.16. Febr
u 25
t
Sa 172.1
M 4.9 uary�
� Mathe �by 17,
IP • Task Type: The name of nri task.
�Os �20
• Task ID: A number that identifies qu cathe 24
e r�Ma �from
specific task item. Use this number rt�ne
whenever you communicate about a z
task or rating.
Task Bar • Request ID: A reference number for
internal use only. Do not use this
number to communicate about a
task or rating.
• Estimated Rating Time: Time to
rate all results

Rating The Rating Guidelines shortcut button

Guidelines opens the guidelines for this task.

Allows you to skip a survey in rare cases

Release where a technical or other issue prevents
Survey you from rating. See Appendix for
complete instructions.
Viewport shortcut buttons provide
convenient controls to pan or zoom to
common map viewport settings. Show
Show User
User moves the result viewport to the
user’s location without changing the zoom
level (map scale).

Show Viewport moves the result

Show viewport to the center of the user
Viewport viewport and zooms in on the viewport
area.

Use Show All to return from any zoom m

SShow
a All level to the initial display showing the �fro ez
IP� turda 2 4
�20 art�
n
17 user, the viewport, and all the results. ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

6
 Name Screenshotrom Description
0 2 4�f �nez
rt The query header shows:
�1 7,�2 r�Ma
ry
ua �Osc
a Query: The term theSuser a entered into the
e b r y search bar. IP� turda
y ,�F 4.9�b rique 17 y,�F
2.1 ago
a
d 6.25 an Viewport Age: How long 6.2 etheb user
tur M 54 ruar
Sa 172.1 moved the viewport. .9 y�1
� • A fresh viewport is indicatedMa �byby 7,�
IP nri sthe
� O
c
20
2
word FRESH displayed in green qu
e
a r �M 4�fro
text. a rt�n m
Query • A stale viewport is indicated by the ez
Header
word STALE displayed in red text.
Locale: The country and language
combination this query is for.
Country: Should match the country in the
Locale field. If it does not, defer to the
country found in the Locale field.
User Lat,Lng: The user’s location.

Top-Level A top-level question that must be

Question answered once for each query.

The result returned for a user query.

The color of the result heading

corresponds to the color of the pin on the
map that marks that result’s location. (See
Result Pin on page 9.)

The result address, classification and

status (if included) will be shown beneath
Result the result name/title. (The classification of
the result refers to its category.)

You will evaluate the relevance of each

individual result. If you are rating Search
2.0, you will also rate the name/address/
pin accuracy for each result.
m
Sa Note: A query can generate more than �fro ez
IP� turda one result.
2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

7
 Name Screenshotrom Description
0 2 4�f �nez
rt
�1 7,�2 r�Ma
ry a Sa
b r ua �Osc IP� turdits
A result may also display status. If the
e y
a y ,�F 4.9�b rique 17 ay,�
status appears and is set2.1to Fe
rd .25 Man 6.2 bru
StatusSatu 2.16 PERMANENT_CLOSURE, the 54result
17 .9� ary�1
IP� requires special treatment whenMa brating
y 7,
relevance. nri �Osc �2024
qu a
e r�Ma �from
rt�n
ez
` You may occasionally see one or more
normal looking or grayed-out results with
Result with
no rating fields beneath them. No rating
no Rating
is required for these results. This is
Choices
expected and is not a technical issue or
a reason to release the survey.

User viewport: A transparent purple box

centered over a device icon shows the
user’s viewport at the time the query was
issued (if known). The user viewport
represents the map area the user was
looking at when making the query.

The shape of the viewport may vary

depending on the size and orientation of
User
the device being used.
Viewport
Note: In some cases, the user viewport
may be so small that it cannot be seen,
but (if the viewport information is
available) the device icon will always be
visible, regardless of the map scale.

Note: The viewports you see in the

examples in these guidelines may be grey.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

8
 Name Screenshotrom Description
0 2 4�f �nez
rt This device icon shows the center of the
�1 7,�2 r�Ma
ry
ua �Osc
a user viewport at theSatime
tur of the user
e b r y query. The purposeIPof�1 the d device icon is
y ,�F 4.9�b rique 72 ay,�F
a
d 6.25 an to make it easier to find the
. 16 user
.25 ebruviewport.
tur M
Sa 172.1 It does not indicate the user's [Link].
a
9�b ry�17
IP � Ma y�O ,�2
n i sc 024
This icon should not be used rfor qu ar�M �fr
Device Icon e art om
measuring distance. To measure �ne
distance, start from the outer edge of the z
user viewport.

This icon has no rating significance. Its

only purpose is to help you find the
viewport on the map.
A blue and white icon indicates the user
location at the time of the query (if
known).
User
Location
Note: Clicking on the icon reveals the
coordinates (latitude/longitude) of the
user’s location.
A pin indicates a result’s location. The
head of the pin is only an indicator. The
tip marks the actual location.

Each pin on the map has a unique

number and color, which matches the
Result Pin number and color of its corresponding
result heading.(See Result, above)

Note: The pins you see in the examples

in these guidelines may look different
from the pin shown in this chart and the
ones in the tool.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

9
 Name Screenshotrom Description
0 2 4�f �nez
rt Clicking any individual result or pin causes
�1 7,�2 r�Ma
ry
ua �Osc
a a pop-up box to appear Sa over the pin. The
t r
e b r y I P�1 ushow
text within the box may d additional
y ,�F 4.9�b rique 72 ay,�F
a
d 6.25 an information and should only . 16 beebused
.25 rua for
tur M
Sa 172.1 research purposes to help understand
4.9 ry� the
�b 17
� M
IP result: an y�Os ,�202
Pop-up riq car
ue �M 4�fro
Information • Phone number (for research only, art m
�ne
Box never call a business) z
• URL
• Coordinates (latitude/longitude)

Note: Do not rate the information in the

pop-up box. Rate only the information in
the result.

Map Layer Allows you to select which map layer is

Selector displayed.

Allows zooming in and out on the map.

Zoom
Change the zoom level by clicking the +
Controller
(zoom in) or – (zoom out) buttons.

Copy to
Click to copy information to a clipboard
Clipboard

Click the pin icon at the top right of the

map to place a pin anywhere on the map.

Drop
Location Pin

A purple pin and a pop-up window

showing the pin’s address and latitude/
longitude will appear.
m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

10
 Name Screenshotrom Description
0 2 4�f �nez
rt
�1 7,�2 r�Ma To measure the distance, click the ruler
ry a S
b r ua �Osc icon at the top rightIPofatthe
urd map.
e y
Measure a y ,�F 4.9�b rique �17 ay,
2.1 �Fe
5 n
Distanceaturd .16.2 Ma 6.2 bru
54
S 172 You can now drop a start pinM(green) .9� ary�1and
IP� by 7,�
nri �Oscthe 20
an end pin (red). The tool will adisplay 2
distance between them.
qu
e
a r �M 4�fro
art m
�ne
z
Draw Tool Click to draw custom polygons.

Click Submit to save your ratings and

Submit
display the next available task.

[Link] Workflow

Complete each step of the following workflow before you assign a rating.

Evaluate and rate each rating drop-down independently of the others. Rate result Relevance based
on whether the result fits the query intent, even if the result is closed or does not exist or has
incorrect Name, Address, or Pin data. If you are rating Search Relevance you will stop after you’ve
rated result relevance. If you are rating Search 2.0, you will continue by rating Name Accuracy,
Address Accuracy, and Pin Accuracy individually.

Note: For any result in a Search 2.0 project, you may be asked to make all of the possible ratings, some of
them, just one, or none. This is expected and not a reason to escalate or release a task.

Rate each result on its own merits. Do not demote duplicate or very similar results.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

11
 m
4 � fro ez
2 n
7 , �20 art�
1 �M
a ry� scar Sa
u
ebr 9�by�O ue IP� turda
F 17
, � . iq 2.1 y,�Fe
u r day 6.254 anr 6.2 bru
t M
Sa 172.1 54
.9� ary�1
IP � Ma by�O 7,�2
nri sc 024
qu ar�M �fr
e art om
�ne
z

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

12
1.3. Rating Interface m
4 � fro ez
2 rt�n
Your ratings and comments will 7 , �20be collected
a in the rating interface pictured below. You will first
answer one top-level question y �1 about
a r �M the query itself, then rate each Sa individual result using the other
r
ua �Osc t
checkboxes and [Link] b r
�b y e I P�1 urda
y,� 54.9 nriq u 72 y,�F
da
r 16. Ma2 .16 eb
t u .25 rua
Sa 172. 4.9 ry�
�b 17
� M
I P an y�Os ,�202
riq car
ue �M 4�fro
art m
�ne
z

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

13
 m
1.3.1. Query-Level Navigational 4 fro ez Question
Result
�
2 n
7 , �20 art�
�1 ar�M for each query to indicate whether
You will answer a top-levelryquestion Sa there are any results in the
a sc
u
real world that would ecompletely
br �by�O e satisfy the user intent. IP� turda
17
d a y,�F 54.9 nriqu 2.1 y,�Fe
2 6.2 bru
tur 2.16. Ma 54
S a
Query-level 1 7 question Explanation .9� ary�Notes
IP � Ma by�O 17,�2
n i sc 024
Is there a navigational result Are there any results in the real You willronly qu need
a to answer
e r�Ma �from
for this query? world that can completely this question once rfor
t�n each
satisfy the user intent? query. ez

Answer to Query-Level
Query Explanation
Question
[Eiffel Tower] Yes There is only one result in the
real world that can completely
satisfy the user intent.
[Starbucks] No There is not only one result in
the real world that can satisfy
the intent of this query.

Note: If you are presented with a query that has no results, you must still answer this question and
submit your answer.

1.3.2. Result-Level Rating Checkboxes

For each result, you will be presented with two high-level questions. These will allow you to highlight
any problems with the result.

High-level
Explanation Notes
question
Result is not in the language of the If you check this box, your rating for this
Result name/
query, the test locale, or the result result will be complete (all other questions
title is in
region (the expected languages) or is will be unavailable).
unexpected
in a mix of expected and unexpected
language or
languages (unless it is an official
script
company, chain, or brand name).
m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

14
 High-level m
� fro ez
Explanation Notes
question 2 4 n
7 , �20 art�
1 �M
a ry� scar If you check
Sa
tur this box, only the relevance
u
Febr 9�by�O ue I
needsPto�17bedrated.
a
, � . iq 2.1 y,�Fe
u r day 6.254 anr 6.2 bru
t M
Sa 172.1 Pay attention to54the
.9� status
ary
�17 of the POI. If
� M b
IP the result’s statusan is �Os ,�202
y
PERMANENT_CLOSURE, riq carrefer4� to 5.19
ue �M fro
Rating Relevance when Status art is m
�ne set to
PERMANENT_CLOSURE and 10.8z
Permanently Closed Results for rating
Business/POI Research shows that the business is
instructions.
is closed or closed or that no such business exists
does not exist at the address listed in the result.
If the status is blank or displays any other
text, rate the relevance of the result as if it
did exist.

Use thorough research and your best

judgement to determine whether the
result is closed, has never existed, or the
result component(s) are [Link]
Unclear Results for further guidance.

1.3.3. Result Relevance Rating

The relevance rating will take into consideration user intent as well as distance/prominence.
Relevance is always rated independently of any data (name/classification, address, or pin)
inaccuracies. This means that when rating relevance we always assume that the result exists (even if
research reveals the location is closed) and that the data presented is correct.

Always rate against the real world: If there is a better result available but it is not shown, demote the
existing result(s) while considering the missing one(s).

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

15
 Relevance m
� fro ez
Explanation Notes
Rating 2 4 n
7 , �20 art�
�1 ar�M
The rmostary Olikely
sc result implied by the user’s Sa
e
u
b �by� e IP� turda
y,query,
�F 4.9 location, and/or viewport that 17
a 5 n riq
u 2.1 y,�Fe
d
tur completely satisfies the user’s distinct
2
6. Ma 6.2 bru
Sa 172.1intent. 54
.9� ary�1
IP� A distinct user intent is defined by a
Ma by�O 7,�2
A rating of nNavigational
riq scar 024� for one
combination of the following result does not ueprevent f
�M other
Navigational art rom
characteristics: results from satisfying the �ne query to
z
• Extreme prominence (e.g. Eiffel Tower) a lesser degree.
• Uniqueness (e.g. complete address)
• Proximity (e.g. incomplete address that
points to an unambiguous option that is
is extremely close)

Highest possible initial rating for

A high-quality result that clearly satisfies the
ambiguous queries as well as for
Excellent user’s intent. Multiple results can be
queries that are not eligible for a
considered high quality.
Navigational rating.
Only partially satisfies the user’s intent due
Good
to relevance, prominence, or distance.
Any relevance rating of Good or
Technically satisfies the user’s intent but below requires an indication of the
Acceptable
does so poorly due to relevance or distance. reason(s) for the demotion:
• User Intent Issue
Does not satisfy the user’s intent due to lack • Distance/Prominence Issue
Bad of relevance or great distance (when closer
satisfying results are available).

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

16
1.3.4. Result Relevance Demotion Checkboxes m
4 � fro ez
If you give a result a Relevance,�2rating 02 art�ofn Good or below, you will be presented with two checkboxes.
1 7 �M
Use them to select the reason(s) ry� scar for your rating: Sa
u a t
Fe b r
�b y � O
e I P�1 urda
• User Intent ,� 4.9 riq
yissue u 72 y,�F
da
r 16. Ma 2 5 n .16 eb
• Distance/Prominence
t u issue .25 rua
Sa 172. 4.9 ry�
�b 17
� M
I P an y�Os ,�202
You must also leave a comment explaining your rating. riq car
ue �M 4�fro
art m
�ne
z
Checkbox Explanation Notes
User Intent Select when the demotion is due to a result only
issue partially fulfilling the query intent.
Select when the demotion is due to a distance
issue based on the user or viewport location or If both issues were reasons for
Distance/ when you demoted for a result that is less your relevance rating, select both
Prominence prominent based on the initial query intent. You checkboxes.
issue can also select this option when the query asks
for something at a specific location and the
result is not at or near the requested location.

1.3.5. Data Accuracy

If you are rating Search 2.0, once you've rated relevance, you’ll evaluate three result components for
data accuracy: Name, Address, and Pin.

1.3.6. Comments

Comments are mandatory for any result relevance rating of Good or below and for any data issues
not rated Correct/Perfect and should explain the reasons for all rating demotions. Be sure to:

• Include user intent: Indicate what you think the user intent is.
• Refer to the guidelines: If the demotion is due to a guideline instruction, note the guideline
section you used to make your decision.
• Include sources: If you find incorrect information in a result, your comment should include
the correct information and its source. Be sure that any links you include lead directly to the
information you provide. If they don’t, include a link to the source you used and explain how to
get to the information from there.
• Use URL shorteners when inserting long links into your comments m
Sa
t u 4 �fro ez
IP•� rBe concise: Don’t write elaborate comments. Be short and specific. 2
�20 art�
n
17 day,� 7 ,
• 2Comment
.16 Feb in English: Your comments will sometimes be reviewed or used by rpeople y�1 car�who M are
. 2 r a s
not familiar
54
.9� arywith
u your test locale or its language. Comments in English canebe br understood
u O by
� 1 � F � by� ue
the M widest
an y�Opossible
b 7 ,�2 audience. y , 4 . 9 ri q
riq scar 024� t urda 16.25 Man
ue �M fro
art m Sa 172.
�ne IP�
z

17
 Issue Expectations m Example Rating and Comment
4 � fro ez
The comment 7 , 202 art�nexplain the
�should Relevance -> Good (Distance/
reasoning �1 ar�Myour rating. A demotion
rybehind Prominence)
Sa
u a sc t
Relevance may�Fbe ebr due � O I P�1 urdaDemoted -1 for a few closer
9�b riqudistance
to from the user’s Comment:
y e
y , 4 . 72 y,�F
Demotions rdlocation
a 25 compared
an to similar results/ real world .1locations
6.2 ebru in the Middletown/
tu 2.16. Mresults, 54
Sa 17potential secondary intent, or Anchorage area .9� ary�1
IP� other reasons. Ma by�O 7,�2
nri sc 024
qu ar�M �fr
Address Accuracy -> e Incorrect
art om— Street
Number �ne
Include a comment when you rate a z
Comment: Correct street number is: 332
Name, Address, or Pin something other
W El Camino Real, Sunnyvale, CA 94087
than Correct or Perfect or you give a
Data Issues as found on the official site: https://
rating of Closed/Does not Exist or
[Link]/locations/sunnyvale
Unexpected Language.
Pin Accuracy -> Wrong
Comment: Wrong pin: correct location is:
52.368067, 4.895389

2. Understanding User Intent

Before evaluating any results, you’ll need to understand what the user wanted to find when they
typed in their query. To determine user intent, use a combination of your own research and local
knowledge plus the information found in the rating interface, which includes:

• User location
• User viewport
• Viewport age

User intent refers to the interaction between query, user location, user viewport, and viewport age.

2.1. Query Types

The queries you are evaluating are real queries submitted by users. Because they are real, they can:

• Be misspelled
• Contain mistakes
• Be inconsistent
• Be ambiguous
• Be badly formatted
• Be, or contain, emojis
m
S•a Have no maps intent
t u 2 4 �fro ez
IP� rda
17 y 7 , � 20 art�n
,�F
2.1 step 1 �M
The first 6.2 ebin r the rating process is to make sure you understand the query. ary� scar
u u
54
.9� ary�1 � F ebr 9�by�O ue
M b 7
y�O ,�2 ,
y 54. nriq
If you see aanforeign-language
riq scar 024� rda 1query
query, do not release the survey. Researchtuthe .2 Mor a use an online
ue translation 2 . 6
�M fro tool to find out what it means, then rate Sitaas 7usual.
art m 1
�ne IP�
z

18
You will see several types of queries, including: m
4 � fro ez
2 n
Address queries 7 , �20 art�
1 �M
a ry� scar Sa
t r
u
Address queries contain
r
all � O
yor part of a complete address, I P�1 ustreet
including 72 ay,�Fnumber, street name,
e b �b e d
y F
,� 4.9 riq u
locality, state, country,
d 6.25andanpostal code.
a . 16 ebr
tur M .25
4.9 uary�
Sa 172.1
IP � Ma �by�O 17,�2
Query Explanation nri sc 024
qu ar�M �fr
e art om
[717 E El Camino
This is an address query in the form of a full address. It contains a�nstreet ez
Real, Sunnyvale,
number, street name, locality, state and postal code.
CA 94087]
[Stevens Creek
This is an address query for a street. The user is looking for the location of
Blvd, Cupertino
this particular street.
CA]
This is an address query for a country. The user is looking for the location of
[Ireland]
the country of Ireland.

This ambiguous query could refer to New York city or New York state. You
[New York] will find more information on prominence, user location, and the viewport in
the following sections to help you determine the intent of this query.

Point of Interest (POI) queries

A point of interest (POI) is a location that people find interesting or useful. POIs can be locally or
internationally known. These guidelines use a very broad definition of POI in which businesses are
also considered POIs.

Query Explanation
[London Bridge] This is a query for a famous POI in London.
[Danube River] This is a query for a river in Europe.
[Charing Cross
This is a query for a transit station in London.
Station]
[Union Square, SF] This is a query for a location in San Francisco.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

19
Business queries m
4 � fro ez
2 rt�n
Business queries contain the7name , �20 aof a specific business.
y �1 ar�M Sa
r
ua �Osc t
e b r
�b y e I P�1 urda
Query y,� 4.9 riq
F u Explanation72 y,�F
da 2 5
r 16. Ma n .16 eb
t u .2 rua
Sa 172. This is a business query with a location modifier54(Palo . 9 �by Alto).
ry�
17 The user is
P � M
[Zola Palo
I alto] looking for a specific restaurant (Zola) in Palo Alto,aCA. nri �Queries
Os ,�20 can include
24
qu caspecific.
location modifiers, like city names, that make them more e r�Ma �from
rt�n
This is a business query with a request for a specific store in Sunnyvale, ez CA.
[Bookasaurus] The viewport and user location can help pinpoint the desired location for
such a query.
[Starbucks, 7 This is a query for a chain business followed by a specific address. Chain
Boulevard businesses are businesses that have more than one location, and include
Poissonnière, everything from national chains, like Starbucks, down to small local chains,
75002 Paris, like Burrito Boyz. Target, Auchan, Albert Heijn, and Boots are all chain
France] businesses.
This is a business query with a request for the chain business Target and
[Target sunnyvale]
location modifier of Sunnyvale, CA.

Category queries

A category refers to a group of entities that share a set of characteristics.

Query Explanation
This query is for locations where fast food is served. Assume the user
[fast fod] wanted the correct version of the query when the query contains a simple
misspelling.
[bus stop] This query requests the locations of bus stops.
[coffee shops] This query requests the locations of businesses that sell coffee.
[gym] This query requests the locations of fitness centers.
[gas San This query requests the locations of gas stations with a location modifier
Francisco] of San Francisco.

m
Sa
Product
t u and Service Queries 2 4 �fro ez
IP� rda
17 y 7 , � 20 art�n
2.1 ,�Fe y�1 car�M
A product 6.2or service
bru query is a query about something that can be purchased at or uisaroffered by a
54 a r b r y�Os
business or POI. .9 y e �b e
Ma �by�O �17,�2 ay,�F 54.9 nriqu
nri sc 024 r d .2 Ma
qu ar�M �fr
e o S atu 72.16
art m 1
�ne IP�
z

20
 Query m Explanation
4 � fro ez
2 rt�n
This 7query
, �20 arequests the locations of businesses that sell a specific type of
[vanilla latte] �1 ar�M
ucoffee
ar Oscdrink.
y Sa
t
F e b r
�b y � e I P�1 urda
[deep-tissue y,� [Link] 9 riquery u 72 ythat
requests the locations of businesses
r da . 2 an
q .16 ,�Feb offer a unique style of
massage t ]
u 6 massage.
M .25 rua
Sa 172.1 4.9 ry�
�by 17,
I P � M
This query requests the locations of businesses that �O �20 pens,
an sell
[school supplies] riq spencil,
ca 24
notebooks, and everything else students need for school. u e r�Ma �from
rt�n
e
This query requests the locations of businesses that offer truck tirezrepair
[truck tire repair]
services.
This query requests the locations of businesses where ATV tours are
[ATV tours]
available.
Not every hair salon offers perms, but this query requests the locations of
[perms]
ones that do.
[deep dish pizza This query requests the locations of places that sell a specific type of pizza
detroit] in a particular city.

Coordinate and “My location” queries

Some queries are simply a set of coordinates or the words ”my location” (or something similar).

Query Explanation
[36.082857,
The user has specified a location using lat/long coordinates.
-115.172916]
[my location] The user has typed these (or similar) words to find out where they are.

Emoji Queries

Some queries are not made using words. Emojis represent the category they picture. Use the most
literal meaning.

Query Explanation
m
�fro ez
!
Sa
t u The fuel pump represents a search for places to get gas. 2 4
IP� rda
17 y 7 , � 20 art�n
2.1 ,�Fe 1 �M
6.2 bru ary� scar
u
54 ebr 9�by�O ue
" .9� ary�1
b
Ma y�O ,�2 7
nri sc 024
The
qu ar�M �fr
pizza slice stands for the query “pizza.”
tu r d
, � F
ay .254. anriq
6 M
e art om Sa 172.1
�
# �n
Theecoffee
z cup represents the query “coffee.”
IP

21
 m
4 � fro ez
Queries with no maps intent,�202 art�n
17 �M
a ry� scar Sa
tur
Some queries have no maps u intent. They includes, but are not limited to,
Fe b r
�b y � O
e I P�1queries
da that:
a , �
y 54 nr . 9 i q u 7 2.1 y,�Fe
d 2 6.2 bru
• tur to6.a physical
Do notarefer Ma location
S 172.1 54
.9� ary�1intent
• Do referP�to a physical location but have an information intent rather thanMa location by� 7,�
I a n Os 20
• Refer to a brand or company with a predominantly online intent, like Grouponriqor LinkedIn c 2
ue ar�M 4�fro
• Ask about the time or weather in a specific location art m
�ne
z
Rate all results for these queries Bad.

Query Explanation
[eureka
This is a weather query with no maps intent. Rate all results Bad.
temperature]

[time in new york

This is a “time in” query with no maps intent. Rate all results Bad.
city]
This is a query about a company that is mainly used online. It does not have maps
[facebook]
location intent. Rate all results Bad.
[is cucumber a fruit This is an information-seeking query that has nothing to do with finding a location.
or a vegetable] Rate all results Bad.

2.1.1. Research Expectation

Research will help you understand the user’s query and intent:

• Use a search engine to investigate and understand the query intent

• Use official resources like businesses’ official websites, national postal service websites, and
government websites whenever possible
• Use your own local knowledge
• Use the information provided in the rating interface

2.2. Result Types

A query can return one of three types of results.

Result Type Explanation Example m

Sa
t u 2 4 �fro ez
n
IP� rda
17 Businesses and POI type results , �20 art�
2.1 y,�Fe 1 7 �M
6.2 bru will show a name in the top field, ary� scar
u
54
.9� aryfollowed by an address and a ebr 9�by�O ue
Business/POIMa by�O �17,�2 , � F
ay .254. anriq
nri sclassification.
0 The same rating r d
qu car�M 24�fr tu
Sa 172.1
6 M
e rules awill apply
om to both Business �
rt�n IP
and POI results.
ez

22
 Result Type Explanation m Example
4 � fro ez
2 rt�n
These results 7 , �20can a be one of
�1 ar�M
multiple ar address
y
sc types, including Sa
e bru �by�O address
residential e or locality. IP� turda
,�F 4.9 riqu 17
y 2.1 y,�Fe
d Instead
a 5
6.2 Ma
nof a business or POI name, 6.2 bru
tur
Sa 172.1this kind of result will show the first 54
.9� ary�1
IP� line of the address in the top field, Ma by�O 7,�2
nri sc 024
followed by the entire address qu ar�M �fr
e art om
below. This type of result will not �ne
Address z
include a classification.

Note: If a result does not include a

classification, don’t assume the
result type is an address. You must
still do research to verify this, as
not all POIs will have a
classification.
The results for POIs or features
without an expected address, like
bus stops, bridges, or mountains,
may sometimes look like address
type results. Check to see if the
result includes a classification. If it
does, the result refers to a feature
or POI, not an address.

Features At first glance, the result on the

without an right might look like it’s for an
expected intersection. However, since it
address includes a classification, you can
see that it actually refers to a POI
— in this case, a bus stop.
This result for a landmark square
might be mistaken for a result
referring to a street with the same
name. Since it contains a
classification, in this case “Park,”
you can see that it actually refers to
a POI.
m
Sa
t u 2 4 �fro ez
IP� rda
17 y 7 , � 20 art�n
2.1 ,�Fe 1 �M
2.3. Location
6.2 brIntent ary� scar
u u
54
.9� ary�1 � F ebr 9�by�O ue
b
Ma y�O ,�2 7 , . riq
A result is considered
nri sc most day 6.254 results.
02 relevant when it is located in the user’s area ofuexpected n There
q ar� 4�f r
t 2.1 Ma
are two types of Location
u e Ma Intent:
ro a
S 17
rt�n m IP�
ez
• Explicit: The query is made clearly and indicates a specific location or area where results are
expected.
23
 • Implicit: The location expectation m is not as clear, so you must use context clues, in the form
ro
of user location and viewport, � toediscover
f z the area in which the user is expecting results.
, �2 024 art�n
17 �M
2.3.1. Explicit Locationuary� scar Sa
t
Fe b r
�b y � O
e I P�1 urda
y,� 54.9location
When there is andaexplicit u mentioned in the query, you can ignore 72 y,�F
2
r 16. Ma n riq .16 the ebruser and viewport
locations. The user has told you exactly where they want to find results. .If the
4.9 uquery
ary contains words
t u 25
Sa 172. � �17
like “near me”IP or “nearest,” the user’s location, not the viewport location,Mshould
�
an y�Osbe ,considered
b �2 the
explicit location intent. riq car 024�
ue �M fro
art m
�ne
z
Query Expected results Notes
Places to buy this drink
[bubble tea tully road san User and viewport locations should be
on Tully Road in San
jose] ignored.
Jose.
Museums in the city of User and viewport locations should be
[Boston museums]
Boston ignored.
The queried chain
User and viewport locations should be
[kfc Philadelphia] business within the
ignored.
stated locality.
Relevant POIs near the Viewport location should be ignored,
[food near me]
user’s location even if fresh.
[nearby/nearest Relevant POIs near the Viewport location should be ignored,
starbucks] user’s location even if fresh.
Result placed on the Viewport location should be ignored,
[my location]
user’s location even if fresh.

2.3.2. Implicit Location

If the user’s location intent is not expressly stated in the query, for example [chinese] or [479
margarita ave], use the user location, viewport location, and viewport age to determine the area of
expected results.
Viewport User Location Location Intent
When the user is within a fresh viewport, take the user
location as location intent. Results are generally expected in
Inside Viewport
or near the viewport, and results inside the area cannot be
rated Bad because of distance alone.
Sa rom
IP� turda Results are expected in or near the viewport area. All0relevant 2 4�f �nez
2 rt
17
Fresh 2.1 y,�Fe Outside results inside the viewport are eligible for a rating�17of,� r�Ma
6.2 bru Viewport y ca
arthe
Excellent. If no results can be found in or near u sviewport,
54
.9� ary�1 e b �by�O e
r
Ma by�O 7,�2 consider the user location a secondaryylocation� F 9 intent.
u
nri sc 024 r d a , .254. anriq
qu ar�M �fr tu 6 M
e art om Sa 172.1
�
Missing�ne When the user is missing, the viewport
IP is the location intent.
z

24
 Viewport User Locationrom Location Intent
4 � f ez
2 n
Inside Viewport 7 , �20 art�
1 �M When the viewport is stale,Sconsider only the user location as
a ry� scar a
Outside
e
u
br �by�O e location intent. IP� turda
F .9 iqu 17
Stale a y,�Viewport
5 4 nr 2.1 y,�Fe
d 2
6. Ma 6.2 bru
tur
Sa 172.1 54
.9� awhen
Use the stale viewport as location intent ry�
17 the user
P � Missing M b y
I location is missing. an �Os ,�202
riq car
ue �M 4�fro
Viewport Age Present or art m
Consider the viewport fresh when the viewport age �neis missing.
Missing Missing z

The user location sets the location intent when the viewport is
Present
not present.
Missing entirely When the user location and viewport are missing, the test
Missing locale becomes the location intent with a strong focus on
prominent results.

[Link] the Query-Level Navigational Result Question

Once you have identified user intent, you will need to answer a query-level question. You must decide
whether the intent is unique and clear enough that there is only a single (navigational) result in the
real world that could fully satisfy it.

You will answer this question before you rate any results, since you don’t need to know what the
results are in order to learn if there’s a real-world result that could fully satisfy the user’s intent:

• If there is a real-world navigational result for the query, answer Yes

• If there are no possible real-world navigational results for the query, answer No

You will answer this question once for each query, whether or not any results are shown.

4. Rating Result-Level Issues

For each result, you must check to see whether:

• There is an issue with the language/script of the result name/title

• The business/POI is closed or does not exist
m
[Link]
Sa
t u Name/Title in Unexpected Language or Script
2 4 �fro ez
IP� rda
17 y 7 , � 20 art�n
A result ,�F
2.1name 1 �M
6.2 ebor r u
title is in an expected language or script when it is:
u ary� scar
54
.9� ary�1 � F ebr 9�by�O ue
b ,
• In the Malanguage/script
y 7
nri �Osc �2024
, of the test locale
r d ay .254. anriq
• In the language/script
qu ar�M �fr of the query tu 6 M
e a om Sa 172.1
• In a language/script rt�nof the result region IP �
e
• Any combination of any of the languages or scripts described above
z

25
 • An official company, chain, or m brand name commonly used in the market, even if this is not
ro
any of the languages or scripts � described
f ez above
, �2 024 art�n
17 ar�M Resort (in red box), address details are
Below Left: Result name is Atlantis a ry� Casino
sc Sa below (in blue box).
turbox as the Address title. All the
r
Below Right: Result is an address,
u �Oso the first line of the address appears in the
e b y e I P�1red d
address details appear y F
,�below4 . �b
9it inrthe
i q u blue box. 72 ay,�F
a
d 6.25 an . 16 ebr
tur M .25
4.9 uary�
Sa 172.1
IP � Ma �by�O 17,�2
nri sc 024
qu ar�M �fr
e art om
�ne
z

When all or part of a result name or title is in an unexpected language or script, users will not
understand it. In these cases, select the Result name/title is in unexpected language or script
checkbox. No further rating will be required.

Note: When the address details, found below the name/title, are in an unexpected language or script,
the result can still be understood and rated for relevance and name accuracy. For more on what to do
when the address details (not the name or title) are in an unexpected language or script, see
Language/Script Issue in Address.

Minor Differences in Spelling

Don’t consider minor spelling issues, such as missing or added diacritics (e instead of é), as
Unexpected Language/Script. This also applies to unnecessary or less relevant parts of a name or
title. Use this checkbox only to report issues that interfere with understanding the name/title and
issues listed in your Country Specific guidelines.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

26
4.1.1. Name of Business/POI Results m
4 � fro ez
Pay special attention to the language 2 n
7 , �20 art�and script of brand and chain names. See your Country
Specific guidelines for more 1 ar�M
a ry� information.
sc Sa
t
u
Fe b r
�b y � O
e I P�1 urda
y,� 54.9 nriq u 72 y,�F
Expected Language da 2 Explanation .16 eExample
t u r 16. Ma .25 brua
Sa 172. 4.9 ry�
�b 17
I P � Expected language/script:
M an y�Os ,�202
• Test locale: en_USriq car
The query gives clues as to the ue �M 4�fro
• Result in California, USAart� m
language in which the user nez
• Query: [mystery]
expects results. Any result that
• Result name: Mystery Spot
matches the most specific part
of the query or corrects a
Result name is in English and satisfies
spelling issue in the query is
the query.
considered to be a result in an
Query expected language. This also
Unexpected language/script:
includes remote results in
• Test locale: en_US
foreign countries.
• Result in California, USA
• Query: [market]
But: Consider official result
name variations and default to • Result name: ေစျးကွက်
the test locale for very short
queries. The result name is “Market” in Burmese
script.
The language of the test locale Expected language/script:
is generally considered an • Test locale: es_ES
expected language and script. • Result in California, USA
• Query: [college]
If the query is so short that the • Result name: Colegio Skyline
language cannot be identified,
assume that the query language The result name is in Spanish, which
is that of the test locale. matches the language of the test locale,
so this result title is expected and
Test Locale
When the test locale and the acceptable.
and
query locale differ, consider the
Query Locale
query locale an expected Unexpected language/script:
language, as it provides more • Test locale: en_US
detailed information. • Result in California, USA
In the example below, the Query • Query: [college]
Locale is set to English in • Result name: Colegio Skyline
m
Sa
t u Indonesia. Therefore English is
2 4 �fro ez
IP� rda an expected language: “Colegio” is in Spanish, but the , � 0 art�n
2test
17 y 7
2.1 ,�Fe • Query Locale: en_ID locale is in English, so thearresult y�1 catitler�M is in
6.2 bru u s
54
.9� ary�1 • Test Locale: id_ID an unexpected language.
� F ebr 9�by�O ue
b ,
Ma y�O ,�2 7
nri sc 024 r d ay .254. anriq
qu ar�M �fr tu 6 M
e art om Sa 172.1
IP �
�ne
z

27
Expected Language Explanation
m Example
4 � fro ez
2 n
7 , �20 art� Expected language/script:
1 �M
a ry� scar • TestSalocale: en_US
t
u
ebr 9�by�O ue I P�1 urin
• Result d Rio de Janeiro, BR
, � F . iq 72 ay,�F
u r day 6.254 anr • Query: .1[beach]
6.2 ebru
t M
Sa 172.1 • Result name: 54 Praia
.9� ary�1de Copacabana
� Mathe by� 7,�
IP Result satisfies nri category
Os 20 “beach” and
the result’s name isquin car 2script
e Latin
�M 4�fro and the
m
artis the
Portuguese language, which �ne
language of Brazil. z
The language/script of the
Result region result’s region is expected as
Unexpected language/script:
the result language. • Test locale: en_US
• Result in Rio, BR
• Query: [beach]
• Result name: Playa de Copacabana
Though the result name is in the same
script as the test locale and query
language, returning the name in Spanish
is unexpected language because the
language of Brazil is Portuguese.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

28
Expected Language Explanation
m Example
4 � fro ez
2 n
7 , �20 art� Expected language/script:
1 �M
a ry� scar • TestSalocale: ar_SA
t
u
ebr 9�by�O ue I P�1 urin
• Result d Riyadh, SA
, � F . iq 7 ay,�F
r day 6.254 anr • Query:2.1[‫]ماكدونالدز‬
6.2 ebru
t u M
Sa 172.1 • Result name: 54 ary
.9McDonald's
IP � Ma y�O �17,�2
� b
nri sc 024
qu ar�M is�fin
The name of this restaurant the
Any official brand, chain , or
e art rom
language of the official brand �name.
nez
business name in the language
of the result’s region or the Expected language/script:
official brand name commonly • Test locale: ar_SA
used in the market, even if it is • Result in Riyadh, SA
not in the language of the • Query: [‫]ماكدونالدز‬
query, test locale, or result • Result name: [‫]ماكدونالدز‬
Brand, chain, and
region, is expected.
business names
The name of this restaurant is in the
In bilingual areas, official
language of the region
names in any of the languages
of the area are expected,
Unexpected language/script:
unless otherwise specified in
• Test locale: ar_SA
the Country Specific
• Result in Riyadh, SA
Guidelines.
• Query: [‫]ماكدونالدز‬
• Result name: [マクドナルド]

The name of this restaurant is in

Japanese, which is not the language of
the query, the locale, the result region,
or the official brand name.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

29
4.1.2. Title of Address Results m
4 � fro ez
Unlike business/POI results, address 2 �n
7 , �20 artresults do not have an actual name. Instead, the first line of the
address appears as the title. �1 Rate M
r Result name/title is in unexpected
� Language or Script when
ary Osca
uaddress)
Sa
tur
the title (first line of the e b r y � is in an unexpected language or
I script.
P�1 da
a y ,�F 4.9�b rique 72 y,�F
.16 eb
d
r 16. Ma 2 5 n
Localized and t u Non-Localized Components .25 rua
Sa 172. 4.9 ry�
�b 17
� M
I P an y�Os ,�202
Address results often cannot be translated and are accepted in the original version riq caof
ue r�Mthe4�fresult
rom
location. Some features, however, are translated into the test locale’s language, especially a rt�nfor
bilingual or English-speaking areas. Although the preferred language is the test locale’s language, ez the
query language and language of the result’s location are also accepted.

Localized components may include:

• City
• State
• Country

Appropriate localization depends on the result itself and the language it is translated into. Research
and local knowledge will help you decide if the translation has been done appropriately.

Components that are not typically localized include:

• Feature type (square, bridge, roundabout, or intersection)

• Street names and street addresses including building names

Use the Address Accuracy Incorrect – Language/Script Issue checkbox if you find issues of this
nature in any of the address components in the address details (not the address title) of any result.

4.2. Business/POI is Closed or Does not Exist

Use this checkbox when, after careful research you determine that a result is:

• Closed/non-existent
• Randomly moving (like a food truck without a fixed schedule)
• A non-recurring past event with no further significance that does not carry any maps intent

Important: If you rate a result as Business/POI is closed or does not exist, you must still give a
relevance rating as if the place were open or did exist.

Remember, this rating can only be applied to business or POI results, not to address type [Link]
Sa r
IP� turda 0 2 4�f �nez
17 ,�2 Mart
2.1 y,�Fe 1 7 �
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
b ,
Ma y�O ,�2 7
nri sc 024 r d ay .254. anriq
qu ar�M �fr tu 6 M
e art om Sa 172.1
IP �
�ne
z

30
 Use this checkbox to indicate a POIrohas m closed only if there is evidence to prove the business
� f ez
indicated in the result is no longer 2 operational.
4 n
7 , �20 art�
When you can’t make a decision 1 �M
a ry� scar about business closure due to lack Sa of resources, assume the
t r Can’t Verify (unless there is
u
business could existeand br �brate
y � O the
e name, address, and pin accuracy
I P�1 uas d
an obvious datadaissue
F
y,� 54like u
.9 arimissing mandatory address component 72oraya,�pin
16 Febrin the ocean).
q .
u r 16.2 Man .25
t
Sa 172. 4.9 uary�
IP � Ma �by�O 17,�2
Note: Businesses and POIs can close for construction, remodeling, vacations, 0
nri or sother
qu car�M 2reasons.
4�f Treat
all temporarily closed businesses as if they were open when the closure is announced e art rom on the
�ne
business/POI webpage or managed social media page. There is no limit to how long the z closure
can be.

4.2.1. Closed/Does Not Exist vs. Inaccurate Name and Address

It is important to understand what the result really is before making your rating. If your research
reveals that the business has an incorrect name or address, use the drop-down rating options to
signal precisely what is wrong. Use the Business/POI is closed or does not exist checkbox only for
the specified purposes. See Unclear Results for more guidance and examples.

4.2.2. Rating Relevance of Closed/Non-Existing Business/POI

Special consideration is required when rating a closed/non-existing business/POI. Please review

section 4.3 carefully with regards to the status and permanently closed vs. open.

Never automatically demote to Bad simply because of closure. (You may find other reasons to
demote to Bad, but closure should not be the sole reason for the demotion.)

4.3. Business/POI Status is PERMANENT_CLOSURE

The following chapter offers a high-level introduction to rating closed/non-existing businesses/POIs

in relation to their status (displayed as part of the result information). It addresses Relevance and
Data rating. Please also review the more specific guidance in the associated relevance chapter.

Note: No matter what is displayed in the status section of the tool, you must always research the
business/POI to determine whether it is open or not.

This chart shows the possible combinations of status displayed in TryRating plus a result’s actual
state based on your research.

Real-World
Sa State Confirmed by rom
IP� turda TryRating Status Comments 24�f �nez
Research
17 ,�20 Mart
2.1 y,�Fe 1 7 �
6.2 bru
Open/Exists None Rate as usual ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ayusual 54. anriq
Closed/Does nrnot
iqu Exist
sca 024 None Rate
tu ras
d 6 . 2
M
e r�Ma �from Sa 172.1
rt�n IP �
ez

31
 Real-World State Confirmed by rom
Research 0 2 4�f �nTryRating
ez Status Comments
�2 ar t
y �17, ar�M Sa Rate relevance based on
r
ua �Osc t
Closed/Does not Exist e b r y e PERMANENT_CLOSUREI P�1 urdwhether result is expected/
y F
,� 4.9 riq �b u 72 ay,�F
a
d 6.25 an . 1unexpected.
6.2 ebru See 5.19.
tur M
Sa 172.1 54 a
.9� y�1r
IP� Rate
Ma relevance
by� 7,� based on
n Os 20
Open/Exists PERMANENT_CLOSURE whether riq result
c is2expected/
ue ar�M 4�fro
unexpected. Seear5.19. t�n m
ez
4.3.1. No Status Shown

When no result status shown or the status is blank, you must research to determine whether the
business/POI is open or closed/does not exist in the real world. Use the Business/POI is closed or
does not exist checkbox when needed.

Rate the result relevance as if the business/POI were open or did exist. Use your best judgement to
determine how well the result satisfies user intent within the area of expected results.

[Link] Shown as PERMANENT_CLOSURE

When the result status is PERMANENT_CLOSURE, follow the research steps to determine if the
business in fact is open in real world or not, and use the Business/POI is closed or does not exist
checkbox when needed.

The relevance rating for a result with PERMANENT_CLOSURE status depends on whether this result
is expected or unexpected based on the specific relevance guidance in 5.19. Rating Relevance when
Status is set to PERMANENT_CLOSURE and 10.8. Permanently Closed Results

5. Relevance
Relevance for each result is found by assessing the relationship between:

• Satisfying user intent

• Prominence
• Distance

Complete each step of this workflow before assigning your relevance rating.
m
Sa
General
t u Rating Rules 2 4 �fro ez
IP� rda
17 y 7 , � 20 art�n
2.1 ,�Fe 1 �M
• Rate bru result individually and demote based on relevance and distance. uary� scar
6.2 each
• Always
54 aryagainst the real world: If there is a better result available but iteis
.9�rate br not �O e
byshown,
b � 1 , � F . 9 � u
Ma the
demote y 7 ,�2
nri �Osexisting 02 result(s) considering the missing one(s). r d ay .254 anriq
c
qu ordera �f results and evaluate each one [Link] 72.16
4the M
• Ignore the e r�Mof art rom � 1
• Ignore duplicate results �ne and rate them individually. Do not demoteIPfor repetition.
z
• If there are results that are extremely inappropriate or illegal, rate Bad. Identify such content
by determining if the result is likely to be embarrassing if seen by users.
32
 m
4 � fro ez
2 n
7 , �20 art�
Rate the relevance of reach y�1 caresult
r�M without considering the accuracy Sa of the name/classification,
u a s address, or pin. t u
ebr 9�by�O ue IP� rda
When a , � F
judging
y 54 nr . distance/prominence,
i q ignore closed or17non-existent
2.1 y,�Fe results.
u r d 6 . 2 a 6.2 bru
t M
Sa 172.1 54
.9� ary�1
IP � Ma by�O 7,�2
nri sc 024
qu ar�M �fr
e art om
�ne
z

Adult Content

Businesses and POIs with legal adult content are rated:

• Navigational to Bad if the query clearly requests this type of content

• Bad if the query does not imply such an intent
m
Sa
t u 2 4 �fro ez
IP� rda
5.1. 1Query-Result
y Connection 7 , � 20 art�n
72
.16 ,�Feb 1
ry� scar
�M
.25 rua u a O
For a result to 4.9satisfy
�
ry� a query to any degree, there must be some kind of relationship
1 � F ebr 9between
� by� ue them.
b , .
Your first taskMa isyto 7
nri �Osunderstand
,�2
02 what this connection is. r d ay .254 anriq
c
qu ar�M 4�fr tu 6 M
e art om Sa 172.1
Satisfying the user intent is�nonly �
ez the first step in the rating process and covers
IP the minimum
requirements for a result to be considered relevant.

33
5.1.1. General Connection m
4 � fro ez
A result can satisfy user intent,�for
7 202 multiple
a rt�n reasons, but most often the result satisfies the most
specific part of the query’sryintent. 1 M
� ar This kind of relationship between
� Sa query and result is called a
ua �Osc t
General Connection.
Fe b r
�b y e I P�1 urda
y,� 54.9 nriq u 72 y,�F
da
r 16. Ma2 .16 eb
t u .25 rua
Sa 172. Type of 4.9 ry�
User Query � Result Description
M �b 17
I P Connection an y�Os ,�202
riq car
ue �M 4�fro
Satisfies Intent: Users are likely to arstart
t�n m their
San Francisco search with the name of the brand “Marriott”.ez
[marriot] Marriott Union General Result satisfies user intent by providing a
Square Marriott close to a user/viewport located in the
San Francisco area.
Satisfies Intent: The user is looking for an
[Houston George Bush
General airport in the city of Houston. This is an airport
airport] Intercontinental
in Houston, which satisfies user intent.
Satisfies Intent: The query contains two
[london, different cities, so it’s likely a routing query.
London General
brighton] Returning either of the individual results is
expected and should be rated Excellent.

5.1.2. Abbreviation/Alternate Name Connection

The query is an abbreviation or alternate name and the result provides the full and currently accurate
name.

Type of
User Query Result Description
Connection
Newark Liberty
Satisfies Intent: The international airport code
[ewr] International Abbreviation
for Newark Liberty International Airport is EWR.
Airport
Alternate Satisfies Intent: The result is the correct name
[sears tower] Willis Tower
Name of what was formerly known as the Sears Tower.

5.1.3. Category Connection

The query is a category and the result satisfies that specific category, which may or may not be
displayed
Sa within the information provided in the result. m
�fro ez
t u 2 4
IP� rda
17 y 7 , � 20 art�n
2.1 ,�Fe 1 �M
6.2 bru Type of ary� scar
User Query 54 Result Descriptionbr y�O u
.9� ary�1 Connection �Fe 4.9�b ique
b
Ma y�O ,�2 7 y ,
nri sc 024 5 anr
rda 16.2search
qu ar�M �fr Satisfies Intent: A category
t u M for "food"
e o Sa 172.
[food] La Ciccia
a rt�n m Category in a viewport over SanIP Francisco returns an
�
ez Italian restaurant there.

34
5.1.4. Spell Correction Connection m
2 4 �fro ez
The query is misspelled and the , �20resulta rt�ncorrects that issue. This kind of connection only applies to
7
1 ar�M
obvious issues when no result ry� scfor the actual query exists at the user’s Sa location or when the user intent
u a t
is clearly satisfied by ethe
F
br spell-corrected
�b y � O
e results. I P�1 urda
y,� 54.9 nriq u 72 y,�F
da
r 16. Ma2 .16 eb
This kind ofScorrection also happens when a query address does not .25 butruthe
exist 4.9 ary� result address
t u
a 72.
does, correcting 1 Ma �by�O 17,�2
IP the issue and creating a match.
�
nri sc 024
qu ar�M �fr
e art om
Type of �ne
User Query Result Description z
Connection
Spell Satisfies Intent: The result corrects the user's
[aple store] apple store
Correction spelling mistake.
Satisfies Intent: This query suggestion for the
Spell
Lodz Łódź Polish market adds the diacritics the user may
Correction
have missed when typing the query.
Satisfies Intent: When there is no "Clair St"
[23 Clair 23 Clair Spell within or around the viewport/user, consider a
street] Boulevard Correction “Clair Boulevard" that is close to the viewport/
user as the most likely intent.

5.1.5. Transit Intent Connection

The result satisfies the transit intent of the query. If the query indicates a specific transit system, the
result must match that system. There is also a transit intent connection when a station provides
access to more than one transit service and the queried one is included.

Type of
User Query Result Description
Connection
Satisfies Intent: Result satisfies user intent by
Richmond BART Transit providing a close station that runs the requested
[bart]
Station Intent transit service for a user/viewport located in the
Richmond area.

5.1.6. Special Character Connection

Always consider the specific language conventions. In general, user intent is satisfied when:
m
Sa
t u 2 4 �fro ez
IP•� rThe
17 day,�query contains a special character and the result is a valid variation (if applicable).
n
7 , �20 art�
• 2The .16 query �M
bru does not include a special character but the result with special characters ry� scaradds
Fe 1
. 2 u a
value 54to the
.9� ary�user and is therefore considered spell corrected. ebr 9�by�O ue
• TheMcountry 1 � F
an y�Os or,�language does not have the special character and it is agenerally
y 54. nperceived as
b 7 , riq
20 r d . 2 a
a form ofiqexpression
r c a 2 4 or style (like “café” in English). t u 1 6 M
ue r�M �fro
art m Sa 172.
�ne IP�
z

35
 m Type of
User Query Result � fro ez Description
0 2 4
tConnection
�n
�2 ar
�17, ar�M
r y
ua �Osc Satisfies Intent:
Sa "oe" is a valid variation for the
r Special I t
P�1 ur"ö"
[möllersdorf] Moellersdorf
e b y e special character d in the country/language of
y F
,� 4.9 riq �b u Characters 72 ay,�F
a
d 6.25 an the result (Germany/German).
. 16 ebr
tur M .25
4.9 uary�
Sa 172.1
IP � Ma �by�O 17,�2
5.1.7. Address-Result Connection nri sc 024
qu ar�M �fr
e art om
When a query address and a result address are not exactly the same, the kind of connection �ne they
z
have depends on their relationship:
• Street number is the same in both query and result but the unit number is different or missing:
• If neither address is a street extension, rate result relevance Good when:
▪ The query contains a unit number and the result does not.
▪ The result contains a unit number and the query does not.
▪ The query contains one unit number and the result contains another.
• The query is full address including street number and name and the result is the street name
only:
• Since this result is an unlikely secondary intent, rate relevance as Acceptable.
• Query is for a street [Main Street, Pleasanton, CA] result is just the locality (Pleasanton, CA).
• Rate the result relevance Bad as it does not satisfy the user intent.

Type of
User Query Result Description
Connection

357 Western Satisfies Intent: The result does not include

[357 western
Ave Address the unit number requested in the query so its
ave suite 1]
St. Johnsbury, VT relevance is rated Good.

Satisfies Intent: The result has the same

357 Western
[357 western street number but a different unit number from
Ave Suite 2 Address
ave suite 1] the address in the query, so its relevance is
St. Johnsbury, VT
rated Good.
Satisfies Intent: Instead of returning the full
address requested, the result provides only the
[357 western Western Ave
Address street name. This is an unlikely secondary
ave suite 1] St. Johnsbury, VT
intent, so relevance is demoted to an initial
rating of Acceptable.
Does not satisfy user intent: Instead of
[357 western m
Saave st. St. Johnsbury, returning the full address requested, the result �fro ez
t u Address 2 4
IP� rda VT provides only the locality. This does not 20satisfyrt�n
johnsbury]
17 y
2.1 ,�Fe 7 , �
1 ar�M
a
6.2 bru the user intent, so relevance is rated ry� Bad.
a c
54 a r e b r y�Os
u
.9 y �b e
M �by�O �17,�2 y,�F 54.9 nriqu
5.1.8. Lack aof Connection
nri sc 024 r d a .2 Ma
qu ar�M �fr
e o S atu 72.16
art the 1
m user intent either because there is no relationship
If the result does not satisfy �ne IP� between the query
z
intent and the result or because the connection between the query intent and result will not be
immediately obvious to the user, rate the result relevance Bad.
36
 m
� fro ez
2 4 n Type of
, �20 art�
User Query Result
1 7 �M Connecti Description
a ry� scar Sa
u
br �by�O e on t u
IP� rda
Fe u 17 y,�F
,� .9 riq 2.1 user
u r day 6.254 Santa
an Cruz Does not satisfy 6.2 ebintent:
rua Research
t MBoardwalk
Sa 172.1
[airport] None shows that there is no 54 connection
r
.9� y�1 between the
P � M by� 7,�
I Santa Cruz query and the result. Rate
an Bad.O 2
riq scar 024�
ue �M fro
Does not satisfy user intent: Result art is m for
[Raging Waters �ne
2333 South the correct address, but does not include z the
2333 South
White Rd None business named in the query, so users will
White Rd
San Jose have no way of knowing if this is truly
San Jose]
connected to the business or not. Rate Bad.
Does not satisfy user intent: Query is the
name of a business and result is for the
2333 South correct address, but does not include the
[Raging Waters] White Rd None business name. Users will have no way of
San Jose knowing whether or not this address is
connected to the business they asked for.
Rate Bad.
Does not satisfy user intent: Result is for a
Macy’s
store, not a mall. This store is inside the
2801 Stevens
[valley fair mall] None requested mall, but does not satisfy the intent
Creek Blvd,
of the query, which is the whole mall.
Santa Clara
Rate Bad.
Westfield Does not satisfy user intent: Result is for a
Valley Fair mall, not a store. This mall contains the
[macy’s] 2855 Stevens None requested store, but this result is the whole
Creek Blvd, mall, not the single store the user asked for.
Santa Clara Rate Bad.
Does not satisfy user intent: Result is for a
Costco
Costco gas station, not a Costco store. The
Gasoline
store and the station are at the same address
[costco] 1601 Coleman None
and share a brand name, but the result is not
Ave, Santa
what the user asked for and does not satisfy
Clara
the query intent. Rate Bad.
Does not satisfy user intent: Result is for a
Sa Costco Costco store, not a Costco gas station. Therom
f
tur
IP�[costco 1601 store and the station are at the same address 0 24� rt�nez
17 day,� gas] Coleman Ave,
None
and share a brand name, but the result
� 2
, Mnot a
2.1 Fe
r y �17 aris �
6.2 bru Santa Clara what the user asked for and does c
a Os satisfy
54
.9� ary�1 e bru �bynot � e
Ma by�O 7,�2 the query intent. Rate Bad. , � F . 9 u
nri sc 024 r d ay .254 anriq
qu ar�M �fr tu 6 M
e art om Sa 172.1
IP �
�ne
z

37
5.2. Satisfying User Intent m
4 � fro ez
2 t�n
The user’s intent can be determined 7 , �20 arby considering the query, the user’s location/viewport, and your
local knowledge. Sometimes y �1 queries
a r �M are ambiguous or can have multiple Sa interpretations.
r
b r ua �Osc I tur
e 9�by ue P�1 da
In order to determine a y ,�F a 4query’s
. r i q primary and secondary intent, look
72 y,�F
at the
.16 relationship between the
d
r 16. Ma 2 5 n ebr
t u . 2 u
query and theSa result. . Ask yourself: 5 4.9 ry�a
� 172 M �b 17
I P an y�Os ,�202
• Is there a logical relationship between the query and the result? riq car
ue �M 4�fro
• How likely is the user to be looking for this result given the query and the location m
artintent?
�ne
z
Intent Type Definition Highest Initial Rating
Primary Intent Result satisfies the most obvious and likely user Navigational or
intent Excellent
Secondary Intent A result which is less likely to be the user’s intent. Good (User Intent)
Results matching secondary intent are often not as
prominent as the originally queried entity but still
satisfy the intent of the query.
Unlikely Intent A result which matches the query but is very Acceptable (User Intent)
unlikely to be the user’s intent.
Non-Relevant There are issues that make the result useless for the Bad (User Intent)
Intent user.

For any Relevance Rating of Good or below, you must select the appropriate check box(es) to
indicate the reason(s)for demotion: User Intent and/or Distance/Prominence. If both reasons apply,
use both checkboxes.

When determining intent, keep in mind:

• It is rare that a navigational query will have multiple primary intents.

• Rating one result Navigational and one Excellent within the same set of results is also rare,
but possible (see examples in Navigational Results for Category Queries).
• A navigational query will most often produce one result that satisfies the distinct intent and
multiple other results that satisfy a secondary intent or do not satisfy the intent at all. This
means there will be one result rated Navigational and all other results will be rated Good or
Acceptable for secondary intent or Bad for not satisfying user intent.
• Most non-navigational queries will produce results that are rated from Excellent to Bad. m
S•a Since the queries were made by actual users, there will be cases where a query is gibberish
t u 2 4 �fro eor z
IP� rhas d 0 t �n
17 a no maps intent. Do your best to understand it and see how well the results fit the
, � 2 user’sa r
2.1 y,�Fe �17 ar�M
intent,
6.2 bbut don't be shy about assigning a Bad rating if a result doesn’t fit. a r y c
54 ruar e bru �by�O e
s
.9� y�1 � F 9 u
Ma by�O 7,�2 ay, .254. anriq
Satisfying the nriuserscaintent
02 is only the first step in the rating process and covers r d
tu 2.16 the minimum
qu r�M 4�fro Sa 17by
M
requirements for ea resultartto be
m considered relevant. The rating determined � deciding how well
intent is met is called the �Initial nez Rating. Distance and prominence will be IP considered next in order
to establish the final rating.

38
 m
5.3. Prominence 4 � fro ez
2 n
7 , �20 art�
1 ar�Mby establishing that there is a relationship
Once you’ve made an initial a ry� rating
sc Sa
tur
between the query and
r u O
the result and determining e b ythe intent type, consider the result’s prominence.
� I P�1 da
a y ,�F 4.9�b rique 72 y,�F
.16 eb
d
r 16. Ma 2 5 n
t u .2 rua
The prominence
Sa 17of 2. a feature refers to its popularity, including the number5of 4.9people
ry� visiting and media
�
sources referencing it. Prominence can vary based on the test locale and even 17
�bylocal
I P M an �Os ,knowledge.
�20
24 the most
Consider the following list to get a general idea how to establish prominence,riordered qu car�Mfrom �fro
e
prominent to the least prominent: a rt�n m
ez
• The feature is known internationally
• The feature is known in the country
• The feature is known in the region
• The feature is known locally
• The feature may not even be known locally

A result that may not directly appear to be user intent can be promoted for being internationally
prominent.

Query Result Rating and Explanation

Relevance Navigational
Sydney, Australia The city of Sydney is clearly the user's primary
intent.
Relevance Good (User Intent)
Sydney Opera House The Opera House does not satisfy primary intent.
Sydney, NSW, Australia However, it is promoted to secondary intent due
[Sydney]
to its international prominence.
Relevance Bad (User Intent)
Sydney Town Hall
483 George St, The Sydney Town Hall does not satisfy primary
Sydney, NSW, 2000 intent. While the civic center is historically
Australia important, it is not internationally prominent and
will not be promoted to secondary intent.
Relevance Bad (User Intent)
Sydney Buses Depot The depot matches the query string but is
Randwick unlikely to be the user’s intent and has very low
34-36 King St, Randwick prominence given how many other internationally
m
Sa NSW 2031, Australia prominent POIs Sydney has to offer. �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 Relevance Navigational
� F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu aAgra tu M
e r�Ma �from Sa 172.1
UttarrtPradesh,
�ne India Query is for a small locality
IP � in India and the result
z satisfies the user intent.

39
 Query Result m Rating and Explanation
4 � fro ez
2 n
7 , �20 art� Relevance Good (User Intent)
1 �M
a ry� scar Sa
[Agra] u IP� turda
Febr 9�by�O ue 17
, � . iq 2.1 y,�Fe site in the queried
r day 6.254 anr Result is for a prominent
6.2 bru
Sa 172.1 Taj Mahal
t u M locality. The Taj Mahal54does
.9� arnot y�1 satisfy the user’s
� Agra, Uttar Pradesh, India primary intent. However,M b 7,
IP an it is
y �Opromoted
sca �2024 to
secondary intent due to the r i qu international
e r�Ma �from
prominence of the feature in the queried rt�n locality.
ez

Relevance Navigational
Japan The country of Japan is clearly the user’s
primary intent.
[japan]
Relevance Bad (User Intent)
(User is in
Seattle) Sarku Japan
401 NE Northgate Way A chain restaurant with “Japan” in its name does
Seattle, WA 98125 not satisfy the query’s primary intent (the
country of Japan) or any secondary intent
(entities with international prominence).

[Link]

Generally, the farther away the result is from the area of expected results, the less desirable it
becomes. This is especially true for queries highly driven by distance to the user/viewport, such as
chain businesses, hospitals, pharmacies, or grocery stores.

Because the user can be offered many possible results that are all very similar, the closest entities
providing the expected service can be considered the best options. Results which are farther away
are less relevant and should be demoted according to their additional distance. Defining what is close
and what is far depends on the context of each individual query. Factors affecting distance include:

• Number of possible results in the real world

• Distribution of all possible results
• Population density (rural, urban, or suburban)
m
Sa
Distance
t u refers to the direct distance from one point to another and is measured via a straight 2 4 �fro ez
line.
IP� rda 0 art�n
2other,
There
17 is no y
2.1 ,�Feneed to account for the actual distance required to travel from one point to the7 , � such
y �1 ar�M
as driving.2distance.
6 b
54 ruar a r s c
.9� y�1 e bru �by�O e
Ma by�O 7,�2 � F 9 u
nri sc 024 r d ay, .254. anriq
qu ar�M �fr tu 6 M
e art om Sa 172.1
IP �
�ne
z

40
 Viewport m Location Intent (see section 2.3.2)
4 � fro ez
2 n
7 , �20 art�
1 �M
a ry� scar Sa
t
u
Fe b r
�b y � O
e I P�1 urda
y,� 54.9 nriq u 72 y,�F
da
r 16. Ma2 .16 eb
t u .25 rua
Sa 172. When the user is within a fresh viewport, the 4user’s
.9� ry�location
17 should be
� M b
P used as the location intent. All ratings made should an y�Osbe,�based
riq car 24� on the
I 20
user’s location. Results inside the fresh viewport umay e be �M demoted
f
art rom
based on distance to the user but they cannot be demoted�nby ez 3 (to
Bad) for distance alone.

Note: Consider the viewport fresh when the viewport age is missing.

Fresh Viewport, User Inside

When the user is outside the fresh viewport, the fresh viewport should
be used as the location intent. All ratings should be based on the
fresh viewport’s location and any results within the fresh viewport
receive No demotion for distance.

Note: If no results can be found in or near the viewport, use the user
location as a secondary location intent.

Fresh Viewport, User outside

When the viewport is stale, the user’s position is considered the

location intent whether the user is inside or outside of the viewport.m
Sa
t u 2 4 �fro ez
IP� rda
17 y Note: If the user is missing, use the stale viewport as location , � 20intent.
a rt�n
2.1 ,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
b ,
Ma y�O ,�2 7
nri sc 024 r d ay .254. anriq
qu ar�M �fr tu 6 M
e art om Sa 172.1
IP �
�ne
Stale Viewport z

41
 Do not demote a result for distancerowhen: m
• This is the closest possible � f ez even if it is far away from the area of expected results.
, �2 02 aresult,
4
rt�n
• Other, closer results�1are 7 found�M to be closed or non-existent.
a ry scar Sa
t
u
e b r
b y � O
e I P�1 urda
Demote a result for y,� distance
F
4.9 nriqwhen:
� u 72 y,�F
d
• Other tresultsa
r 16. that5 asatisfy the query and provide the same or similar .16 eb
u 2 .25 service
r are closer.
Sa 172.
M 4.9 uary�
IP� Ma �by�O 17,�2
nri sc 024
qu ar�M �fr
e art om
5.5. Distance vs. Prominence �ne
z
Once you’ve decided how relevant the result is based on user intent, consider the result in the
context of all possible results in the real world. Use the distance to the user or viewport and the
prominence of the result to decide if a demotion should be applied.

A result’s fit to user intent, prominence, and distance should all be relative to the query and the
context around the query. Before deciding whether to demote because of prominence or distance, it’s
important to look at:

• The type of area around the result – rural, urban, or suburban

• The number of businesses that satisfy the query
• The distance to the user or viewport

The following examples of multiple query/result pairs will demonstrate how to interpret the
relationship between distance, prominence, and satisfying the user’s intent. The examples address
common rating situations and explain how to evaluate the relevance of the results.

5.6. Many Possible Results

Some queries, like [starbucks], have many results that could satisfy the user. In cases like this,
distance is more important than prominence, so results that are closer to the user’s location/viewport
should be rated higher than results that are farther away. To illustrate the high density of Starbucks,
possible results are shown as purple dots.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

42
User Inside Fresh Viewport m
4 � fro ez
2 n
When the user is inside the viewport, 7 , �20 art�consider all possible results, including real-world results not
�1 arand �M
returned for rating (purple a rydots),s c demote by distance from theSauser.
e b r u
b y � O
e IP� turda
F � 17
a y,� 54.9 nriq u 2.1 y,�Fe
Query and d 2
6. Ma Result br
.25 Explanation
Rating 6and
tur Screenshot 4.9 uary�
Sa 172.1
IP� Ma �by�O 17,�2
① Starbucks Relevance Excellent
nri sc 024
qu ar�M �fr
865 Market Rate Excellent for Starbucks e locations om are in
art that
Street �ne
close proximity to the user. z

Relevance Good (Distance/Prominence)

[starbucks] ② Starbucks
170 O’Farrell St Rate Good for locations that are a bit farther
User and fresh viewport in San away from the closest relevant locations to the
Francisco, CA user.
Acceptable (Distance/
Relevance
Prominence)
③ Starbucks
264 Kearny St Rate Acceptable for relevant locations that are
even farther away from the user but still inside
the viewport.

Relevance Bad (Distance/Prominence)

④ Starbucks
580 California
St When there are many locations close to the user,
rate Bad for locations that are significantly farther
away and outside the viewport.

Relevance Excellent
⑤ Starbucks
140 Mason
Rate Excellent for Starbucks locations that are in
Street
close proximity to the user, even if they are
outside the viewport.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

43
User Outside Fresh Viewport m
4 � fro ez
2 �n
When a user is outside the viewport, 7 , �20 artresults are expected in or near the viewport. In cases where
�1 ar�M
there are a large numberuaof r possible
y
sc results inside the viewport, even
Sa if they are not returned for
t
rating (purple dots),�Frate
r
e 9Bad
b �b � O
y for e those outside it. I P�1 urda
y, 54. nriq u 72 y,�F
da 2
r 16. Ma .16 eb
t u .25 rua
Sa 172. 4.9 ry�
�by 17,
I P � M
Query and Screenshot Result nri �Osc �2024
Rating andaExplanation
qu ar�M �fr
e art om
Relevance Excellent �ne
① Starbucks z
865 Market Rate any Starbucks within the fresh viewport
Street Excellent when the user is outside the viewport.

[starbucks]
Relevance Excellent
User in Alameda with fresh ② Starbucks
viewport in San Francisco, CA 170 O’Farrell St Rate any Starbucks within the fresh viewport
Excellent when the user is outside the viewport.

Relevance Excellent
③ Starbucks
264 Kearny St Rate any Starbucks within the fresh viewport
Excellent when the user is outside the viewport.

Relevance Bad (Distance/Prominence)

④ Starbucks
580 California
St When there are many possible results within the
viewport, including those not returned for rating
(purple dots), rate Bad for results outside it.

Relevance Bad (Distance/Prominence)

⑤ Starbucks
140 Mason
Street When there are many possible results within rthe m
Sa
viewport, including those not returned for �f o ez
rating
IP� turda �
2 4
20 art�n
17 (purple dots), rate Bad for results outside , it.
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

44
 m
4 � fro ez
2 n
7 , �20 art�
1 �M
a ry� scar Sa
t
u
5.7. Few Possible Results Fe b r
�b y � O
e I P�1 urda
y,� 54.9 nriq u 72 y,�F
da
r 16. Ma2 .16 eb
t u .25 rua
When the query
Sa 17has 2. only a few results in the real world, be more lenient when 4.9 considering
ry� distance.
Because there �are only a few Zara clothing stores in Miami, results for the query 17
�by [zara]
I P M an �Os �202 demoted
, are
more leniently for distance than the many Starbucks locations in the exampleriabove. qu car�M 4�fr
e art om
�ne
z
Query and Screenshot Result Rating and Explanation

① Zara Relevance Excellent

19501 Biscayne
Blvd, Aventura Rate Excellent for the closest Zara location, even
when outside the fresh viewport.

Relevance Good (Distance/Prominence)

② Zara
420 Lincoln
[zara] When there aren’t any possible results in the
Rd, Miami
Beach fresh viewport, rate Good for locations that are a
User and fresh viewport in North bit farther away from the user/viewport.
Miami Beach, FL
Relevance Good (Distance/Prominence)
③ Zara
590 Collins
Ave, Miami When there aren’t any possible results in the
Beach fresh viewport, rate Good for locations that are a
bit farther away from the user/viewport.

Relevance Good (Distance/Prominence)

④ Zara
701 S Miami
When there aren’t any possible results in the
Ave, Miami
fresh viewport, rate Good for locations that are a
bit farther away from the user/viewport.

Acceptable (Distance/
Relevance
Prominence)
⑤ Zara m
Sa
7535 N Kendall �fro ez
IP� turda 2 4
�20 art�
n
17
2.1 y,�Fe Dr, Miami The Zara store is located significantly ,
1 further
7 �M
6.2 bru ary� scar
away than the second closest stores u and is
54
.9� ary�1 ebr 9�by�O ue
Ma by�O 7,�2 therefore rated Acceptable. , � F .
nri sc 024 r d ay .254 anriq
qu ar�M �fr tu 6 M
e art om Sa 172.1
IP �
�ne
z

45
 m
4 � fro ez
2 rt�n
5.8. Few Possible Results and 7 , �20 Greater
a Distance
y �1 ar�M Sa
r
ua �Osc t
Leniency on distance F e b r
is acceptable
�b y e P�1 urdaresults for the query in the
when there are only a few possible
I
� 4.9 iq u 72 y,�F
requested [Link], example,
2 5
. Ma n r a user close to Berlin queries for [Wartestraße],
.16 eb which is a street
u . four streets in Germany called “Wartestraße” that .can
6 r
25 satisfy
t
name. ThereSaare7only
2 1 4.9 uary� the user’s intent
1 �by 17, each result’s
IP�
and all four streets are returned as results. Because of the limited numberMof an results,
�O �2
relevance remains fairly high even over longer distances. riq scar 024�
ue �M fro
art m
�ne
z
Query and Screenshot Result Rating and Explanation
[Wartestraße] Relevance Excellent

User and
① Wartestraße, Wartestraße in Gransee is the closest to the
fresh viewport close to Berlin, Gransee user and viewport and is therefore the most
Germany relevant.
Relevance Good (Distance/Prominence)
② Wartestraße, Wartestraße in Siegen is far away from the
Siegen user, but is the second closest possible result.

③ Wartestraße, Wartestraße in Wiesbaden is at a similar

Wiesbaden distance from the user as the one in Siegen
and receives the same rating.

④ Wartestraße, Acceptable (Distance/

Relevance
Geislingen Prominence)
Wartestraße in Geislingen is the fourth closest
[Wartestraße] result but significantly farther away. Given all
other results and their distances, this result is
User and rated Acceptable.
fresh viewport
close to Berlin,
Germany

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

46
 m
5.9. Rural Areas 4 � fro ez
2 n
7 , �20 art�
1 �M
Results are often farther away a ry� scinarrural areas, but can still be considered Sa
tur
relevant if there are no
r u O
reasonable results close e 9to
b �byorqwithin
� the fresh viewport. In a ruralParea,
I �17 dgenerosity can be applied to
,�Fto 4distance.
. ue ay,
�
ratings with respect a y
rd 16.25 Man
r i The criteria for rating are similar to the
2 . [zara]
16 ebr F example in the Few
t u . 2 u
possible results
Sa 17section,
2. but with an emphasis on distance. Here is an example 5 4.9 forar the query
[american legion]
P � in North Dakota. M �by y�17,
I an �Os �202
riq car
ue �M 4�fro
art m
Query Result Rating and Explanation �ne
z
Relevance Excellent
① American
Legion This result is closest to the user
based in Bismarck, ND.
[american legion]
Relevance Good
② American The second-closest result is
Legion significantly further north than the
closest result.

Relevance Acceptable

③ American While quite remote from the user, this

Legion result is still a good option for the
user given that there are only two
closer results.

Relevance Acceptable

④ American Like result 3, this location quite far

Legion away but is still an acceptable result
given that there are only two
significantly closer results available
to the user.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

47
5.10. Location – User Intent Deviation m
4 � fro ez
2 rt�n
When the location intent and7user , �20 intent
a do not allow for a clear result (because either the user or
viewport are in an atypical �1 ar�M like the middle of the ocean), Srate with a focus on high
location,
y
ar Osc atu
prominence. For example, bru �bthe � query [Hong Kong] in a test locale
IP�set
17 to
e y e rda en_US with the viewport and
, � F . 9 q u y,�F
user location around
d a y Naples,
r 16. Ma 2 5 4 nr Italy. There is no real change in rating if2the
i . 16 user
ebr is inside or outside of
u . 2
the viewport, t
Sa [Link] viewport is fresh or stale. 5 4.9 uary�
IP � Ma �by�O 17,�2
nri sc 024
qu ar�M �fr
Query and Screenshot Relevance Rating Explanation
e art om
�ne
[Hong Kong] The most prominent resultzis the
Navigational
territory of Hong Kong in Asia.
User and
Fresh Viewport close to Naples, Italy Businesses/locations with the same
name that are within the viewport or
Excellent
close proximity to the user and
prominent. (This will be rare.)

Locations that are too far away and

less prominent to be considered
relevant should be rated Bad. A
Bad (Distance/
restaurant in Rome named “Hong
Prominence)
Kong” should be rated Bad
because it is very far away from the
user location, which is in Naples.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

48
5.11. Rating for User Inside and Outside m Viewport
� f ro
ez
The following two examples show , �2 024the
a rt�ndifferences in rating when a user is inside and outside a fresh
viewport. The query is foraray�chain 17 ar�M business called Great Wolf Lodge Sa found across the United States.
r u �Osc tur
The examples showFall e b possible
y e results within and around the large I P�1 viewport.
d
y
�
,� 4.9 riqb u 72 ay,�F
da 25 an . 16 ebr
tur .[Link]
In general, when
.25 u
Sa 172the
M is outside the fresh viewport, no result within the 4viewport
� .9� ary�1 is demoted for
distance. TheIPonly exception to this is when the viewport is large enoughMtoa include b y 7,an unusually
nri �Osc �2024
large area, like an entire continent, and the results within it would not realistically qu beruseful
a �M �froor
e art m
interesting to a user with this query. �ne
z
(Note that even though the viewport in the example below is large, because of the limited number of
Great Wolf Lodges with it, the results still might be useful or interesting to a user with this query.)

Query and Screenshot Result Rating and Explanation

Relevance Excellent
① Great Wolf Lodge
Atlanta The result is within the fresh viewport
and fulfills the primary user intent.
[great wolf lodge] Relevance Excellent
② Great Wolf Lodge
User in Savannah outside large, Charlotte The result is within the fresh viewport
fresh viewport and fulfills the primary user intent.
Relevance Excellent
③ Great Wolf Lodge
Williamsburg The result is within the fresh viewport
and fulfills the primary user intent.
Relevance Good/Acceptable
(Distance/Prominence)

④ Great Wolf Lodge The result is outside the fresh viewport.

Pocono Mountains Because there are a limited number of
possible results within the viewport and
this one is relatively close, demote to
Good or Acceptable.
Relevance Excellent
⑤ Great Wolf Lodge
Niagara Falls The result is within the fresh viewport
and fulfills the primary user intent.
m
Sa Relevance Good/Acceptable �fro ez
IP� turda 2 4
�20 art�
(Distance/Prominence) n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ry� scar
54
.9� ary�1 ⑥ Great Wolf Lodge The result is outside the u a
fresh
ebr 9�by�O ue
viewport.
Ma by�O 7,�2 Traverse City Because there areya,�Flimited number of
nri sc 024 d a .254. anriq
qu ar�M �fr possible results r within
atu 72.16 the
M viewport and
e art om S
this one is relatively
1 close, demote to
�ne IP�
z Good or Acceptable.

49
When the user is inside the fresh viewport, m the user's location is used as location intent and results
ro
are demoted for distance. � f ez
, �2 024 art�n
17 �M
a ry� scar Sa
Query and Screenshot u �O Result Rating
t and Explanation
Fe b r
�b y e I P�1 urda
,� .9 iq u 72 y
r day 6.254 anr ① Great Wolf Lodge Relevance .16 ,�Feb Excellent
t u M .25 rua
Sa 172.1 Atlanta 4.9 ry�
� This result is amongst
M �b 1the
7 closest
I P an y�Os ,�202
possible to the user riq and
caris inside the
ue �M 4�fro
fresh viewport. a rt�n m
ez
② Great Wolf Lodge Relevance Excellent
[great wolf lodge] Charlotte
This result is amongst the closest
User in Savannah inside large, possible to the user and is inside the
fresh viewport fresh viewport.
③ Great Wolf Lodge Relevance Good (Distance/
Williamsburg Prominence)
Though still inside the fresh viewport,
this result is significantly farther away
from the user location with closer
options available.
④ Great Wolf Lodge Relevance Bad (Distance/
Pocono Mountains Prominence)
This result not only is very far away from
the user, it is also outside the fresh
viewport.
⑤ Great Wolf Lodge Relevance Acceptable
Niagara Falls (Distance/Prominence)
While very far away from the user, this
suggestion is still within the fresh
viewport and therefore rated
Acceptable.
⑥ Great Wolf Lodge Relevance Bad (Distance/
Traverse City Prominence)
This result is not only very far away from
the user, it is also outside the fresh
Sa viewport. m
�fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

50
5.12. Partial Address Does Not Exist m
4 � fro ez
2 n
Relevance is always rated independently 7 , �20 art� of any data (name, address, or pin accuracy) issues the
1 ar�M for addresses that do not exist
result may have. This includes a ry� scresults Sa in real life.
t
u
Fe b r
�b y � O
e I P�1 urda
y,� 54for .9 existing
riq
u 72 y,�F
When judging distance
da
r 16. Ma2 n addresses do not factor in any returned
.16 enon-existent
bru addresses.
t u . 2
Evaluate distance
Sa [Link] for existent and non-existent addresses. Do not 5 4.9 demote
ar existing
address resultsP � when closer, non-existent addresses are returned. M �by y�17,
I an �Os �202
riq car
ue �M 4�fro
For example, a user in Half Moon Bay, CA is looking for [2373 chestnut] and is presented m three
art with
�ne
residential addresses. The address in San Francisco is the only one that actually exists. Thez results in
Oakland and Redwood City are not supported by the postal authorities and no evidence can be found
that the addresses in either city exist.

Note: For cases where the query is a unique full address that does not exist and the result matches
the query, see Query Address does not Exist.

Query and Screenshot Result Rating and Explanation

Relevance Excellent
This is the closest existing result. The address
2373 Chestnut St, in Redwood City is disregarded and its
[2373 chestnut] San Francisco relevance is not promoted nor demoted for
User and Fresh Viewport Distance/Prominence because it does not
around Half Moon Bay, CA exist.

Relevance Excellent

This is closer to the user than the existing

2373 Chestnut St, result in San Francisco. Because data issues
Redwood City are not part of the relevance rating, the result
is rated Excellent due to proximity and user
intent. Address accuracy is rated Incorrect –
Address does not exist.

Relevance Good/Acceptable
(Distance/Prominence)

2373 Chestnut St, This is significantly farther away than the

Oakland existing result in San Francisco and the non-
existent result in Redwood City, and is om z
Sa �fris
t
IP� rdau demoted in relevance. Address accuracy 2 4
0 art�n
e
17 y rated Incorrect – Address does not7 , � 2exist.
2.1 ,�Fe 1 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
b ,
Ma y�O ,�2 7
nri sc 024 r d ay .254. anriq
qu ar�M �fr tu 6 M
e art om Sa 172.1
IP �
�ne
z

51
5.13. City vs. Municipality m
4 � fro ez
2 n
7 , �20 art�
In many cases, a city and a state/county/municipality (or other similar market-specific components)
have the same name, butathe y �1 city a r �M
is typically more prominent. In this
Sa case, the chances that a user is
r
r u �Osc tur
looking for the state/county/municipality
e b y e and not the city, are veryP�small,
I d but still a possibility.
F �
,� 4.9 randb
q u 1 72 ay,�F
Therefore, states, a counties,
y
rd 16.25 Man
i municipalities will be treated as a secondary
. 16 ebrintent and given an
initial ratingSoft u
a Good. 7 2 . Consider the relationship between the city and the.2municipality 54 uar
.9� y�1 in terms of their
� 1 b
locale and adjust
I P if necessary. On the other hand, if the query specifically Mrequests
an y�Os the
7,� state/county/
20
municipality, that result’s relevance should be rated as Navigational and the city r c
qu should 2
i
e
a r �M 4�be fro rated
Bad. a rt�n m
ez
See your Country Specific guidelines for more information.

Query Result Rating and Explanation

Relevance Navigational
New York City
New York, USA The result is for the city, which is considered more
prominent than the state.
[new york]
Relevance Good (Distance/Prominence)
New York State
New York State, USA Result is for the state, which is less prominent than the
city.
Relevance Navigational
Santa Clara
Santa Clara, CA Query is for the city, which is considered more
prominent than the county.
[santa clara]
Relevance Good (Distance/Prominence)
Santa Clara County
Santa Clara County, CA Query is for the city, which is considered more
prominent than the county.
[santa clara Relevance Navigational
county] Santa Clara County
Santa Clara County, CA Query is specifically requesting the county, so the
result for the county will be rated Navigational.
Relevance Bad (User Intent)
Santa Clara
Santa Clara, CA Query is for the county and a result for the city is
considered irrelevant for the query.
[Link] Results
m
Sa
Straightforward
t u queries can have unexpected results which at first glance might not fit the query 2 4 �fro ez
n
IP� rda
intent.
17 Fory,these kinds of results, consider: 7 , �20 art�
2.1 �Fe 1 �M
.25 braualogical relationship between the query and the result? ry� scar
• Is6there u a
�O e
• HowMlikely
4.9 ry�
�by is 1it7,that the user is going to be looking for this result given the � F ebr 9�byand
query u location
, .
ay .254 anriq
an �Os �202
intent? r d
riq car tu 6
ue �M 4�fro Sa 172.1
M
art m �
A result can partially satisfy �nea secondary intent due to: IP
z

52
 • Prominence of the feature m
• Transit intent 4 � fro ez
2 n
7 , �20 art�
Promoting for prominence �1 ar�M
ryshould
r u a
� O sc only occur for internationally prominent Sa
tur POIs.
e b y e I P da
�F .9�b iqu �17
2.1 yand
ay, .254two
In the examplesrdbelow, a nratings
r are provided for some results: Good
,�F
6.2 ebAcceptable. The
t u 6 M rua
Sa 172.1 the two ratings rests in how well the result satisfies user
difference between 54 intent.
.9� y�1 r Choose Good if
� M b 7
there is a strong
I likelihood that it will satisfy user intent and Acceptable if aitn is less
P y �O likely
, �2 to satisfy.
riq scar 024�
ue �M fro
ar m
Query Result Rating and Explanationt�nez
Relevance Navigational
Mission St & 14th
St
San Francisco, CA Query is for an intersection and the result
[mission & 14th satisfies the user intent.
street]
Relevance Good/Acceptable (User Intent)
User and fresh
viewport in San Mission St & 14th St Bus Result is for the bus stop at the queried
Francisco, CA Stop intersection. The bus stop carries the name of
San Francisco, CA the intersection and users tend to look for
intersections when seeking transit POIs.

Relevance Navigational
[soho]
Soho
User and viewport in London, UK Query is for a neighborhood in London and the
London, UK result satisfies the user intent.

Relevance Bad (User Intent)

Mildreds Restaurant
45 Lexington St, Carnaby, Result is for a specific restaurant in Soho. It is
London W1F 9AN, UK very unlikely to satisfy the user intent.

Relevance Bad (User Intent)

Happy Lamb Hot Pot The query is for a street and the result is a
[stevens creek
19062 Stevens Creek Blvd, specific business on that street. This specificom
blvd
Sa cupertino] fr the
t u
IP� rda Cupertino, CA, 95014 result is unlikely to satisfy the broad intent 0 2 4�of �ne
z
� 2 a r t
17
2
User
y,�F query. ,
�17 ar�M
.16and efresh r y
.25 bin r a Os c
viewport 4.9 uary� Relevance Bad (User e bru �Intent)
by� ue
Cupertino,Ma �CAby 17, 19062 Stevens Creek , � F . 9
nri �Osc �2024 r d ay .254 anriq
qu ar�Blvd The result includes aastreet
tu 2.16number M when the
e Ma �from query is for a street,S making
1 7 this result too
Cupertino,
rt�n CA, 95014 IP �
ez specific for the more general query.

53
 Query Result m Rating and Explanation
4 � fro ez
2 n
[The Slanted 7 , �20 art� Relevance Bad (User Intent)
1 �M
Door a ry� scar Sa
One Ferry e br �by�O e Building #3
One
u Ferry IP� turda
y,� 5One
4.9 nFerry Result is for the17address
2.1 y,�Fe and not the business
riq Building #3 San
F u
Building #3 a requested in the query,
6.2 so
54 ruitardoes not satisfy the
d 2
6. Francisco, CA 94111 b
tur Ma
Sa 172.1
San Francisco, user intent. .9 y
IP�
California 94111] Ma �by�O �17,�2
nri sc 024
qu ar�M �fr
Relevance e
Navigational
art om
[One Ferry �ne
The Slanted Door
Building #3 San z
The query is for an address and the result is the
One Ferry Building #3
Francisco, business at this address. Including the business
San Francisco, CA 94111
California 94111] name provides additional correct information.
Relevance Navigational
San Francisco
[san francisco] San Francisco, CA Query is for the city of San Francisco and the
result satisfies the user intent.
User and fresh
viewport in San Relevance Good (User Intent)
Francisco, CA San Francisco
International Airport The result represents the airport within the
San Francisco, CA queried locality, which satisfies the secondary
transit intent.

The Pruneyard Relevance Navigational

1875 South Bascom Ave The query is for a mall and the result is the mall
Campbell, CA the user asked for.

The Pruneyard Relevance Bad (User Intent)

Pruneyard Cinemas The query is for an entire mall and the result is
1875 South Bascom Ave for a cinema inside the mall. Even though the
Campbell, CA cinema shares the mall’s name and address, it
does not match the query intent.

5.15. Multiple Transit POIs with the Same Name

m
Sa
t u 2 4 �fro ez
IP� rda
Many 17 largey transit POIs include multiple means of transportation at the same location. For
7 , � 20 art�n
example,
2.1 ,�Fe 1 ar�M
large airports
6.2 bcan r have metro or train service within the same location, or train stations a ry�can c be a hub
54 u a b r y�Os
u
for trains, metros,
.9 r yand buses. Other transit POIs at the queried transit POI should ebe treated
�b e as
Ma �by�O �17,�2 y,�F 54.9 nrifiquthe result is
secondary intent with
nri sc 024 an initial rating of Good, but can also be considered Acceptable
d a
r 16.2 Ma
less likely to satisfy qu the a
e r�Muser’s �fro intent. Additional demotions can be applied atubased . on the prominence
art m S
� 172
of the returned feature. �ne I P
z

54
 m
� fro ez
Query Result 202 rt�n 4 Rating and Explanation
� a
y �17, ar�M
ar sc Airport
Hamburg Relevance Sa Navigational
e bru �by�O e IP� turda
y,�F 522335
4.9 nriqHamburg, Germany
u 1 y,�F queried airport.
a Result [Link]
16 the
tur
d 2
6. Ma .25 ebrua
Sa 172.1 Relevance [Link]
9 ry (User Intent)
IP� Ma �by�O �17,�2
nri sc 024
[hamburg airport] Hamburg Airport Station qu ar�M �fr
e om
22335 Hamburg, Germany Result refers to the train station aatrt Hamburg
�ne
User and fresh Airport. z
viewport in Germany
Relevance Bad (User Intent)

Lufthansa Basis The result is for a small bus stop that seems to
22335 Hamburg, Germany service the Lufthansa training center. The result
does not share the same name as the queried
transit. Therefore, the result is not relevant.
Relevance Navigational
The query is for a unique transit station. The
Embarcadero Station result (a unique BART station) fully satisfies the
[Embarcadero
San Francisco, CA user’s intent.
Station]
Acceptable (User Intent &
User and fresh Relevance
Distance/Prominence)
viewport in San Jose,
CA Ferry Building & The result (a historic streetcar) name includes
Embarcadero Station the queried station name, but has low
San Francisco, CA prominence, given that there is a unique
Embarcadero Station. Therefore, the result
should be demoted based on user intent.

5.16. POIs and Transit Intent

A non-transit POI can be associated with a transit POI with the same name. You can establish the
relationship between the two entities by using local knowledge, researching prominence, and
understanding how well the result satisfies user intent. This way you will learn whether the query has
a distinct navigational intent or if the prominence of the two POIs that share a similar name is so
strong that both can be the intent.
m
Sa
t u 4 �fro ez
IP� rdaQuery Result Rating and Explanation �20 rt�n 2
17 y , a
2.1 ,�Fe y �17 ar�M
[mall .of
6 25 America]
b r Relevance Navigational
a r s c
4.9 uary� Mall of America e bru �by�O e
Ma �by�O 17,�2 60 E Broadway, � F 9 u
User and fresh nri viewport
sca 024 r d ay, .254. anriq
tu 6 M
in que r�M �Bloomington,
f
art rom
MN Sa 17in2.1the query.
Result is POI requested
55425 United States IP �
Minnesota �ne
z

55
 Query Resultm Rating and Explanation
4 � fro ez
02 art�n
�2of Good/Acceptable
Mall
7 , America
a y�1 car�M
rStation Relevance S a (User Intent &
s
e bru �by�O e IP� turda Distance/Prominence)
y,� 54.9 nriqu 24th Ave S
8240
F 17
a 2.1 y,�Fe
tur
d 6.2 MaMinneapolis, MN Even though the station6.2 bhas
54 ruarthe same name as
Sa 172.1 55425 .9 y�1 therefore
IP� the POI, it is not prominent
Ma �by�and 7,
United States demoted. nri sc �2024
O
qu a
e r�Ma �from
Relevance rt�n
Excellent
ez
Result is for famous square in London. The
square and the train station are both equally
Piccadilly Circus prominent and local users would be looking for
[Piccadilly circus] London, UK the station while tourists would be looking for
User and viewport in the square. As both features are equally
London, UK prominent, it is hard to establish a distinct user
intent.

Piccadilly Circus Relevance Excellent

Station Result is the famous station that is just as
London, UK prominent as the square.
Dam Square Relevance Navigational
Dam Square,
Amsterdam, The result is the famous square in Amsterdam.
[dam square] Netherlands
User and viewport in Dam Square Line 2 Good/Acceptable
Relevance
Amsterdam Dam Square, (Distance/Prominence)
Amsterdam,
Netherlands Result is for the tram stop for line 2. The stop is
on a street adjacent to Dam Square. However, it
is not prominent and should be demoted.

5.16.1. Transit Queries

The criteria described above should be applied to understand the transit queries. Additionally, if it is
determined that a query has a clear navigational intent, all other results will be Bad (see [12th st
oakland bart] example below). If a result is promoted to Navigational, other results that could
potentially satisfy the user intent should be demoted further for distance and prominence (see
m
[BART
Sa daly city] and [stockport station] examples below). In general, the fewer the results that
t u 2 4 �fro ez
IP� rthe
satisfy
17 day,�user intent, the farther away the results can be and still be considered relevant. , �2The
0 amorert�n
2.1 results
F 1 7 �M
available 6.2 ebru that can satisfy the user intent, the closer they need to be. ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
b ,
Ma y�O ,�2 7
nri sc 024 r d ay .254. anriq
qu ar�M �fr tu 6 M
e art om Sa 172.1
IP �
�ne
z

56
 Query Result m Rating and Explanation
4 � fro ez
2 n
7 , �20 art� Relevance Navigational
1 �M
a ry� scar Sa
tu
u
� Febr 9�by�O ue The query is for aIPspecific
�17 rday, BART station with a
day 6.2512th
4. nSt. riq Oakland
, �F
2.1 the
r a unique name that is not 6.2 esame
b as the name of
Sa 172.1 Station
t u M 54 risuafound.
the locality where the station .9� y�1 (Compare
r
IP � Oakland, CA this to the examples below).M by� 7,�
anThis O result
2 matches the
[12th st oakland riq scar 024�
query exactly and fully satisfies uthe
e user’s
�M frintentom for
bart] this specific station. a r t�n
ez
User and viewport in Relevance Bad (User Intent Issue)
California
The query intent is for a specific BART station with a
19th St. Oakland unique name that is not the same as the name of the
Station place where the station is located. The result
Oakland, CA returned is for a different BART station and does not
satisfy the user intent. This result should receive a
rating of Bad.
Relevance Navigational

Daly City Station The query intent is for a BART station in Daly City.
Daly City, CA Research shows that there is only one BART station
in Daly City and its name is Daly City Station, so this
result fully satisfies the user’s intent.
Relevance Good (Distance/Prominence)

The query intent is for a BART station within Daly

City. This result fits intent as it is a BART station.
Colma Station This station is in a neighboring locality just outside
Colma, CA of the requested locality. Even though the station is
[BART daly city]
outside of the requested locality, it provides a
User and viewport in choice of BART stations in the area for the user.
California This result is demoted due to distance.

Relevance Acceptable (Distance/Prominence)

San Francisco
International Airport m
Sa
t u Station The query intent is for a BART station in Daly2City. 4 �fro ez
n
IP� rda
17 y San Francisco This result fits intent as it is a BART station. 7 , �20Thisart�
2.1 ,�Fe y�1farther �M
6.2 bru International Airport, station is in a neighboring locality, but u a ris s car
54
.9� ary�1 CA away than the Colma station and eisbrdemoted �O
Ma by�O 7,�2 , � F . 9 �by que due to
distance. y 4 ri
nri sc 024 urda 16.25 Man
qu ar�M �fr t
Sa 172.
e art om
�ne IP�
z

57
 Query Result m Rating and Explanation
4 � fro ez
2 n
7 , �20 art� Relevance Navigational
1 �M
a ry� scar Sa
u
ebr 9�by�O ue IP� turda
, � F
4. nriq The query intent is 1for
72 a ystation
.16 ,�Feb in Stockport.
r day 6.25Stockport
a
Station
t u 1 Stockport,
M England Research shows that there .25 are
4.9 useveral
r a stations in
Sa 172. ry�
IP� Stockport, but only one named � b Stockport
Ma y�O 7,�2 1 Station,
n
so this result fully satisfies the riquser’s
s 0
c intent.
2
ue ar�M 4�fro
art m
�ne
z
Davenport Station Relevance Excellent
Stockport, England
[stockport The query intent is for a station in Stockport. There is
station] one station with a name that matches the query
Heaton Chapel exactly, which receives the Navigational rating. All
User and viewport in Station other stations within the queried locality should
Stockport, England Stockport, England receive Excellent.

Relevance Good (Distance/Prominence)

This station is just outside of the requested locality,

in a neighboring locality. Even though the station is
Burnage Station outside of the requested locality, it provides a choice
Manchester, England of stations in the area for the user. The fewer choices
there are available, the farther away the results can
be and still be relevant. This result is demoted due to
distance.

Relevance Excellent
San Jose Diridon
Station
[san jose station] San Jose, CA The query intent is for a station in San Jose. There
are several stations in San Jose, but no stations with
User and viewport in a name that matches the query exactly, so we should
California rate every station within the queried locality equally.
Tamien Station There are two stations that match the user’s intent,
San Jose, CA so both results should be rated Excellent.

Relevance Good (Distance/Prominence)

m
Sa �fro ez
IP� turda This station is just outside of the requested�2locality, 2 4
0 art�n
17
2.1 y,�Fe Lawrence Caltrain in a neighboring locality. Even though rthe 7 ,
6.2 bru y�1 station
car
�M is
54 Station a
outside of the requested locality, eitbrprovides
u s
O a choice
.9� ary�1 Sunnyvale, CA F � by� ue
Ma by�O 7,�2 of stations in the area for the auser.
y 5The
, � 4 nfewer
. 9 riq choices
nri sc 024 r d . 2 a
qu ar�M �fr there are available, the farther
tu away 6 Mthe results can
e art om Sa 172.1
�ne be and still be relevant. IP �
z

58
 Query Result m Rating and Explanation
4 � fro ez
2 n
7 , �20 art� Relevance Acceptable (Distance/Prominence)
1 �M
a ry� scar Sa
tur
u
r y�O
ebSunnyvale This station is just
IP�outside
d of the requested locality,
F 9�b rique Caltrain 1 72 ayEven
in a neighboring locality.
.16 ,�Feb though the station is
y , � 4 .
a
d 6.25Station n
tur Ma outside of the requested.2locality,
54 ruar it provides a choice
Sa 172.1 Sunnyvale, CA .9�user.
IP� of stations in the area for M the b y�1The
7 fewer choices
an y�Os ,�202
there are available, the farther riqaway
c the results can
ue ar�M 4�fro
be and still be relevant. art m
�ne
z
Relevance Bad (Distance/Prominence)
Palo Alto Train Result is far from the queried station. The farther
Station away the result is from the queried station, the less
Palo Alto, CA likely it is that it will be considered relevant, so the
relevance rating should be lowered.

5.16.2. Stops vs. Stations

A transit stop is a location typically designated by a bench or covered waiting area, a posted sign, or
street markings. Transit stations, on the other hand, are typically larger areas associated with major
structures including, but not limited to, platforms, ticketing offices, enclosed waiting/seating areas, or
terminal buildings/structures encompassing the transit area. The term “station” is primarily used to
refer to transit locations that are larger and typically a terminal housing multiple routes. All stations
are stops, but not all stops are stations.

Since all stations are stops, but not all stops are stations, returning a station for a stop query is ok, but
returning a stop when the query is station should result in a rating of Bad with the User Intent
checkbox selected. Try to identify these corresponding terms in the test locale and understand the
relationship between them.

For the category [bus stops], relevance should be based mainly on distance from the user location
or fresh viewport and the physical size of the bus stop. If the result is a small bus stop in a rural area
and the bus stop is among the closest ones to the user’s location intent, it should be rated Excellent.
On the other hand, if the result is a large bus hub that is a bit farther away from the user, it should still
receive an Excellent because of its size, regardless of the fact that there are closer, smaller bus
stops. Results close to the user should not be demoted because there is a larger bus stop farther
away, instead, the large bus stop should be promoted because of its importance.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

59
 Query Result m Rating and Explanation
4 � fro ez
2 n
7 , �20 art� Relevance Excellent
1 �M
a ry� scar Lines
Greyhound Sa
u
ebr200 �O e IP� turda
, � F . 9 �by Folsom
q u
St This is a major 1bus
72 station
y,�F in San Francisco
a y
rd 16.25 Man
4San Francisco,
r i CA 94105 .
where a user can take1 e
u 6 .25 Greyhound
br buses.
t
Sa 172. 4.9 uary�
IP� Ma �by�O 17,�2
Main St & Folsom St nri sc 024
San Francisco, CA 94105 qu ar�M �fr
Relevance Bad (Usere Intent) art om
[bus station in san �ne
francisco] z

User and viewport in

San Francisco, CA These results are small local bus stops and do
5th St & Howard St not satisfy the user intent for a bus station.
San Francisco, CA 94103

Relevance Bad (Distance/Prominence)

Sacramento Bus This result is another Greyhound station, but it is
Station in Sacramento, quite far from San Francisco.
420 Richards Blvd There are closer real world results we could
Sacramento, CA 95811 return. This result is too far and should be
demoted due to distance.

Relevance Excellent
Chicago Bus Station
630 W Harrison St The query intent is for a bus stop. This result is
Chicago, IL 60607 a Greyhound station, which fully satisfies the
user's intent. This result is close to the user.

Relevance Excellent
[bus stop] W Harrison St & S The query intent is for a bus stop. This result is
Jefferson St a Greyhound station, which fully satisfies the
User and viewport in Chicago, IL 60607
Chicago, IL user's intent. This result is close to the user.

Relevance Bad (Distance/Prominence)

The query intent is for a bus stop. This result is a
Harlem Ave & W 115th bus stop and matches the user's intent, but
St there are many bus stops closer to the userfrin m
Sa
Worth, IL 60482 � o ez
IP� turda the real world we should be returning instead. 2 4
�20 art�
n
17 ,
2.1 y,�Fe Therefore, this result should be demoted 1 7 due to
�M
6.2 bru ary� scar
distance. u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

60
 m
5.17. Parking Intent 4 � fro ez
2 n
7 , �20 art�
1 �M
a ry� scar Sa
t
u
When evaluating [parking]F e b r
�b
O
y queries,
� e note that: I P�1 urda
y,� 54.9 nriq u 72 y,�F
da
r 16. Ma 2 .16 eb
t u .25 rua
• Free Sand
a 7paid 2 . parking are equally relevant. 4.9 ry�
� 1 �by be 1changed
• Parking I P time limits do not affect relevance rating. Your rating should
M anot
7, by the
nri �Osc �2024
fact that a parking lot is long term, short term, or limited-time (like a two-hour qu a limit) parking.
e r�Ma �from
• Parking for small cars, large cars, RVs, or motorcycles is equally relevant. rt�n
• If you can find evidence that a result is for private parking that cannot be used by the ez general
public, give it a rating of Bad.

Public parking vs Private Parking

Public parking is:

• Parking that is a mix of residential/staff/permit and visitor parking and is not in a gated
community
• Parking that can be used only when visiting a certain business (limited-use parking)

Private parking is:

• Parking that is residents only, staff only, or by permit only

• Parking in a gated community

If you cannot confirm whether parking is public or private, give the result the benefit of the doubt
and consider it public parking.

5.18. Relevance: Service-Level Mismatch

Sometimes a query specifically requests a certain level of service, which may or may not be reflected
in the result. Common requests include:

• Specific stores (e.g. Walmart Supercenter)

• Outlet stores (e.g. J. Crew Factory)

When the query requests a specific level of service which is not reflected in the result, give an initial
rating of Good and demote as necessary depending on how well the result would satisfy the user
intent. m
Sa
t u 2 4 �fro ez
IP� rda
1 y , � 20 art�n
When72the .16 query
,�F requests a type of business with a generic level of service, providing ay�result 1 7 �Mthat
ebr r scar
offers more .25 service
u
4.9 ary� than requested still satisfies user intent and should receive an br �by�O e of
initial
u a rating
Excellent.M �by 17, � F e 9 u
an �Os �202 r d ay, .254. anriq
riq car 4�f tu 2.16 M
When the query does
ue �not rom the type of service, any relevant resultSacan
Ma specify 1 7 be rated Excellent.
rt�n IP �
ez

61
 m
� fro ez
Query Result 2 4 n Rating and Explanation
7 , �20 art�
1 �M
a ry� scar Relevance Sa Excellent
u
ebr 9�by�O ue IP� turda
F 1
, �
y 54. nSupercenter
riq 2.1 y,�Fe and the result is a
Query is for a generic 7Walmart
r daWalmart
. 2 a 6 bu
u
Sa 1723435
t .1 6 East
M Broadway 54 roffers
Walmart Supercenter store.2that more
.9� ary�1
�
IP Blvd, Tucson, AZ 85716 services than the average Walmart
Ma y�Ostore.
b 7,� User
2
intent has been met and therenis car 02to
riqno sneed
ue �M 4�fro
demote for service level. art m
[walmart] �ne
z
Relevance Excellent

Walmart Neighborhood
Market The query does not specify the type of Walmart,
5500 E 22nd St, Tucson, and any Walmart can be rated Excellent. Demote
AZ 85711 further for distance.

Relevance Good (User Intent)

Walmart Neighborhood Query is for a store with specific level of service.

[walmart Market Walmart Supercenters are very large stores that
supercenter] 5500 E 22nd St, Tucson, have a full range of grocery and general
AZ 85711 merchandise. A Walmart Neighborhood Market is
generally smaller with a more limited array of
grocery and general merchandise.
Relevance Good (User Intent)
Nordstrom The query is for an outlet store, but the result is for
[Nordstrom 55 E Grand Ave, Chicago,
rack] a full-price store. The result satisfies the query
IL 60611 intent, but to a lesser degree.
Bank of America Relevance Excellent
10900 Orangewood Blvd,
Orlando, FL 32821

[bank of When the query is for a bank or a general bank

Samerica] m
atu Bank of America ATM brand, an ATM or a branch location of that specific
2 4 �fro ez
IP� rda
17 y 10900 Orangewood Blvd, brand are equally relevant. 7 , � 20 art�n
2.1 ,�Fe 1 �M
6.2 bru Orlando, FL 32821 ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
b ,
Ma y�O ,�2 7
nri sc 024 r d ay .254. anriq
qu ar�M �fr tu 6 M
e art om Sa 172.1
IP �
�ne
z

62
 Query Result rom Rating and Explanation
0 2 4�f �nez
rt Relevance Excellent
�1 7,�2 r�Ma
ry a Sa
b r ua �Osc IP� turda
e y
a y ,�F 4.9�b rique 17
2.1 y,�Fe
d 6.25 an 6.2 bru
tur M
Sa 172.1 54
.9� ary�1
IP � Ma by�O 7,�2
nri sc 024
qu ar�M �fr
e om
artmany
The result is a bank branch location. Since �ne
Citibank branches contain ATMs, and would be able to z
3333 E Tropicana Ave provide the same level of service as an ATM, this
Las Vegas, NV 89121 result usually fulfills the user’s intent.

[ATM] Note that if research indicates the result does not

offer cash services, rate it Bad.

Relevance Excellent
Citibank ATM 7-Eleven
3421 E Tropicana Ave This is an ATM located inside a 7-Eleven
Las Vegas, NV 89121 convenience store. It satisfies the primary intent of
the category.
Relevance Bad (User Intent)
A user has asked for a specific fast food restaurant
McDonald’s and the result is another fast food restaurant that
[burger king] 6875 Sand Lake Rd, offers similar food and service. Even though the
Orlando, FL 32819 service level in the two restaurants is similar, this
result does not match the user intent for the
named restaurant.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

63
 m
5.19. Rating Relevance When Result 4 � fro eStatus
z is PERMANENT_CLOSURE
, �2 02 art�n
17 �M
a ry� scar A business/POI that has Sa its status set to
t
u �O
e b r y e PERMANENT_CLOSURE I P�1 urrequires
d special consideration
F
,� 4.9 riq �b u 72 ay,�F
a y
d 6.25 an during relevance rating. . 16 ebr
tur M .25
4.9 uary�
Sa 172.1 17
IP � Note: A result without any statusMa �byindicated , should be
nri �Osc �2024
rated as usual, including when research qu a indicates the
e r�M �fro
business/POI is closed or does not exist. art�n m
ez
There are some situations where you can expect to see results with the status
PERMANENT_CLOSURE and others where such results are not expected. The following sections will
describe how to identify and rate them.

5.19.1. Expected PERMANENT_CLOSURE Status m

Sa
t u 2 4 �fro ez
Sometimes
IP� rda you can expect to see results whose status is shown as PERMANENT_CLOSURE.
17 , � 20 art�n
y
2.1 ,�Fe 1 7 �M
6.2 bru ary� scar
This can happen u
.9� awhen: ebr 9�by�O ue
54 ry�
b 1 , � F
Ma y�O ,�2
nri sc 024
7
r d ay .254. anriq
• The permanentlyqu ar�M closed
�fro result satisfies the user intent [Link] 72.16 M
e
AND a rt�n m
IP � 1
• There is/are no other result(s) ez that satisfy the actual user intent in the area of location intent.

64
Examples of results where PERMANENT_CLOSURE m status is expected
f ro
24� �nez
• Navigational queries: 7,�20 Mart
• Queries that can a y�1 creturn
ronly ar� a single result, which is permanently
Sa closed. This could be
r u � O s tur
because the POI or business name is unique or the I
query containsy,�F location intents like
e b y e P da
y ,�F 4.9�b riqu �17
2
localityrdor street
a .25 Macomponents.
n . 16 ebr
.25
atu 72.16for closed
• Chain Squeries chains: 4.9 uary�
� 1 y 17,
Ma �bclosed
• All chain
IP locations within the area of location intent are permanently nri �Osc �2and
0 the closest
open chain result is significantly farther away. qu ar�M 24�fr
e art om
�ne
Rating Approach z

Rate results with an expected status of PERMANENT_CLOSURE as if they were open. This means
that in most cases the rating will be either Navigational or Excellent, because even though they are
closed, these are the best or only results that could ever be returned.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

65
[Link]. Expected PERMANENT_CLOSUREmStatus: Navigational Query
2 4 �fro ez
The user is looking for a unique , �20business
a rt�n in a specific location.
1 7 �M
a ry� scar Sa
t
u
F e b r
�b y � O
e I P�1 urda
y,� Query u User
72 and y,�F Viewport
a 5 4.9 nriq . 1
d
tur 2.16. Ma
2 6 .25 ebrua
S a
[99 bottles santa cruz] User and fresh [Link] 9�bSan
ry� Luis Obispo, CA
P � 17 M y 17
I an �Os ,�202
riq car
ue �M 4�fro
art m
�ne
z

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

66
 m
4 � fro ez
Result 2
�20 art�
n Rating and Explanation
1 7 , M
� ar �
ry Relevance Sa
Navigational
ua �Osc t
Fe b r
�b y e I P�1 urda
y,� 54.9 nriq u
Business/POI 72 y,�F
d a
r 16. Ma 2 .16 eb
① 99 Bottles u Closed/Does not Yes .25 rua
Sa Of Beer On The
t 2 . 4.9 ry�
� 1 7 �b 17
Wall I P exist M an y�Os ,�202
PERMANENT_CLOSURE riq car
This permanently closed restaurant is the only �M 4�fthat
ue result
110 Walnut Ave, Santa Cruz, CA art rom
meets the user intent, which makes it expected. Choose �ne the
z
Business/POI Closed/Does not exist checkbox and rate the
business as if it were open.
Relevance Bad (User Intent)
② 99 Cents Only Stores
260 E 10th St, Gilroy, CA The 99 Cents store does not match the user intent and is rated
Bad.
Relevance Bad (User Intent)
⓷ 99 Bottles & Cocktails While also a restaurant with a name that starts with 99 Bottles,
8901 Katella Ave, this is not in Santa Cruz, does not match the user intent, and is
Anaheim, CA rated Bad.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

67
 m
[Link]. Expected PERMANENT_CLOSURE 4 � fro eStatus:
z All chains closed in area
, �2 02 art�n
7
r y�1 car�M Sa to the user are across the
Chico’s has closed all of uits locations
a s in Canada. The closest locations t
e b r y � O I P�1 urda
border in the United FStates. �
y,� 54.9 nriq
b u e 72 y,�F
da
r 16. Ma2 .16 eb
t u .25 rua
Sa 172. 4.9 ry�
�by 17,
I P � Query User and
M anViewport
�O �2
riq scar 024�
[chico’s] u
Fresh viewport in Toronto, ON, euser�M fro
inaHamilton, ON
rt�n m
ez

Result Rating and Explanation

Relevance Excellent
Business/POI Closed/
① Chico’s Yes
Does not exist
PERMANENT_CLOSURE
100 City Centre Dr, The permanently closed location for Chico’s is in the center of the
Mississauga, ON fresh viewport. Since there are no open locations anywhere close
to the area, this result is expected. Choose the Business/POI
Closed/Does not exist checkbox and rate the business as if it
were open.
Relevance Excellent
m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru a ry� scar
u �O e
54 ar ebr 9the
�by border.
② Chico’sM .9�by y�17, The open Chico’s closest to the user is just across F
y 54 nriqu
, � .
a �O �2 rda 16.2Excellent.
5151 Main St,nriq scar 024� Because it is the closest open result, it isturated Ma
u
Williamsville, NY e
�M fro
art m Sa 172.
�ne IP�
United States z

68
 Result m Rating and Explanation
4 � fro ez
2 rt�n
⓷ Chico’s 7 , �20 Relevance
a Good (Distance/Prominence)
y �1 ar�M Sa
3349 Monroe Ave Ste 45, r
ua �Osc t
Rochester, NY e b r
b y e I P�1 urda
y,� F �
.9 iq u As the second-closest open location,
72 they Chico’s in Rochester is
United States urda 6.254 anr .16 ,�Feb
t M demoted to Good. .25 rua
Sa 172.1 4.9 ry�
�b 17
� M
I P an y�Os ,�202
riq car
ue �M 4�fro
art m
5.19.2. Unexpected PERMANENT_CLOSURE Status �ne
z
These are results whose status is shown as PERMANENT_CLOSURE, but are not expected to be
shown at all.

Results with the status PERMANENT_CLOSURE are unexpected when there are also open results in
the area of location intent that would satisfy the actual user intent fully without changing or altering
the user query.

Examples of situations where results with PERMANENT_CLOSURE status are not expected

• Category queries:
• There are always a large number of possible results for category queries like [restaurant]
or [hair salon]
• Note: In cases where there is only one match for the category query within a large area and
it is marked with the PERMANENT_CLOSURE status, consider it an exception and choose
Business/POI is closed or does not exist, then rate it as if it were open. This should be
extremely rare.
• Queries with several possible interpretations:
• These are queries could have several possible results and/or result types available, and do
not depend on PERMANENT_CLOSURE results.
• Most chain queries:
• There are often multiple locations of a chain available within the area of location intent, and
a permanently closed result does not need to be shown in these cases.

Rating Approach

Unexpected permanently closed results should be demoted by 2 for relevance which means the
highest rating starts at Acceptable.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

69
 m
[Link]. Unexpected PERMANENT_CLOSURE 4 � fro ez Status: Open Options are Nearby
2 n
7 , �20 art�
�1 r�M
ary Osca near the user for this category query,
There are many optionsruavailable Sa
t so there is no reason to show
e b y � I P�1 urda
a permanently closed F business.
�b
y,� 54.9 nriq u e 72 y,�F
da
r 16. Ma2 .16 eb
t u .25 rua
Sa 172. 4.9 ry�
�by 17,
I P � Query User and
M anViewport
�O �2
riq scar 024�
[vintage store] u �M fro DC
User and fresh viewport ineWashington,
art m
�ne
z

Result Rating and Explanation

Relevance Excellent
① Meeps Vintage
2104 18th St NW, Washington, Meeps Vintage matches the user intent and is close to the user
DC within the fresh viewport.

Relevance Excellent
② Miss Pixie's
1626 14th St NW, Washington, Miss Pixie’s sells vintage clothing and is among the closest
DC results for this category query. m
Sa �fro ez
IP� turda 2 4
�20 art�
n
⓷ Buffalo Bad or Acceptable
2.1 y,�FExchange
17 ,
Relevance 1 7 �M
6.2 ebru
PERMANENT_CLOSURE (User Intent) ary� scar
u
1318 14thMSt
54
.9NW,ar
�by yWashington,
�17 � F ebr 9�by�O ue
� , Business/POI Closed/ ,
ay .254. anriq
DC anri sc �2024
O Yes r d
qu ar�M �fr Does not exist tu 6 M
e art om Sa 172.1
IP �
�ne
z

70
 Result m Rating and Explanation
4 � fro ez
2
0 rt� n
�1 7,�2 r�MaThe permanently closed Buffalo Exchange did sell vintage
ry a clothing, but since there are other Sa open stores that do this in the
ua �Osc t
e b r y I P�1 urda
F �
y,� 54.9 nriq
b u e area of location intent, this result 72is unexpected.
y,�F The relevance
a . 1 e
tur
d 2
6. Ma rating starts at Acceptable. Given the 6 .25 abundance
br of nearby
Sa 172.1 results, this could be rated Bad, as 4.9 uary�
well.
IP� Ma �by�O 17,�2
nri sc 024
qu ar�M �fr
e art om
�ne
z

6. Name Accuracy
The Name Accuracy rating is used to evaluate the accuracy of a Business/POI name. Your final
rating will take into consideration both the accuracy of the Business/POI name and the classification
assigned to it. Inaccuracies in either or both of these elements will result in rating demotions.

Business/POI Name Accuracy can be rated as:

• n/a
• Correct
• Partially Correct
• Incorrect
• Can’t Verify

6.1. Name Not Applicable (n/a)

The n/a rating should be used for all address type results, including residential addresses, streets,
localities, and so on.

Unlike Business/POI type results, address type results do not actually have a result name. Instead, the
first line of address type results appears as the result title because this field is meant to present the
most relevant part of the address information.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

71
Since address results do not have a name, m their Name Accuracy cannot be evaluated. This is why the
ro
n/a rating should be selected. 24� nez f
0 rt�
�1 7,�2 r�Ma
ry a Sa
Result ua �Osc Rating andI Explanation
t
Fe b r
�b y e P�1 urda
,� 4.9 riq
ySt u 72 y,�F
1703 NW Taylor da
r 16. Ma 2 5 n Name Accuracy n/a
.16 eb
.25 rua
t u .
1703 NW Taylor
Sa 172St 4.9 ry�
�by of1a7,business or POI.
� This is a residential address, not the name or
P
Topeka, KS I66608 M antitle�O �2
riq scar 024�
ue �M fro
1600 Pennsylvania Ave Name Accuracy n/a art m
�ne
1600 Pennsylvania Ave, z
Although this is the address of a well-known POI (the White House), it
Washington, DC, 20500 is still an address result and contains no name or title. It cannot be
United States rated for Name Accuracy.
Name Accuracy n/a
Paris, France
Paris, France This is the name of a locality and country, not the name of a business
or POI.

6.2. Result Names

Your final Name Accuracy rating will take into consideration both the accuracy of the Business/POI
name and the classification assigned to it.

First, consider the name.

6.2.1. Correct Name

A business/POI result name is accurate when it is used on the POI’s official website or on other official
resources. Even if the official website does not use the name, if it is used on other official sources, the
name is correct. Note that the name has to be used to refer to the particular POI. The corporate name
by itself is not automatically the correct name.

Business Name

Every name that a specific business location uses to refer to itself is considered correct. These
names can be listed in a variety of ways in different sections of the entity's official website or official
social media website(s):

• Chain business locator page on the official website

S•a About/About Us section on an entity’s official website m
t u 2 4 �fro ez
n
IP•� rSigns
17 day,� and storefronts seen on official sites or social media pages 7 , �20 art�
• 2Claimed
.16 Feb social media pages 1 �M
.25 rua ary� scar
u
4.9 ry�
� 1 � F ebr 9�by�O ue
b ,
If these resources 7
Ma y�Oare,�not
nri sc 2024available, other reliable sources that can be used r
for
d 54. anriq business
ay researching
. 2
names include: que ar�M �fr tu 6 M
art om Sa 172.1
IP �
�ne
z
• Signs and storefronts seen on recent street or online imagery or crowdsourced review pages

72
 • Recent articles in primary publications m (newspapers or similar publications that do their own
ro
reporting) f
24� rt�nez
• Official restaurant menus , �2 0(user
a photos or scanned images from restaurants)
y �17 ar�M Sa
r
r ua �Osc I tur
If the name cannot �be Fe confirmed
b �b y
9 riq u e with these resources and there Pis�1nothing
72 ay,�F objectively wrong with it,
d
y , 4 .
rate it Can’t Verify.
a
d 6.25 an . 16 ebr
tur M .25
4.9 uary�
Sa 172.1
IP � Ma �by�O 17,�2
nri sc 024
qu ar�M �fr
e art om
Corporate name �ne
z
The corporate name (and sometimes brand or product name) is often used to refer to a particular
entity, but might be not the preferred name for a specific location. This depends on the particular
company and the specific result.

Some official websites have a local language and an international (English) version. Consider the
name given in the international version only if English is the language/script of the test locale, the
query, or the result region, or if the official company, chain, or brand name is commonly used and
understood in English in this market. If it is not, select the Result name/title is in unexpected
language or script checkbox. No further rating is required.

Result Name Official Business Name Rating and Explanation

Name Accuracy Correct

McDonald’s McDonald’s The chain calls all stores McDonald’s and has the
name in front of all locations as corporate
branding.
Name Accuracy Correct

Peet’s Coffee & The name is considered Correct, because it is

Peet’s - Polk Street used on the sign on the storefront. The store is
Tea
officially called “Peet’s - Polk Street” on the
website, as it refers to the Polk Street location.
Name Accuracy Correct

m
Sa
tur The chain Best Buy uses a location modifier 2 4 �fro ez
in
I
Best
P �17 Buy
da Best Buy San Jose 0 rt�n
2.1 y,�Fe 7,�2 r�Ma
their store names, but their store sign�1(logo)
6.2 bru
54 shows only the corporate brand name r u ary O“Best
sca Buy”
.9� ary�1 e b �by� e
and can be rated Correct. y,�F .9 iqu
Ma by�O 7,�2 4 r
nri sc 024 urda 16.25 Man
qu ar�M �fr t
Sa 172.
e art om
�ne IP�
z

73
 Result Name Official Business m Name Rating and Explanation
4 � fro ez
2 n
7 , �20 art� Name Accuracy Correct
y �1 ar�M S
ar sc atu
The MicrosoftIstorefront shows only the Microsoft
e bru �by�O e P �17 rday,
, � F . 9 i q u logo without any text.
2.1 Fethe webpage, stores are
On�
r day 6.254 anr b
6.2 Store”
u
MicrosoftSat 2.1 Microsoft M Store referred to as “Microsoft 54 ruar or named
17 .9� y�1
IP� together with a locationMmodifier b 7such as
an y�Os ,�202
“Microsoft Store – South Coast riq cPlaza”. Because of
u ar�M 4�fro
the close similarities between ethe result art name
m and
�ne
the store name, rate Correct. z

Location modifier or affiliation

Businesses can include the name of the locality or the larger complex or organization they belong to
as additional information. These modifiers, even when not specifically used by the official resources,
can be considered correct. A name with missing modifier can also be considered correct as long as
the modifier isn’t crucial for understanding the particular result. If a modifier is present, it must be
spelled correctly. If it is misspelled, the name is partially correct.

See your Country Specific guidelines for cases where the location modifier is essential for
understanding the result.

Result Name Official Business Name Rating and Explanation

Name Accuracy Correct

Apple Apple Valley Fair The result name is missing the location modifier
(Valley Fair) given on the official website, but is still
considered Correct.

Name Accuracy Correct

Peet’s Coffee Peet’s – Ferry Bldg SF The result name is Correct because it is used as
the name on the official website, while the specific
m
Sa store has an optional location modifier. �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
54 Name Accuracy u
Correct ebr �by�O e
.9� ary�1
M by�O 7,�2
Old Navy –aBelle d ay,�F 54.9 nriqu
nri sc Old0
a 24Navy Old Navy doesn’t officially .2 M
r use the mall
a name as
Isle Station que r�Ma �from S atu 72.16
rt�n part of the store name, but
P�1 the location modifier is
ez correct, so the businessI name is rated Correct.

74
 Result Name Official Business m Name Rating and Explanation
4 � fro ez
2 n
7 , �20 art� Name Accuracy Correct
Delgado 1 �M
a ry� scar Sa
Community u
br �by�OSchool
eCharity IP� turda
� F 9 rique of The result for the 1Nursing
72 y,�F School includes the name
College – a y ,
5 4 . .1
d
tur .16. Ma
2Nursing n e
25 brua with. Even though
of the college that it [Link]
Charity School
Sa 172of 4.9 ry�
Nursing IP� this form is not official, itMis rated
�b 1Correct.
7
an y�Os ,�202
riq car
ue �M 4�fro
art m
�ne
z
Stylized logos and letters

A variation is still correct when a business uses stylized logos and letters (like the backwards “R” in
Toys ”R” Us) that are outside the regular set of letters.

Result Name Official Business Name Rating and Explanation

Name Accuracy Correct

Toys ‘R’ Us Toys Я Us This business uses a special character in its name,
so the name is still considered Correct.

“The” is missing or added

• Missing: The use of definite articles depends on the individual result. When a company using
“the” is often referred to without it, the name is correct both with and without the article.
• Added: A business/POI that does not officially include a definite article in its name but has one
included in the result should be considered partially correct.

Result Name Official Business Name Rating and Explanation

Name Accuracy Correct

Home Depot The Home Depot The official name of this business is “The Home
Depot,” but since it is so often referred to as
“Home Depot” the name is considered Correct.

6.2.2. Partially Correct Name

A partially correct name differs from the official versions but can still be recognized by the user.
Partially
Sa correct names can include minor and moderate misspellings, service level mismatches,froand m
� z
missingt
IP� rdor
u
a
unnecessary name parts, including holding names/corporate structures. When the
� 2 0 2 4
r t �ne
17 , Mthe a
business 2.1 yname
,�F on the storefront does not include the corporate status (Ltd., Inc., etc.) seen
y �17 arin �
6.2 ebru a r c
result, it is partially
54 correct. bru �by�O e
s
.9� ary�1 � F e 9 u
Ma by�O 7,�2 ay, .254. anriq
n s 0 r d
[Link]. Minor and r iquModerate
c a 2 4 Misspellings and Missing or Extra Words tu 6 M
e r�Ma �from Sa 172.1
rt�n IP �
ez
Consider names partially correct when they contain issues that don’t prevent the user from
identifying the business:
75
 m
• Name contains repeated, redundant, 4 � fro ez or missing information or parts
2 n
• Incorrect or missing punctuation 7 , �20 art� or special characters
1 r�M
• Unnecessary or missing a ry� scaspaces Sa
t
u
• Unexpected �use Fe of
b r
�b y � O
lower/uppere case and ALL CAPS I
lettersP�1 urda
y, [Link] 9 riq u 72 y,�F
• Acronymsd a
r 16. Ma 2 n often expected in ALL CAPS: YMCA, TGIF .16 eb
.25 rua
t u
• MinorSaand 1 7 moderate
2 . misspellings that don’t influence the user’s understanding.
4.9 ry� See your
� M �by 17,
Country-Specific
I P guidelines for more information on misspellings. an �Os �20
riq car 24�
• Mix of expected languages in the result title. Expected languages are the uelanguages
�M froof the
query, test locale, or region, or of an official business name. art m
�ne
z

Result Name Official Business Name Rating and Explanation

Name Accuracy Partially Correct
Macys Macy’s
The result is missing an apostrophe.

Name Accuracy Partially Correct

HM H&M
Missing the “&” in H&M is a misspelling but the
name is still recognizable.

Name Accuracy Partially Correct

uhaul uhaul U-Haul

The result name is duplicated and in all lowercase
with no “-”.

Name Accuracy Partially Correct

Seven Eleven 7-Eleven The name is in an unexpected form not used by the
business itself.
Name Accuracy Partially Correct
GAMESTOP GameStop The name written in ALL CAPS is not expected for
this business and demoted.
Name Accuracy Partially Correct

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
Mosjaw6.25 brua Moosejaw ary� scar
The name of this outdoor store has u two missing
4.9 ry� ebr by�O e
Ma �by�O 17,�2 letters but is still [Link],�F 54.9� riqu
nri sc 024 d 2 n
qu ar�M �fr atur 2.16. Ma
e art om S 17
�ne IP�
z

76
 Result Name Official Business m Name Rating and Explanation
4 � fro ez
2 n
7 , �20 art� Name Accuracy Partially Correct
y �1 ar�M Sa
r
Ecofuture ua �Osc t
e b r
Ecofutures
�b y e Building Inc
I P�1 urda
Buildng Co F
y,� 54.9 nriq u The business shows 72 two
.
y,�Fmisspellings and the
a 1
tur
d 2
6. Ma 6
incorrect business structure.25 ebru(Co. vs. Inc.).
Sa 172.1 4.9 ary�
IP� Ma �by�O 17,�2
n sc 02
Name Accuracy PartiallyriqCorrect ue ar�M 4�fro
art m
�ne
z
Napoli The result name has additional parts not used by
Coffeehouse & Napoli Coffee the business. Because the additional parts are in
Pastries line with the business and don’t make the result
ambiguous, it is considered Partially Correct.

Name Accuracy Partially Correct

The additional “superstore” is not used officially,

GAP Superstore GAP but also does not change the user’s ability to
identify the well formatted and correct corporate
name and is therefore considered Partially
Correct.

Name Accuracy Partially Correct

BerkeleyLaw BerkeleyLaw The query [law] was issued in a cz_CZ (Czech)

Univerzitní of University of locale and the result locale is the US (English).
California California Consider this Partially Correct due to the mix of
expected languages: English and Czech.

Name Accuracy Partially Correct

Aqua Spa 夢幻⽔ Aqua Spa - Ocean The query [aqua spa] was issued in the zh-Hant_HK
都Sa City (Hong Kong) test locale and the result locale is in m
t u the US (English). Consider this Partially Correct 2 4 �fro ez
IP� rda 0 rt�n
17
2.1 y,�Fe due to the mix of expected scripts. �17,�2 r�Ma
6.2 bru
54 r u ary Osca
.9� ary�1 � F eb 9�by� ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

77
 Result Name Official Business m Name Rating and Explanation
4 � fro ez
2 n
7 , �20 art� Name Accuracy Partially Correct
1 �M
a ry� scar Sa
u
ebr 9�by�O ue IP� turda
, � F . iq URLs can give an1indication
72 y,�F of a businesses’ official
u r day 6.254 anr .16 eb
name, but because a URL .25 lacks
r formatting choices,
t
Sa 172.1
M 4.9 uary�
� it should generally not beMaused
�by to17confirm the
IP ,
nri �Orestrictions
att AT&T official business name. Similar sca �2024 exist for
qu
e r�Ma �from
certain social media such as Twitter. rt�n
ez
The company’s name is confirmed by the URL
([Link]), but the name stated in the URL, “att”, is
clearly poorly formatted, but still recognizable.

Name Accuracy Partially Correct

University of University of California Irvine is more than a location modifier for this
California Irvine university. The city name differentiates the Irvine
location from other universities in the University of
California network.

Name Accuracy Partially Correct

Even though the Nike symbol appears on this

Nike NIKELAB 21M NYC store’s official website, the preferred store name
for this specific location is not the general brand
name but the NIKELAB name seen on the store
sign and website.

Name Accuracy Partially Correct

The Sears Sears Sears does not use “The” in any of their official
webpages. Adding it to the company name gives
the name a rating of Partially Correct.

[Link]. Service-Level Mismatch

m
Sa businesses often indicate the level of service provided at that location in their name. If the
Chain t u 2 4 �fro ez
IP� rda
result
17 namey does not reflect the correct type, it is considered a service-level mismatch and
7 , � 20is art�n
2.1 ,�Fe 1 �M
considered 6.2 partially
bru correct. ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
b ,
Ma y�O ,�2 7
nri sc 024 r d ay .254. anriq
qu ar�M �fr tu 6 M
e art om Sa 172.1
IP �
�ne
z

78
 Result Name Official Business m Name Rating and Explanation
4 � fro ez
2 n
7 , �20 art� Name Accuracy Partially Correct
y �1 ar�M S
ar sc a
e bru �by�O e IP� turda
17
Patagonia Outlet
da y,�F Patagonia
5 4.9 nriqu The result name 2.1 y,�Fethat the store is an outlet,
suggests
2
6. Ma 6.2 bru
tur
Sa 172.1 which it isn’t. 54
.9� ary�1
IP � Ma by�O 7,�2
nri sc 024
qu ar�M �fr
e art om
Name Accuracy Partially Correct
�ne
z
Depending on its size and the services available,
Delhaize Delhaize Supermarkt this chain business comes in five varieties. The
result is missing part of the name indicating its
service level.
Name Accuracy Partially Correct

Best Buy Best Buy Express A Best Buy Express is a vending machine and not a
store. This is a service-level mismatch and
considered Partially Correct.
Name Accuracy Partially Correct

Best Buy Express Best Buy The user is expecting a vending machine where
there is a store. This is a service-level mismatch
and considered Partially Correct.

J"G"G"N"%OAC,>B?%19M)%9B,%4AE(AE9+)%7+E:*+:E)

Holding names or corporate structures are not considered correct if they are not explicitly used by
the individual stores. Holding names or names that include corporate structure are considered
partially correct or incorrect depending on how recognizable the name is in context with the particular
business.

Result Name Official Business Name Explanation

Name Accuracy Partially Correct

IT’SUGAR LLC IT’SUGAR The addendum “LLC” refers to the corporate

structure and should not be used for the store,
However, this name is still recognizable. m
Sa �fro ez
IP� turda 0 2 4
t�n
17
2.1 y,�Fe Name Accuracy Partially Correct 17,�2 Mar
�
6.2 bru a ry� scar
The addendum “Inc.” refers to the u
54
.9� ary�1 F ebr 9company’s
�O
�by que
Nordstrom, Ma Inc.
by 7,Nordstrom corporate structure and should , �
y not .
4 beriused for
nri �Osc �2024 u rda 16.25 Man
qu ar�M �fr the store. However, the
Sa store
t . can still be
e art om recognized. P � 172
�ne I
z

79
 m
6.2.3. Incorrect Name 4 � fro ez
2 n
7 , �20 art�
An incorrect result name isryone �1 athat �M
u a s c r can’t be recognized because Sof atusevere misspelling or ambiguous
or unnecessary/missing b r parts
e 9�by ue � O in the name. I P�1 rda
, � F
y 54 nr . i q 72 y,�F
da
r 16. Ma 2 .16 eb
t u .25 rua
Sa 172. 4.9 ry�
�b 17
Consider names
I P � incorrect when they contain issues including: M an y�Os ,�202
riq car
ue �M 4�fro
• Severe misspellings that prevent the user from identifying the business becausearof: t�n m
• Change in meaning ez
• Misspelling that results in an entirely different word or gibberish
• Holding names that are completely different than the recognized name
• Unnecessary or missing parts in the name that prevent the user from recognizing the
business
• Slang and inappropriate language
• Using the previous name of the same entity that is not a variation of the current name and
therefore cannot be identified

Note: If a result name is incorrect, the final Name Accuracy rating will always be Incorrect, even if
the classification is correct.

Result name Official Business Name Rating and Explanation

Name Accuracy Incorrect

JAB Holding
Peet’s Coffee The holding company name is completely
Company
different than the store name.

Name Accuracy Incorrect

m
IEA
Sa
IKEA �fro ez
IP� turda In short business names, even small errors 2 4
�20canart�
n
17 y 7 ,
2.1 ,�Fe prevent the user from recognizing the 1 ar�M
6.2 bru ary�business.
sc
54 u
br �by�O e
.9� ary�1 e
Ma by�O 7,�2
d ay,�F 54.9 nriqu
nri sc 024
qu ar�M �fr tur 6.2 Ma
e art om Sa 172.1
�ne IP�
z

80
 Result name Official Business m Name Rating and Explanation
4 � fro ez
2 n
7 , �20 art� Name Accuracy Incorrect
1 �M
a ry� scar Sa
tur
u
br �by�O e
Zatas Tacos + y,�FeZacatecas Tacos + The misspellingIPis�17severe
da and does not allow the
4.9 nriqu 2.1 y,�Fe
Tequila da 5
6. Tequila
2 user to identify the business
6.2 bruwith certainty. The
tur Ma
Sa 172.1 54
.9� ary�1 that it is a
user is likely under the impression
IP� different restaurant. Ma by�O 7,�2
nri sc 024
qu ar�M �fr
e art om
Name Accuracy Incorrect �ne
z

The misspelling changes the meaning, which

Taco Bull Taco Bell makes the name ambiguous: It could be a “Taco
Bell” chain store or a different business named
“Taco Bull”.

Name Accuracy Incorrect

With the unnecessary word “Pizza,” the name

Walgreens Pizza Walgreens becomes ambiguous and the user does not know if
this is a pizzeria named Walgreens or a wrongly
labeled Walgreens pharmacy.

Name Accuracy Incorrect

Cheesecake The Cheesecake Factory When missing the word “factory”, the result name
“Cheesecake” is not specific enough and the chain
business cannot be identified with certainty.
Name Accuracy Incorrect

UPS USPS USPS (United States Postal Service) and UPS

(United Parcel Service) are both in the delivery
business, but are entirely different companies.

Name Accuracy Incorrect

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe& 1 7 �M
Starbucks6.2 bru Marks & Spencer ary� scar
By switching Marks with Starbucks, u
Spencer 54.9 ary� F ebr 9�the
by� business
O
e
Ma �by�O 17,�2 can no longer be [Link] 54 nriqu
, � .
nri sc 024
qu ar�M �fr tur 6.2 Ma
e art om Sa 172.1
�ne IP�
z

81
 Result name Official Business m Name Rating and Explanation
4 � fro ez
2 n
7 , �20 art� Name Accuracy Incorrect
1 �M
a ry� scar Sa
Mickey D’s u
eMcDonald’s
br �by�O e IP� turslang
Mickey D’s is British da for McDonald’s brand.
F 17 official
y
da y 54.9 nriqu
, � However it is not an 2.1 Fe variation of the brand
, �
tur 6.2 Ma name. 6.2 bru
Sa 172.1 54
.9� ary�1
IP� Name Accuracy
Ma by�O 7,�2
Incorrect
nri sc 024
qu ar�M �fr
e art oon
Showing a former name that is not shown �ne the
m
Bridgestone arena’s official webpage is not a good experience.z
Sommet Center
Arena Even when the name might still be in use among
users, if a result shows a former name, rate it
Incorrect.

6.3 Result Classification

Once you have determined the correctness of a result’s name, you will have to evaluate the accuracy
of its classification in order to determine the final Name Accuracy rating. The classification of a result
refers to the category of the Business/POI.

Not every result will include a classification, but when one appears, you will find it below the address
details

If the classification is missing or listed as N/A, make your final Name Accuracy rating based on the
name alone.

6.3.1. Correct Classification

When a business or POI is classified correctly, the classification accurately reflects the business,
service, or function of the entity. This includes broad or alternate classifications that are not the
preferred choice but are not misleading.

A correct name paired with a correct classification is rated Correct for Name Accuracy.

• Not every result will include a classification. If the classification is missing or listed as N/A, do
not demote.
• Some classifications may seem slightly too specific or too general. As long as the
classification is not misleading, consider it correct. m
Sa
• t u Classifications can vary for similar POIs and vary per market. Localization of categories 2 4 �fro ez
IP� rda
17 shouldy be taken into account when deciding if a classification is appropriate. 7 , � 20 art�n
2.1 ,�Fe 1 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
b ,
Ma y�O ,�2 7
nri sc 024 r d ay .254. anriq
qu ar�M �fr tu 6 M
e art om Sa 172.1
IP �
�ne
z

82
 m
4 � fro ez
Result Name and 2 n
, �20 art� Rating and Explanation
Classification y � 7
1 ar�M
r Sa
ua �Osc t
Fe b r
�b y Name e Accuracy Correct I P�1 urda
y,� 54.9 nriq u 72 y,�F
d a 2 .16 eb
RestaurantaToqué
tur 2.16. Ma Restaurants are commonly classified by their.25respective r
S 4.9 uary� cuisines.
French 1 7
‘French’ refers to French cuisine or a French restaurant
Ma �by�O 17and is an
IP� ,
nri sc �2024
appropriate classification for the result. qu a
e r�Ma �from
rt�n
Name Accuracy Correct ez
Jocko’s World Famous
Chicken and Seafood This classification may seem a bit too specific but it is not misleading.
Seafood Although this restaurant sells more than just seafood, categorizing it as a
seafood restaurant still properly reflects the nature of this entity.
Name Accuracy Correct

Walmart As long as research shows that the particular Walmart location

Grocery represented by the result sells groceries, this would be an appropriate
classification. This is because grocery is a major department in this store
and represents a large part of what it sells.
Name Accuracy Correct
Walmart
Discount Store This classification accurately represents the POI. Walmart is known to
offer merchandise at low prices.

6.3.2. Incorrect Classification

When the classification is wrong, the final Name Accuracy rating is always Incorrect. This is true
whether the result name is Correct, Partially Correct, or Incorrect.

Consider the classification incorrect when it is:

• Wrong
• Misleading
• Misspelled
• Incomplete (missing parts or has uncommon/odd abbreviations)
• In an unexpected language/script. The classification must match the language/script of the
query, test locale, or result region
m
Sa
t u 2 4 �fro ez
IP� rda
17 y 7 , � 20 art�n
2.1 ,�Fe 1 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
b ,
Ma y�O ,�2 7
nri sc 024 r d ay .254. anriq
qu ar�M �fr tu 6 M
e art om Sa 172.1
IP �
�ne
z

83
 Result Name and Expected m
� fro ez Rating and Explanation
Classification Classification
2 4 n
7 , �20 art�
1 �M
a ry� scar Name Accuracy SIncorrect
a
u
ebr 9�by�O ue IP� turda
F 17
, � . iq 2.1 y,�Fe
u r day 6.254 anr 6.2 bru
Denver Zoo t
Sa 172.1
M
Classification is wrong since54 thearresult is a zoo. This
� Zoo .9
Ma �by�Othe
y�1
Active Life IP classification does not represent 7,
nri sc �nature 20
24
of the
result. Final Name Accuracy rating a
e is �Incorrect.
q u r Ma rom� f
rt�n
ez

Name Accuracy Incorrect

Macy’s The result is a department store and should not be
Bar Department Store categorized as bar. Final Name Accuracy rating is
Incorrect.

Name Accuracy Incorrect

Classification is misleading. The result is a
department store and it should be categorized as
one. Although this store does sell shoes, the
Macy’s classification does not reflect the wide variety of
Shoes Department Store other merchandise it offers. It is misleading to
categorize this result as simply a shoe store. Final
Name Accuracy rating is Incorrect.

Name Accuracy Incorrect

Classification is misleading. Pondok Djaja is a
restaurant in Jakarta famous for its chicken dishes,
but the classification “Daging Ayam” or “Chicken
Meat" is more appropriate for a poultry butcher than
a restaurant. The classification “Restoran Ayam” or
“Chicken Restaurant” is more appropriate. Final
Pondok Djaja Name Accuracy rating is Incorrect.
Daging Ayam Restoran Ayam

translation of translation:
classification: Chicken Restaurant
Chicken Meat m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

84
 Result Name and Expected m
� fro ez Rating and Explanation
Classification Classification
2 4 n
7 , �20 art�
1 �M
a ry� scar Name Accuracy SIncorrect
a
u
ebr 9�by�O ue IP� turda
F 17
, � . riq 2.1 y,�FeAny misspelling in the
Classification is misspelled.
Fry’s Electronics day 6.254Electronics
n .25 brua
u r
Electrnics Sat 72.1 Ma classification should be6considered
4.9 ry� wrong. Final
IP�
1 Name Accuracy rating is Incorrect.
Ma �by�O 17,�2
nri sc 024
qu ar�M �fr
e art om
Name Accuracy Incorrect �ne
z

Macy’s Classification is incomplete. The classification shown

Department Store is not a common abbreviation for “Department Store”
Depart Store
and appears incomplete. Final Name Accuracy rating
is Incorrect.

Name Accuracy Incorrect

Test Locale: Germany

Classification is in unexpected language or script.
Aral The classification “Gas Station” is in English instead
Tankstelle of the expected German word “Tanskstelle.”
Gas Station
English should be considered an unexpected
language in this locale (even if it could be understood
by a user there). Final Name Accuracy rating is
Incorrect.

Name Accuracy Incorrect

The result name should be considered partially
correct because it does not include the proper
Macys Macy’s punctuation: Macys should be Macy’s. The
Bar Department Store classification of Bar for this department store is
wrong.
When the name is partially correct and the
classification is wrong, rate Name Accuracy
Incorrect.
m
Sa
t u 2 4 �fro ez
IP� rda
17 y 7 , � 20 art�n
2.1 ,�Verify
F 1 �M
6.4. Can’t 6.2 ebru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
When, dueMto b
ana lack
y�O of,�2available data online, the business or POI name cannot aybe.2confirmed,
54. anriq rate
7 ,
r s c 0 2 r d
Can’t Verify. This iqu can a be4because of a lack of official resources or streetatuimagery
S 172.1 or can be the case
6 M
e r�Ma �from
for small businesses that rdon’t t�n maintain their own webpage or social media IP profile.
�
ez

85
6.5 Transit Names m
4 � fro ez
2 rt�n
Transit stations and other transit 7 , �20 results
a (like airports and shipping ports), are often named after the
locality or street where they y � r �M
1arealocated and can include a transit indication
Sa such as "Station" or
r
r ua �Osc tur
“Subway.” The transit e indication
b y in the result name/title is consideredI P�1 optional
d and can be missing
9�b rique
,�F 4correct.
. 72 ay,�F
and still be considered
a y
rd 16.25 Man The user query for [san mateo station]
. can
16 ebr therefore return the
t u . 2 u
name San Mateo
Sa 172Station
. or simply San Mateo to be Correct. The classification 5 4.9 ofary� the result will help
�
you correctlyIPinterpret the result because classifications for transit POIs should Ma �by�O be17a, reference to
nri sc �2024
transit. qu ar�M �fr
e art om
�ne
Keep in mind that some transit POIs located on street intersections may have a result title that z is the
name of the street intersection (e.g. “Lincoln Way & 19th Avenue”). This is also considered Correct.

If there are multiple transit systems operating out of the same station, any of the systems can be
included in the name to be Correct. If transit stations are close to each other, but users have to walk
outside to get from one building to another, consider the results for the two stations as two separate
POIs.

Query Result Rating and Explanation

Millbrae Name Accuracy Correct
Millbrae, CA “Millbrae” has no transit indication in the result
Classification: Train Station name, but the classification indicates it is a train
[Millbrae station.
station] Millbrae BART Name Accuracy Correct
Millbrae, CA “Millbrae BART” has a transit indication for the
User and Classification: Train Station
viewport BART system in the result name.
in Palo Alto, CA Millbrae Amtrak Name Accuracy Incorrect
Millbrae, CA “Millbrae Amtrak” has an incorrect Amtrak transit
Classification: Train Station indication. Only BART and Caltrain operate from
Millbrae station.

6.6. Parking Names

A parking lot may or may not have a name. Confirm this on the lot’s official webpage:

• The generic names “Parking,” “Garage,” or “Lot” (or any other words that indicate parking
can take place at the location) are considered Correct when no official name can be found. om z
Sa �frany
• t u If an official name can be found, rate the generic names “Parking,” “Garage,” or “Lot” (or
2 4 e
IP� rda
17 other y words that indicate parking can take place at the location) as Partially Correct.7 , � 20 art�n
2. ,�Fe y�1 car�Mname
• If16the .25 parking
bru lot is specialized (for instance, motorcycle-only parking), and the a rresult’s
r y�Os
u
ary
4.9 reflect bname
doesn’t � that specialization, the result should be rated Incorrect for
F e �b accuracy.
e
Ma �by�O 17,�2
d ay,� 54.9 nriqu
nri sc 024 r 16.2 Ma
Accept the following
qu ar�M �fr
e combinations of names as Correct if no official nameatu is .
art mo S
P � 172found:
�ne I
z
• (Business name/Plaza name/Shopping area name) + (parking/ garage/lot)

86
 • Without the addition of parking/garage/lot, m the name is Incorrect
ro
• Parking/ Garage/Lot (or any �other
f ez words that indicate parking can take place at the location)
, �2 024 art�n
17 �M
a ry� scar Sa
t
u �O
Fe b r
�b y e I P�1 urda
y,� 54.9 nriq u 72 y,�F
da
r 16. Ma2 .16 eb
t u .25 rua
S a 72. 4.9 ry�
QueryP�1 Result Rating and M Explanation
�b 17
I an y�Os ,�202
riq car
Name Accuracy Correct
ue �M 4�fro
Union Square Garage art m
�
This garage’s official website confirms itsnename.
z

Parking Name Accuracy Partially Correct

(Result is for the Union Research shows that the official name for this
Square Garage) parking location is Union Square Garage
Safeway Parking Name Accuracy Correct
(Result is for the parking
[Parking] lot attached to a This parking lot has no official website or name, but
Safeway store in San is associated with a Safeway store.
User and viewport Francisco)
in San Francisco, CA
Parking Name Accuracy Correct
(Result is for the parking
lot attached to a
Safeway store in San This parking lot has no official website or name.
Francisco)
Safeway Name Accuracy Incorrect
(Result is for the parking
lot attached to a Without the words “Parking,” “Garage,” or “Lot,”
Safeway store in San users will have no way to know they can park at this
Francisco) Safeway.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

87
6.7. Final Name Accuracy Rating (Summary m Table)
� f ro
ez
, �2 024 art�n
7
This table shows the finalarratings y�1 car�M produced by different combinations
Sa of name correctness and
u �Os t
classification accuracy. Fe b r
�b y e I P�1 urda
y,� 54.9 nriq u 72 y,�F
d a
r 16. Ma 2 .16 eb
t u . .25 rua
Name/Title SaCorrectness
1 7 2 Classification Accuracy Final Name 4.9 ry� Rating
Accuracy
�b 17
� M
I P an y�Os ,�202
Correct Correct or N/A Correct riq car
ue �M 4�fro
art m
Correct Incorrect Incorrect �ne
z
Partially Correct Correct or N/A Partially Correct

Partially Correct Incorrect Incorrect

Incorrect Correct or N/A Incorrect
Incorrect Incorrect Incorrect

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

88
7. Address Accuracy: Components
rom
and Issues
0 2 4�f �nez
Address Accuracy is split into �2 main
7,two M art parts: Components and Issues and Result Expectation. This
�1 ar �
section will discuss Components ry Swill
r ua �Osc and Issues and the next section I
atu discuss Result Expectations.
, � Fe b
. 9
y
�b qu e P �17 rday,
y 4 r i 2.1 �Fe
rda 16.25 Man
7.1. AddresstuComponents 6.2 bru
54
Sa 172.
� .9� ary�1
IP Address components are the elements used Mato bform
y 7,� address details
nri �Osc the 20
2
for each result. These components include street number,q u a r �M 4unit/apt,
�f
e art rom
street name, locality, region/state, postal code, and country.�nThe ez
components are defined in these guidelines with a global approach in
mind. There may be variations for specific markets that are not
addressed here. See your Country Specific guidelines for more
information on the address component requirements for each type of
result.

This section covers the issues that can be associated with the address
components as well as the possible issues that can be associated with the address itself. It refers to
the checkboxes presented in the rating interface when Incorrect is selected. Checkboxes should be
selected for incorrect or missing information. Issues can occur within parts of the address or the
entire address.

Choose all identified incorrect or missing components. If the issue is not tied to individual
components but to an issue pattern, choose the appropriate issue instead.

Never select issues and components at the same time to report the same problem. That is, do not
rate Incorrect —Language/Script issue for the entire address and also Incorrect—Street Name
because street name is in an incorrect language.

When a Language/Script issue is present, make sure to check the address components for
accuracy and to select the appropriate checkbox. For instance, if you select language issue for the
entire address, you can also mark street number as incorrect, since this is an error that's not
language related.

7.1.1. Street Number

If the result address has an incorrect or missing street number rate Address Accuracy as Incorrect –
Street Number.
m
Sa �fro ez
IP� turda �
2 4
20 art�n
17 Result Official Address Rating and Explanation �1 r�M ,
2.1 y,�Fe 7
6.2 bru
54 r u ary Osca
.9� ary�1 Address Accuracy Incorrect � F
�
eb– 9Street
�by queNumber
7-ElevenMa by�O 7,�2 834 E Fremont Ave, , . i
nri sc 024 day 254 anr
836 E Fremont quAve,ar�M Sunnyvale,
�fro CA tur 2.16. because
Select the Street numberacheckbox M the
e S 17
Sunnyvale, CA 94087 94087, a rt�n m USA street number in the result
IP �address is incorrect.
ez

89
 Result Official Address m Rating and Explanation
4 � fro ez
2 n
Defour �20 art� 47,
Potgieterstraat
7 , Address Accuracy Incorrect – Street Number
y �1 ar�M S
ar OscXS
Potgieterstraat, 1053 ru1053 Select the StreetInumber
atu checkbox because the
�
b y
XS Amsterdam, ,�F .9Amsterdam,
e �b qu e street number is
P �17 rdayin
missing
y 4 nri 2.1 ,�Fthe result address.
Netherlands turda 6.25 Netherlands 6 e b
Ma .25 rua
Sa 172.1 4.9 ry�
�b 17
� M
I P an y�Os ,�202
The way street numbers are assigned varies by country and area. Some patterns riq youc may
ue ar�M 4�f see:
art rom
�ne
Street Number Extensions z

Some markets use a street number extension system. Street number extensions are part of the street
number, not a further breakdown of it like building or unit numbers. If a street number extension is
incorrect or missing from a POI address it should be treated as an incorrect/missing street number.
Refer to Country Specific Guidelines for more details.

Result Official Address Rating and Explanation

Address Accuracy Incorrect – Street Number
Elkjøp Halden Walkersgate 8c, In Norway, street number extensions are part of the
Walkersgate 8, 1771 1771 Halden, street number and are not unit numbers. The street
Halden, Norway Norway number in the result is missing a street number
extension ‘c’ which is listed as part of the official street
number.
Address Accuracy Incorrect – Street Number
REMA 1000 Tynset Elfengveien 4 B, In Norway, street number extensions are part of the
Elfengveien 4 A, 2500 Tynset, street number and are not unit numbers. The street
2500 Tynset, Norway Norway number in the result has an incorrect number
extension ‘A’ when ‘B’ is listed as the official street
number extension.

Address Range

Address ranges are used to assign numbers to a stretch of road. Given the nature of these ranges,
not all numbers will have a building assigned to them.

When an address range is given by the query or returned as a result, consider it Correct when:

• The result street number is within the queried range

S•a The result address range exists and contains the queried street number m
�fro ez
t u
IP•� rThe range or number matches the odd/even numbering system for left/right side of�2street 2 4
0 art�n
17 day,� 7 ,
2required
.16 Feb by the country 1 �M
.25 rua ary� scar
u
4.9 ry�
17 to POI addresses. F ebr 9�by�O ue
The same M criteria
�by apply
an �Os ,�202
, �
ay .254. anriq
riq car r d 6
�M 4�fro tu M
ue
art m Sa 172.1
IP �
�ne
z

90
 Suggestion OfficialroAddress
m Rating and Explanation
4 � f ez
2 n
7 , �20 art� Address Accuracy Correct
The Crutched Friar 1 �M
ry� scar S
No need to select
IP� tuthe
rda Incorrect – Street Number
u a a
39 Crutched Friars, ebr by�O e
London
� qu
y,�F 54.9 39-41 checkbox since1the 72 street
y,�F number in the
a nri Crutched Friars, . 1 ebr
r d 6 . 2 a suggestion is within the6 .25 official address range.
t u
Sa 172. 1 M London EC3N 2AE, 4.9 uary�
� United Kingdom �b 17
IP Address Accuracy MIncorrect an y�Os ,�–20Street Number
The Crutched Friar riq car 24�
u f
45 Crutched Friars, Select the Incorrect – StreeteNumber �M checkbox
art rom
London because the street number in the suggestion �ne
z is
outside of the official address range.
Address Accuracy Incorrect – Street Number
26 Winchester
25-27 Winchester
Avenue Select the Incorrect – Street Number checkbox
Avenue, Burpengary
Burpengary East Qld
East Qld 4505 Australia because the number 26 is even while the official
4505 Australia address range is odd.

Address Accuracy Incorrect – Street Number

Select the Incorrect – Street Number checkbox
Rua de Dom Hugo 17 because the street range in the suggestion does
Apartamentos Oporto 4050 Porto
Rua de Dom Hugo 1-45 Portugal not exist. This is a random address range and
Porto should be considered incorrect even if it contains
the official street number.

7.1.2. Unit/Apt

A street number can be divided into unit, apartment, or building numbers. Commonly seen forms
include the use of letters: A, B, C as well as the character # in front of a number: #420. Less common
are forms like ½.

A unit number should be correct and present when the official address of a business/POI contains a
unit number.

When a business does not list a unit number and the unit number cannot be confirmed, no unit
number should be given in the result. Rate Incorrect – Unit/Apt when unit number is present in the
rating tool in these cases.

Result Official Address Rating and Explanation

Free
Sa People Address Accuracy Correct m
tur 2 4 �fro ez
333 n
I P �17Santana
da
y Row This is the correct address listed on the official 7 , �20 art�
2 .16 ,�Feb
Suite #1110 website of the business.
1
ry� scar
�M
. rua a
San Jose,25CA 4.9 95128
ry
u
ebr 9�by�O ue
Ma �by�O �17,�2 , � F
ay .254. anriq
nr sc 024 Address Accuracy r d
Incorrect 6 –M Unit Number
Free People ique ar�M 333 tu
�froSantana Row Sa 172.1
333 Santana Row a rt�n m#1110
Suite This result address is missing
IP� the unit number listed
ez on the official website. Unit number checkbox should
San Jose, CA 95128 San Jose, CA 95128
be selected.
91
 Free People m Address Accuracy Incorrect – Unit Number
4 � fro ez
333 Santana Row 2
�20 art�
n
This result address has a different unit number than
7 ,
Suite #2490 1
ry� scar
�M the one listed on the
Sa official website. Unit number
San Jose, CA 95128ebr y�O u a tur
checkbox shouldIbe P�1 selected.
d
a y ,�F 4.9�b rique 72 ay,�F
.16 eb
d 6.25 an
tur M .25 rua
Sa 172.1 4.9 ry
IP � Ma �by�O �17,�2
nri sc 024
7.1.3. Street Name qu ar�M �fr
e art om
�ne
If the result address has an incorrect or missing street name rate Address Accuracy as Incorrect z –
Street Name.

Result Official Address Rating and Explanation

Van Gogh Museum Address Accuracy Correct
Museumplein 6, 1071
DJ Amsterdam, This is a correct address as displayed on the official
Netherlands website of the business.

Van Gogh Museum Address Accuracy Incorrect – Street Name

Museumplein 6,
Van Baerlestraat 6,
1071 DJ Amsterdam,
1071 DJ Amsterdam, This address has the wrong street name. Street
Netherlands
Netherlands name checkbox should be selected.
Van Gogh Museum Address Accuracy Incorrect – Street Name
6, 1071 DJ
Amsterdam, This address has a missing street name. The street
Netherlands name checkbox should be selected.

Alternative Street Names

A street can have alternate names or route
numbers, as well as multiple names in different
languages in bilingual areas. Consider a street
name correct when the name used is still valid and
in the language expected given the test language,
result region, or user query. If the street name has
changed and the older name is no longer in use,
consider the old name to be Incorrect – Street
Name if returned.

m
Sa
t u 2 4 �fro ez
IP� rda
17 y 7 , � 20 art�n
2.1 ,�Fe 1 �M
bru
6.2 Street ary� scar
Misspelled Names u
54
.9� ary�1 � F ebr 9�by�O ue
b ,
Ma y�O ,�2 7
d ay .254. anriq
Misspellings ninrithe sstreet
c 02 name, including missing diacritics (e instead of é,
qu ar�M 4�fr
rl instead
atu 72.16 Mof ł) may be
e
rated Incorrect – StreetaName. S
rt�n m See your Country Specific guidelines forImore
P�1 information.
o
ez

92
 Result Official Address m Rating and Explanation
4 � fro ez
2 n
Van Gogh Museum 7 , �20 art� Address Accuracy Incorrect – Street Name
y�1 r�M
Museumplein 6, Sa
Musuemplein 6, 1071 ruar �Osca tu is misspelled (“ue” instead of
The result streetIPname
b 1071 DJ Amsterdam, �17 rday,
DJ Amsterdam, y,�Fe .9�by ique “eu”), so the street name
2.1 �checkbox should be
4 Netherlands
r Fe
Netherlands turda 16.25 Man selected 6 . 25 br
Sa 172. 4.9 uary�
IP� Ma �by�O 17,�2
Address Accuracy Incorrect
nri sc – Street
0 Name
qu ar�M 24�fr
Bozego Ciala e
The result street name is missing diacritics art oin
�ne two
Bożego Ciała, m
Bozego Ciala, letters (ż and ł) which should be treated as az
Wrocław, Poland
Wrocław, Poland misspelling in the Polish market. The street name
checkbox should be selected.

Street Directions and Types

Street directions (North (N), East (E), South (S), West (W)) as well as street types (Street (St),
Boulevard (Blvd), Avenue (Ave), etc.) are part of the street name. If they are incorrect or missing, the
street name is wrong and rated Incorrect – Street Name. Exceptions are when such elements of a
street name are used interchangeably for the same street.

Result Official Address Rating and Explanation

Address Accuracy Incorrect – Street Name
Van Gogh Museum This address has the wrong type of street: both
Museumplein 6,
Museumkade 6, 1071
1071 DJ Amsterdam, “plein” (square) and “kade” (quay) are street types.
DJ Amsterdam, The official street type is listed as ‘plein’, therefore
Netherlands
Netherlands the type of street is considered wrong and the
checkbox for street name should be selected.

118 El Camino Real 118 E El Camino Address Accuracy Incorrect – Street Name
118 El Camino Real, Real, Sunnyvale, CA This address is missing the direction. Therefore, the
Sunnyvale, CA 94087 94087 street name checkbox should be selected.
Blue Stones Address Accuracy Incorrect – Street Name
3530 El Camino
3530 E El Camino
Real, Santa Clara, This result address has additional direction, which is
Real, Santa Clara, CA
CA 95051 wrong and does not exist in real life.
95051

m
Sa Sub-Locality and Administrative Subdivisions
7.1.4.t u 2 4 �fro ez
IP� rda
17 y 7 , � 20 art�n
.16 ,�Feb or areas require an additional subdivision, like sub-locality, for correctryaddress
Some 2countries �1 ar�M
c
.25 rua u a Os
r guidance
information.4See your
r
.9� y�1 Country Specific guidelines for specific guidance. The generale b y � is to
Ma sub-locality , �F 4.9�b ique
by� 7,� as Incorrect – Sub-Locality. This is also true if the sub-locality
rate a wrong n Os 202
y
da 25 n r is required
but missing. rique car�M 4�fro atur 2.16. Ma
art m S 17
�ne IP�
z

93
 m
4 � fro ez
2 n
7.1.5. Locality 7 , �20 art�
1 �M
a ry� scar Sa
tuinstead
Misspellings within the u
locality name, including missing diacritics
Fe b r
�b y � O
e I P(e
� 1
rda of é, l instead of ł) may be
, � 9 u 7 y ,
rated Incorrect d–ayLocality.4 See
. r your Country-Specific Guidelines for2more
i q .16 Finformation.
�
t u r 16.25 Man .25 ebrua
Sa 172. 4.9 ry�
1
�b cases
Every result requires
I P � the correct locality component within its address details.
M an yIn�Os 7,�20 of local
government reforms or other changes in naming, the result has to reflect therofficial iqu car�name.
24
e Ma �from
Exceptions are made when alternate names are accepted. rt�n
ez
Result Official Address Rating and Explanation
Van Gogh Museum Address Accuracy Incorrect – Locality
Museumplein 6, 1071 Museumplein 6, 1071
DJ Utrecht, DJ Amsterdam, This address has the wrong locality. Locality
Netherlands Netherlands checkbox should be selected.

Address Accuracy Incorrect – Locality

Van Gogh Museum Museumplein 6, 1071
Museumplein 6, 1071 DJ Amsterdam, This address has a missing locality therefore
DJ Netherlands Netherlands locality checkbox should be selected.

Jana Matejki Jana Matejki Address Accuracy Incorrect – Locality

Jana Matejki 90-237 Łódź
Polska The locality within the street result is missing
90-237 Lódz diacritics in two letters (Ł and ź) which should be
Polska treated as a misspelling in the Polish market.

7.1.5. Region or State

Each country has its own understanding of what is expected (correct) or unusual (incorrect) for
region or state components. See your Country Specific guidelines for more information.

Result Official Address Rating and Explanation

Incorrect – Region/
Address Accuracy
1384 Navarro Dr, State
1384 Navarro Dr
Sunnyvale, CA 94087, This address is missing the state, which is a
1384 Navarro Dr,
USA mandatory component in the USA. Region/State
Sunnyvale, 94087, USA
checkbox will be selected for missing state. m
Sa �fro ez
IP� turda Correct with�20 art�n 2 4
17
2.1 y,�Fe Address Accuracy , M
formatting �17 issue�
Van Gogh b
6.2 Museum ar y car
54 ruar Museumplein 6, 1071
u s
ebr 9�by�O uin
Museumplein .9 1071
Ma �b6,
y�
y�O 17,�2 DJ Amsterdam, Region is not a mandatory ,component
� F e the
ay 54. nriq
DJ Amsterdam, nri North-
s 0 Netherlands, but if present
tur 2.16has
d .2 toMabe correct.
qu car�M 24�Netherlands
f Sa 1necessary,
Holland, Netherlands ar rom
e Since the region is not 7 it is a
t�n I P�
ez redundant address component and should be
flagged as a formatting issue.

94
 Result Official Address
m Rating and Explanation
4 � fro ez
2 n
, �20 art� Incorrect – Region/
1 7 �M Address Accuracy
a ry� scar Sa State
u
Van Gogh Museumebr �by�O e IP� turda
y,�F 54.9 Museumplein
Museumplein 6,da1071 riq
u 6, 1071 Region is not a1mandatory
72 y,�F
.16 eb component in the
tur 2.16. MaDJ Amsterdam,
2 n
DJ Amsterdam, Netherlands, but if present
.25 ruahas to be correct.
Sa 17North- Netherlands 4.9 ry�
Brabant, Netherlands
IP� The correct region forMthe �bcity 1of
7 Amsterdam is
an y�Os ,�202
North-Holland, thereforerithequ region/state
car
�M 4�fro
checkbox will be selected. e art m
�ne
z
7.1.6. Postal Code

The postal code accompanies the locality name and provides further detail about where a feature is
located. See your Country Specific guidelines for more information on when postal codes are a
mandatory address component.

If a postal code is not mandatory but is present in the result address, rate Correct as long as the
postal code applies to at least part of the feature (street, locality, large POI without an expected
address, etc.).

For many localities, more than one postal code may apply. As long as the returned postal code is
correct for at least a part of the feature (street, locality, large POI) rate Correct. Columbus, OH, for
example, contains 45 postal codes.

Postal code standards differ between locales so be sure to consult your Country Specific guidelines
for details.

Consider any country specific conventions when it comes to the use and correctness of shortened
postal codes. For example, the US postal code does not need the four-digit extension that follows the
five digit main code. Ignore it if it appears.

Result Official Address Rating and Explanation

Van Gogh Museum Address Accuracy Incorrect – Postal Code

Museumplein 6,
Museumplein 6, 1071
1071 DJ Amsterdam, This address has the wrong postal code “DM”
DM Amsterdam, instead of the correct “DJ.” Postal code checkbox
Netherlands
Netherlands should be selected.
Van Gogh Museum Address Accuracy Incorrect – Postal Code
Museumplein 6,
Museumplein 6
1071 DJ Amsterdam, This address has a missing postal code. Postal code m
Amsterdam,
Sa �fro ez
t u Netherlands checkbox should be selected. 4
Netherlands
IP� rda
, �
2
20 art�n
17 y 7
2.1 ,�Fe 1 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
b ,
7.1.7. CountryMa y�O ,�2 7
nri sc 024 r d ay .254. anriq
qu ar�M �fr
e om piece of information, but should always Sbe atu 72.16 M
The country is a “nice toahave”
rt�n �included
1 when the result is
IP
located in a country other than e z the test locale. If missing, rate Incorrect and select the Country
checkbox.
95
 m
� fro ez
Test 4
2 rt�n
Address in Result , �20 aAddress in Reality Rating and Explanation
Locale y � 7
1 ar�M
ar sc Sa
tur
bru �by�O e AddressIP� Accuracy Correct
1384 e
Navarro 17 day,�
d a y,�F 5 4.9 nrDr,
iqu 1384 Navarro Dr, 2.1 Fe
en_US tSunnyvale,
ur .16. MCA2 a Sunnyvale, CA 6.2 bru
This is a correct 54address since the test
Sa 94087
7 2 94087 .9� ary�1
IP�
1 locale is the USA. b
Ma y�O 7,�2
nri sc 024
q a
Address Accuracy uCorrect e r�Ma �from
1384 Navarro Dr, 1384 Navarro Dr, rt�n
ez name
de_DE Sunnyvale, Sunnyvale, CA This address includes the country
CA,94087, USA 94087, USA since it is outside of Germany, which is the
test locale.
Address Accuracy Incorrect – Country

Museumplein 6, The country is mandatory in this example

Museumplein 6, because the address is in the Netherlands,
en_US 1071 DJ
1071 DJ Amsterdam, which is outside the user's US test locale.
Amsterdam
Netherlands Country checkbox should have been
selected.

7.2. Address Does Not Exist

An address-type result needs to be associated with a building or with a plot of land that has been
officially assigned that address. If you find strong evidence that there is no building at the address or
that no plot of land has been officially assigned the address, rate Incorrect – Address does not exist
and leave a detailed comment including links. If there are not enough resources available to make an
informed decision, rate Can’t Verify.

Within markets that use street number extensions, if the result offers an address with a generic street
number, but the street number alone does not exist without an extension (e.g. result returns “163
Main St.”, but only “163A Main St.” and “163B Main St.” exist), rate the address as Incorrect –
Address does not exist, since the street number without the extension is not a valid, real-life address.
Note that street number extensions differ from the building numbers referred to in Unit/Apt section.

In rare cases, an existing street address can be found in a different locality. Always mark such cases
as Incorrect – Address does not exist and not as Incorrect – Locality.

Use the Incorrect – Address does not exist checkbox for any address result that doesn’t
exist, like a street or sub-locality result. This rating should not be applied to POI addresses.
m
Sa
t u 2 4 �fro ez
IP� rda
17 y 7 , � 20 art�n
2.1 ,�Fe 1 �M
7.3. Language/Script
6.2 bru Issue in Address ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
b ,
The address Ma details
y 7
nri �Osc must ay .254. a(like
,�2 be in a language and script that matches the test language
02 r d
q
nri en_US), the
user query, or the qu result tu 6
e r�Maregion.
a 4�f M
rom Sa 172.1
rt�n IP �
ez

96
Use the Address Accuracy Incorrect m – Language/Script Issue checkbox if you find issues of this
ro
nature in any of the address components � f ez in the address details of any result. (For business/POI
names and address titles in unexpected , �2 024 art�n languages, see Result title/name in unexpected language.)
17 �M
a ry� scar Sa
tur
r u �O I
These examples show Fe bincorrect
�b y
u e language and script for the resultP�“Cafe
1 72 ay,Timber,
d 1066 Hippy Hollow
y ,� 4.9 riq � F
Rd, Red BoilingrSprings,
d 6.25 TN
a n 37150” with a user in the US using English. . 16 ebr
tu Ma .25
4.9 uary�
Sa 172.1
IP � Ma �by�O 17,�2
nri sc 024
qu ar�M �fr
e art om
�ne
z

Any combination of unexpected language or script is considered Incorrect. An exception can be

made in cases when only special characters are added that are not used in the expected language.

Results located in a market with different scripts are hard to verify. Use the normal research steps to
confirm the address. It is not expected that you understand markets and address formats outside
your local knowledge expertise, so do the best you can without doing more research than normal.

Rate mixed languages and scripts found in any address details as Language/script Issue when
they use a different language or script than the one used in the query, test, or result location.

7.4. Country-Specific Issue

The variety of address formats and distinctive country specific issues is broad. In general, use the
checkbox for Country Specific Issue when there is an address problem that is not covered by the
available checkboxes. This includes things like instances when an address also requires a
municipality in addition to locality and state, but those components are either missing or incorrect.
See your Country Specific guidelines for more information.

[Link]-Specific Issue vs. Correct with Formatting Issue

Any additional components beyond the regular address format for a country are rated:

• Correct with formatting issue if correct

• Incorrect – Country Specific Issue if very unusual or wrong

7.5. Other Issue m

Sa
t u 2 4 �fro ez
n
IP� rda
Issues
17 noty,mentioned in these guidelines are reported using the Incorrect – Other Issue 7 , �20 art� If
checkbox.
2.1 �Fe 1 ar�M
you choose 6.2 this
bruoption, be sure to leave a comment as well as links to the resourcesuyou a ry� used
c to
54 a b r y�Os
identify the issue.
.9 r yThe checkbox is also used for: e �b e
Ma �by�O �17,�2 ay,�F 54.9 nriqu
nri sc 024 r d .2 Ma
• Duplicatequaddress
a �fro
e r�Ma components S atu 72.16
rt�n min the address details 1
• Name of POI reappears ez IP�
• Natural features that contain street address elements (see Natural Features)
• P.O. Box addresses
97
 m
You may also use this checkbox if24you �fro notice formatting issues along with any Incorrect
nez
0 art�This
components you’ve already selected. , �2 is because once you mark a component Incorrect, you
�17 ar�M
can no longer choose Correct r y
ua �Oswith c Formatting issue. Sa
t
Fe b r
�b y e I P�1 urda
� 4.9 iq
y,Formatting u 72 y,�F
7.6. Correct with da
r 16. Ma2 5 n r Issue .16 eb
.25 rua
t u
Sa 172. 4.9 ry�
�by 17,expected, mark it
P�
When all the Iresult address information is correct and present, but not in M the
an format
�O �20
as Correct with Formatting issue. Formatting issues include the order of address riq scarcomponents
2 and
ue �M 4�fro
other minor issues that are not necessarily considered wrong. They do not include misspellings a rt�n m
which are addressed under the relevant individual components. Some reasons to rate Correct ez with
formatting issue:

• Components are in unexpected order

• Non-required but correct address components
• Extra spacing
• Double comma [,,]
• Rate Incorrect if a required component is missing
• Valid but redundant or unnecessary components (See your Country Specific guidelines for
more information)

If optional components already discussed in this chapter appear in the address, use the guidance
provided in the section that applies to those components, not the Correct with formatting issue
rating. If your market has additional address components, consult your Country Specific guidelines
before demoting.

7.7. Can’t Verify

An address is rated Can’t Verify when it cannot be confirmed as Correct or Incorrect. This is
usually the case when there is a lack of resources or an unexpected address format is given on the
official website.

• Lack of resources:
• No official webpage found
• No official address listed
• General lack of official resources
• Lack of street imagery
• Unexpected address formats used by official resources can include:
• Intersection address (Main St and 2nd St)
• Exit address (Exit 5, Hwy 101)
• Descriptive address (Main St between 6th and 7th Streets)
m
Ask
Sa
yourself:
t u Is the location given by the result address at least not wrong given all information 2 4 �froI ez
IP� rda
1 , � 20 art�n
have 7found?
2.1 ,�FeUse the following examples to learn how reach a conclusion.
y 1 7 �M
6.2 bru a ry� scar
u
54
.9� ary�1contains missing or incorrect components, it can be confirmed ebras y�O e
�bIncorrect.
Note: If anMaddressby� 7,� , � F . 9 u
an Os incorrect
2 d ay .254 anriq
Mark the individual
riq car 024� components. See your Country Specific guidelines tu r 6 for Mmore information
ue
on missing or incorrect
f
�Mcomponents.
art rom Sa 172.1
IP �
�ne
z

98
7.7.1. Can’t Verify for Street Number m
4 � fro ez
The following example shows ,address 2 n
7 �20 art� details for a business called “Utopia.” No information online
confirms the address and ronly y�1 caarfew �M street numbers can be confirmed Sa with official resources.
u a s t
Fe b r
�b y � O
e I P�1 urda
y,� 54.9 nriq u 72 y,�F
Rulea and Explanation .16 Example
t u d
r 16. Ma2 .25 ebrua
Sa 172. 4.9 ry�
�b 17
� M
I P an y�Os ,�202
The street number has to fall within the possible riq car
ue �M 4�fro
range of addresses. art m
�ne
z
The street number 165 falls within the possible
street numbers ranging from 103 to 175.

Those are the houses closest to the result

address that could have been confirmed.

Rate the address Can’t Verify.

7.7.2. Can’t Verify for Street Name

The following examples give different address details for a business called Aztec. The official address
is “Granite Ave & W Babcock St, Bozeman, MT” and is in a different format than the result addresses.

Rule and Explanation Example

The result address has to provide access and

be within the possible range of street numbers.

W Babcock St provides access to the business

and the number appears to be within the range
of addresses we can confirm.

Rate the address Can’t Verify.

Granite Ave provides access to the business

and
Sa the number appears to be within the range m
tur 4 �fro ez
Iof
P�1addresses
d we can confirm. 2
�20 art�
n
72 ay,�F 1 7 ,
�M
.16 eb
ary� scar
Rate the .2address
54 ruar Can’t Verify. u
.9 y ebr 9�by�O ue
Ma �by�O �17,�2 , � F
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

99
8. Address Accuracy: Result
rom
Expectations
0 2 4�f �nez
rt
�1 7,�2 r�Ma
y ca
arresults: Sa
You will see three kindsruof s
e b b y�O e IP� turda
F � 17
a y,� 54.9 nriqu 2.1 y,�Fe
• Business/POI
tur [Link]
d 2
Ma
6.2 bru
54
S a
• Address�1type7 results .9� ary�1
IP without an expected address Ma by�O 7,�2
• Features nri sc 024
qu ar�M �fr
e art om
Different address details are expected for each result type. For example, the Amazon river �nehas no
z
street address but its name is accompanied by the country, while the fast food place Wienerschnitzel
shows a complete address. You will need the appropriate expectations in order to rate addresses
accuracy.

Wienerschnitzel Eiffel Tower

75 Saratoga Ave 5 Avenue Anatole France
Santa Clara, CA 95050 75007 Paris
United States France
1 Church St Grand Central Terminal
1 Church St Manhattan
Burlington, VT 05401 New York, NY
United States United States
Amazon Yellowstone National Park
Brazil Natural Feature Yellowstone National Park
WY 82190
United States

8.1. Business/POI Result

The address details of a business or POI generally consist of: street number, street name, locality,
region, postal code, and country.

The address given is confirmed Correct when it points to the same physical location listed on the
official webpage or other official resources and all mandatory components for your market are
present. See your Country Specific guidelines for details on mandatory address components.

8.1.1. Business/POI Address Research and Resources

Use official resources to confirm an address when a business or POI’s official website does not
provide a full address or if there is a conflict with the address in the result. These resources can
include:
m
Sa
t u 2 4 �fro ez
IP•� rSocial n
17 day,� media sites claimed by the business/POI and updated within the last 6 months 7 , �20 art�
• 2Street
.16 Feimagery (any recent online imagery showing streets and buildings) 1 �M
.25 brua ary� scar
• Postal 4.9authorities (for postal codes and locality names) u
�
ry�
1 � F ebr 9�by�O ue
• Government b
Ma y�O property registries ,
nri sc �2024
7 ,
r d ay .254. anriq
qu ar�M �fr tu 6 M
e art om Sa 172.1
IP �
If a business or POI has more �ne than one official address for the same location, accept any of them
z
as Correct.

100
 m
If no official resources can be found, � frorate z according to consensus from multiple reliable sources.
2 4 �ne
Reliable resources include: 7,�20 Mart
1 �
a ry� scar Sa
t
u
• Articles in primary Fe b r
�b y � O
publications
e (newspapers or similar I P�1 urda that do their own
publications
y,� 54.9 nriq u 72 y,�F
reporting) da
r 16. Ma2 .16 eb
.25 rua
t u
• Crowdsourced
Sa 172. user review sites 4.9 ry�
� M �b 17
I P an y�Os ,�202
r car
When no official resources are available and address components are missingiqor �M 4incorrect,
ue clearly �fro
check to see if those components are required in the market or region of the result and select a r t�n m the
ez
appropriate checkboxes under Incorrect. See your Country Specific guidelines for more information.

Some resources, like data aggregators, spammy directory sources, and so on, are unreliable, and
consensus between unreliable resources should be disregarded.

• Valid alternate street and locality names When valid alternate names for streets or
localities are used interchangeably, consider all versions Correct.
• Valid alternate street addresses: When valid alternate addresses are returned, consider all
versions found on the official website or confirmed by official sources as Correct.

When the address listed by the official website or resources is in a different format than the one seen
in the result, confirm if the address given is Incorrect or Can’t Verify. See Can't Verify for more
information.

If there is any obvious error in an official source, like a misspelled country or city name, and the
same error appears in the result, rate the erroneous component Incorrect.

8.1.2. Alternative Official Addresses

Some official addresses may contain a vanity street name or have no official street number. In rare
cases they may even lack a complete street address. Refer to the official webpage as well as to
common address formats in your country to determine the accuracy of each business or POI address.

P"#"G"#"%Q)(9E+M)B+%0,,E);;);

When the official webpage does not give a complete address with street number and name for a
large entity (mall, university, etc.):
• Rate the result address Correct when it matches the address of any department or entity at
the same location complex or campus.
• Rate the result address Correct when it lists the correct locality for the entity. If the exact
Sa locality is unclear because the entity borders multiple localities, rate Can’t Verify. m
�fro ez
t
IP•� rThe locality is always expected, even when no complete address is provided. If missing, 4
�20 arate
u 2
17 day,� , rt�n
2Incorrect 7
.16 Feb – Locality. 1
ry� scar
�M
• Region . 2 r
54 and u postal code must also appear in countries where they are mandatory u a
.9� ary�1 F ebr 9�by�O ue
components. b
Ma y�O ,�2 See
7 your Country Specific guidelines for more information. , �
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

101
 m
4 � fro ez
Result Address Official
2 nAddress Rating and Explanation
7 , �20 art�
1 �M
a ry� scar Address Accuracy
Sa Correct
u
ebr 9�by�O ue IP� turda
F 17
, � . iq 2.1 y,�has
Dartmouth College F no official street
Dartmouth Colleger day 6.254 anr 6.2 ebru
10 N Main SSt,
u
at 72.1 M address listed on their
54 website.
.9� ary�1 The address
� 1 in the result belongsMato bthe
y�O Office
7,� of
Hanover, NHIP03755 20
Admissions, which is npart scathe
riq of
ue r�Mlarger
24
�fro
university, therefore the address isrt�Correct.
a m
nez
Dartmouth College Address Accuracy Correct
Dartmouth College Hanover, NH The college lists only the locality as its
Hanover, NH 03755 official address and the result matches that
03755 USA address and is therefore Correct (even
though it is missing a street number and
name).
Address Accuracy Incorrect – Locality
Dartmouth College
NH A locality is expected in the address details
03755 for most POIs. Rate Incorrect – Locality
when the locality is given by the official
webpage but missing in the result.

In addition to a street address, a store or department can have the name of the complex or campus
that contains it and be rated Correct.

Result Address Official Address Rating and Explanation

Address Accuracy Correct

Stanford School of 559 Nathan Abbott This result is a department within Stanford
Law Way, Stanford, CA University. The address is Correct because the
Stanford University, 94305 larger entity name and correct locality is listed
Stanford, CA 94305 as the address.

Address Accuracy Correct m

Sa
The �fro ez
IP� tCheesecake
ur 3041 Stevens Creek 2 4
0 art�n
17 day,�
Factory Blvd This result is a business within Westfield 7 , �2Valley
2.1 Fe 1 �M
Westfield.25Valley
6 b rua Fair, Santa Clara, Fair shopping mall. The address isuaCorrect ry� scar
r y�O
eband
Santa Clara, 4.9CA ry� because the larger entity name �bcorrect
Ma �by�O 17,�2 CA 95050 F e
y 54.9 nriqu
,
locality are listed as the address.
a
�
95050 nri sc 024 d 6.2 Ma
qu ar�M �fr tur
e art om Sa 172.1
�ne IP�
z

102
 m
4 � fro ez
2 rt�n
If the entity has an official address 7 , �20 anda the result address belongs to another entity in the same
�1 ar�M
complex or on the sameucampus, ar Osc rate Incorrect.
y Sa
t
Fe b r
�b y � e I P�1 urda
y,� 54.9 nriq u 72 y,�F
da
r 16. Ma2 .16 eb
t u .25 rua
S a 72. 4.9 ry�
Result Address
� 1 Official Address Rating and M Explanation
�b 17
I P an y�Os ,�202
riq car 4�f Number
Incorrect
ue –�M
Street rom
Address Accuracy a
& Street Name rt�ne
Stanford School of z
559 Nathan Abbott The result address belongs to the larger entity
Law
Way, Stanford, CA (Stanford University). The department has an
450 Serra Mall,
94305 official address that is different from the
Stanford, CA 94305
university’s address, so the result address is
rated Incorrect.
Incorrect – Street Number
Address Accuracy
Stanford University & Street Name
559 Nathan Abbott 450 Serra Mall, The result address belongs to a smaller entity
Way, Stanford, CA Stanford, CA 94305 within the university (Stanford School of Law).
94305 The university has an official address that is
different, so this address is rated Incorrect.
Address Accuracy Incorrect – Street Number
The Cheesecake
3041 Stevens Creek The result address belongs to the larger entity
Factory
Blvd (Westfield Valley Fair mall) that contains the
2855 Stevens Creek
Santa Clara, restaurant. The Cheesecake Factory’s official
Blvd
CA 95050 website lists a different address, so the
Santa Clara, CA 95050
address Incorrect.
Address Accuracy Incorrect – Street Number
Westfield Valley Fair 2855 Stevens Creek
3041 Stevens Creek Blvd The result address belongs a business (The
Blvd Santa Clara, Cheesecake Factory) within the mall. the
Santa Clara, CA 95050 CA 95050 shopping mall has an official address that is
different, so the address is rated Incorrect.

[Link]. Result Missing the Street Address

When both the result and the official webpage show identical but incomplete street addresses
(missing
Sa
t street name, street number, or both) and the locality is correct, consider the address �fromez
u 4
Correct.
IP� rda
17 y 7 , � 202 art�n
2.1 ,�Fe 1 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
b ,
Ma y�O ,�2 7
nri sc 024 r d ay .254. anriq
qu ar�M �fr tu 6 M
e art om Sa 172.1
IP �
�ne
z

103
 Result Address Official mAddress Rating and Explanation
4 � fro ez
2 n
7 , �20 art� Address Accuracy Correct
1 �M
Pilot Thomas a ry� scar Sa
u O
ebr 9�by�State This result isIPfortuardself-serve gas station for
Cardlock y , � F
4 . i q ue Hwy 115 & �17 ay,
commercial vehicles. 2.1 While
� F we would normally
a r
State Hwy 115 d
r& .25 Man Mustang Drive, 6 ebru
expect a full address.25for
S atu 72.16 4.9 rytype
this a of result, the
Mustang Drive,
�1 Andrews, TX 79714 official website lists only
Ma an � b �
y�Ointersection.
17, The
IP79714
Andrews, TX result listing matches the sca �2website,
nriofficial 02
qu
e r�M �fro so
4
the result is rated Correct. art m
�ne
z
Address Accuracy Can't Verify

Strand Central Park This result is for a automated book kiosk.

E. 60th St & 5th Ave, While we would normally expect a full address
Kiosk
Manhattan, NY for this type of result, the official website lists
789 5th Ave
10065 only an intersection. The result listing is a full
Manhattan, NY 10065
street address, so the result is rated Can't
Verify.

When the street address is missing from the result but the official webpage has a street address,
consider the address Incorrect.

Result Address Official Address Rating and Explanation

Address Accuracy Incorrect – Street Name

Pilot Thomas State Hwy 115 & This result is for a self-serve gas station for
Cardlock Mustang Drive, commercial vehicles. The official website lists
Andrews, TX 79714 Andrews, TX 79714 an intersection as the address. The result
address is missing the two streets (State Hwy
115 & Mustang Dr). Mark the result Incorrect
– Street Name.

Address Accuracy Incorrect – Street Number

Stanford University
450 Serra Mall, The result address is missing the street
Serra Mall, Stanford, CA
Stanford, CA 94305 number given on the official website, therefore
94305
the address accuracy is Incorrect – Street
Number.
m
Sa
t u 4 �fro ez
[Link].
IP� rdP.O. Box, Mailing Addresses, and Management Offices 2
�20 art�
n
17 ay,� 7 ,
2.1 Fe 1 �M
6.2 bru ary� scar
Addresses 5that4.9 point
ary to a different location or building, such as management offices, ebr 9�P.O.
u O Boxes,
� � 1 F by� ue
mailing addresses, b
Ma y�O ,�2 or 7 shared office spaces, are not valid and are rated Incorrect ay .254 anriqIssue.
, � – Other
.
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

104
 m
4 � fro ez
2 n
, �20 art�
Result Address 1 Official
7 �M Address Rating and Explanation
a ry� scar Sa
t
u
Febr 9�by�O ue I
Address AccuracyP�1 urda Incorrect – Other Issue
, � . iq 72 y,�F
r day 6.254 anr .16 eb
t u
Sa 172.1
John F. Kennedy M 54 ruaairport
The address on the.2official site is for
4 World Trade .9� ry�1
International �
IP Airport The Port Authority ofMNY a &y�O
b NJ 7corporate
,�2
Center, 150 riq scarof0the
office, which is not the nlocation �M 4�fractual
4 World Trade Center, 2
Greenwich St., ue o
150 Greenwich St., airport. Even though the result address a rt�n m
New York, NY 10007 matches the address listed on the official e z site,
New York, NY 10007
it is a different location and does not refer to
the location of the result POI.

8.1.3. Businesses/POI with Moving Locations

Moving entities can either be on a fixed schedule or move at random. In some cases, entities appear
to be moving because they are located in a truck or similar vehicle, but are actually permanently
based at the same location.

Random location
The location of randomly moving entities cannot be predicted and should not be shown on the map.
Rate such businesses as Result is closed or does not exist.

Fixed schedule
Some entities, such as food trucks, move on fixed schedules. Their stops and schedule are usually
posted on their official webpage. The most accurate location for these entities is the address of their
longest stay over a full cycle of the given schedule (i.e. if a business has a weekly cycle and stays in
one spot for four days, that spot will be the only acceptable address for it). Mark any other address as
Incorrect – Other Issue. In cases of a tie, consider any of those locations Correct.

Fixed location
Businesses that operate out of a truck or bus that is stationary are evaluated like a standard business.
The vehicle does not need to be parked at the location after closing hours to be considered at a fixed
location.

8.1.4. Events

Some events can be very prominent but happen only a few days a year, others are regularly recurring.
m
Sa
Regularly
t u recurring (weekly/monthly) 2 4 �fro ez
IP rda
Rate�17eventsy like weekly farmer’s markets like any other business. 7 , � 20 art�n
2.1 ,�Fe 1 �M
6.2 bru ary� scar
u
Annual Events
54
.9� ary�1 � F ebr 9�by�O ue
b ,
Ma y�O ,�2
nri sc 024
7
r d ay .254. anriq
qu ar�M �fr tu 2.16 M
Events that happen e oncea a year, Sa 17only
om such as Burning Man or the Sziget Festival, occur for a short
r n �
IP Users can be interested
time each year, but attractt�massive ez amounts of people and media attention.
in these kinds of events outside the time they are held.

105
 m
If the query and location intent are 4 fro ez assign an appropriate relevance rating, otherwise rate Bad.
clear,
�
2 rt�n
Treat seasonal stores (like Spirit 7 , �20Halloween
a store) and seasonally open POIs (like California’s Great
�1 ar�M
America theme park) theuasame r sc way as annual events.
y Sa
t
Fe b r
�b y � O
e I P�1 urda
y,� 54.9 nan u
riqevent may not have an official address. 72 y,�F
Depending on its da location,
r 16. Ma 2 .This
16 kind
.25 ebruaof event should be
t u
treated like Saalandmark
17 2 . or natural feature. 4.9 ry�
� M �b 17
I P an y�Os ,�202
riq car
Singular or Non-Established Events ue �M 4�fro
art m
�ne
Non-recurring events from the past don’t carry any map significance and are rated Business/POI z
closed or does not exist, unless the location of the event became a POI (due to its historical
importance) that carries the name of the event further.

8.2. Address Type Results

Address type results generally include:

• Street number, street name, postal code, locality and country (when outside of the test
locale).

8.2.1. Address Result

An address usually includes a street number, street name, locality, postal code and state/region. It
can be the same as the mailing address or other addresses provided by the official resources. Use
the chapter Address Formats, below, as well as your local knowledge, to identify the necessary
components and format.

• The address given has to be associated with a building or a plot of land officially assigned
that address.
• P.O. boxes are not valid addresses in the map context. Rate such addresses as Incorrect –
Other Issue.

If your research shows that the address does not exist, see Address Does Not Exist.

Address Mandatory components Explanation

13 Navarro Dr, Street Number, Street Name,
Sunnyvale, CA Street Type, Locality, State,
94087 Postal code Mandatory components may vary by
country. Check your country specific
Street Name, Street Type, guidelines for a complete list.
Museumplein 5,
Street Number, Postal code,
1071DJ Amsterdam m
Sa
t u Locality
2 4 �fro ez
IP� rda
17 y 7 , � 20 art�n
2.1 ,�Fe 1 �M
6.2 bru ary� scar
u
8.2.2. Address
54
.9� aFormats
ry�
1 � F ebr 9�by�O ue
b ,
Ma y�O ,�2
nri sc 024
7
r d ay .254. anriq
Various addressquformats a tu 2.16 M of the
e r�Maare
�froused in different countries. The sequence and
m Sa 1presentation
� 7
components is adapted tort�matchnez the local needs. For example, the streetIPnumber comes before the
street name in the United States but after it in Germany. See your Country Specific Guidelines for
more information.
106
 om z
�fraddress
It might be impossible to confirm2an on official resources when another format is used. Rate
4
0 to �ne
rtthe
Can’t Verify if the address points , �2 a same location using an alternate format and there are no
�17 ar�M
missing or incorrect components. r y
ua �Osc
Sa
t
Fe b r
�b y e I P�1 urda
y,� 54.9 nriq u 72 y,�F
d a
r 16. Ma 2 .16 eb
t u .25 rua
8.2.3. Street
Sa Result
1 7 2 . 4.9 ry�
� M �b 17
I P an y�Os ,�202
Depending on the length of the street, different address components are expected. riq car
ue �M 4�fro
art m
�ne
Mandatory components may vary per country. See your Country Specific guidelines for a complete z
list.

• Local roads: Local roads that stay within a certain locality or county should carry the
appropriate locality and state name.
• Highways/Interstates: Longer roads that travel between cities or even states don’t require a
locality or state component. If such components are present, they must be accurate.

U.S. Route 395 covers almost the entire distance from Canada to Mexico. It passes through four
states and connects countless towns, such as Big Pine, CA. Within that locality, it carries for a short
distance the name N Main St. The two results have different expectations regarding components.

There are several forms that are appropriate for the result
U.S. Route 395 because of its length:

• U.S. Route 395 or US 395

• U.S. Route 395, California
• US 395, Big Pine, California, United States

For the result N Main St, there is only one expected form
because the road is short and stays within the locality:

• N Main St, Big Pine, CA United States

8.2.4. Locality Result

A locality result can be a city, village, municipality or neighborhood. In the U.S. the result usually
includes the state it is part of.

Mandatory m
Sa Address
t Explanation 4 �fro ez
u components 2 n
IP� rda
17 , �20 art�
2.1 y,�Fe 1 7 �M
Sunnyvale,
6.2 bru CA Locality, State ary� scar
Mandatory components may vary u per country.
54
.9 a r y ebr 9�by�O ue
Ma �by�O �17,�2
Amsterdam, Check your country specific ay .254 anriq for a
, � guidelines
F .
nri sc 024 Locality complete list. tu r d 6
Netherlands qu ar�M �fr
e Sa 172.1
M
art mo �
�ne IP
z

107
 m
4 � fro ez
[Link] Code Result ,�202 art�n
17 �M
a ry� scar Sa
Postal codes are returned b r u when
y � O the user query matches the specific
I P�1 unumbers
t r
da or letters.
Fe �b u e y
,� .9 iq 72
.16 ,�Feb
u r day 6.254 anr .25 rua
t M Mandatory
Sa 172.1
Query Address 4.9 Explanation
r
�by y�17,
I P � components M an �Os �202
riq car
Sunnyvale, CA Locality, State, Postal ue �M 4�fro
[94087] art m
94087 code Mandatory components �ne may
z
vary per country. Check your
Museumplein, 1071 Country Specific guidelines for
[1071 DJ] DJ Amsterdam, Postal code, Locality a complete list.
Netherlands
[Link]/Region/Territory Result

If the user makes the query from a country outside the state or region result, that result must be
accompanied by the country name.

Mandatory
Address Explanation
components
California State name
If the result is outside of the test locale, country
North-Holland Region name
name is a mandatory component.
Puerto Rico Territory name

8.2.7. Country Result

The country is the highest administrative level and has no other address component.

Mandatory
Address Explanation
components
Netherlands Country The country is the highest administrative level
Romania Country and has no other address components.

8.3. Features Without an Expected Address

There are several kinds of features where no address is expected by the user. This could mean no
Sa rom z
�fbe
street t uname or number or, in some cases, no address components of any kind, are expected to
2 4 e
IP� rda
shown.
17 Thesey types of results have different rating criteria when it comes to Address �
Accuracy.
7 , 20 art�n
2.1 ,�Fe 1 �M
6.2 bru ary� scar
u
8.3.1. Natural
54 ary
.9� Features
� 1 � F ebr 9�by�O ue
b ,
Ma y�O ,�2
nri sc 024
7
r d ay .254. anriq
Natural featuresquare ar� tu .16 M and other
e specific
Ma �frolandforms
m
or ecosystems like rivers, mountains,
Sa 172jungles,
�
geological features. Theyrhave t�n names that can be rated, but typically doInot
ez
P have a street address, so
natural feature results should be returned without any street address components. If a street address

108
is present, it is considered Incorrect –mOther Issue, even when pointing to a building that is
associated with the feature (like a24ranger �fro ez station or visitor center).
n
7 , �20 art�
• A locality may beuan �1 ar�M
ryacceptable address if it is appropriate Sfor
a sc a the size of the feature, as it can
help locate a�Fsmall
r �
e 9�bfeature, O
like a hot spring, within the IP� turFor
locality.
17 day,�larger features, such as a
b y e
y , 4 . i q u 2.1 Fe – Other Issue.
mountain, rd a1locality
a .25 Manmay not make sense and would be rated Incorrect
r 6.2 bru
t u 6 54
• The state
Sa 17the 2. feature is in can also be provided as the feature’s address .9� aand
ry� rated Correct.
� M b 17
• If a postal
I P code is included, it must be correct y
an �Os ,�202
riq car 4�f one
• If a very large or expansive natural feature, like a river or mountain, spans uemore �Mthan rom
country, any one of these countries can be a Correct address. If no country at allrtappears, a
�ne
this is also Correct. z

Parks and other protected areas are artificial boundaries created to help protect the natural feature.
Those POIs are often named after the natural feature they contain. In cases where a feature can be
considered a POI, such as Mount Rushmore or a state park beach, the official address can be
returned. There might be other natural features within a park that reference the park name as part of
their address details.

Treat landmasses like islands and continents as natural features with no expectation of a street
address. If one is returned, rate it Incorrect – Other Issue.

Result Details Official Address Rating and Explanation

Wreck Beach The beach can be confirmed as located within
No official address
Vancouver Vancouver and is therefore rated Correct.
The result contains the name of a street that
Wreck Beach
provides access to the beach. But the street is
NW Marine Dr, No official address
not expected and therefore rated Incorrect –
Vancouver
Other Issue.
The result contains the name of a street that is
Wreck Beach
nowhere near the beach. The street is not
W King Edward Ave, No official address
expected and therefore rated Incorrect – Other
Vancouver
Issue.
This glacier is located in the borough of Juneau.
Mendenhall Glacier The postal code in the address is associated
No official address
Juneau, AK 99801 with that locality, therefore both components
should be considered Correct.
Mendenhall Glacier The given address belongs to the overseeing
8510 Mendenhall Loop No official address Forest Office. The glacier should not have this m
Rd,SaJuneau address and is rated Incorrect – Other Issue. �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe Mount Rushmore is both a mountain
7
1 ar�Ma
6.2 bru ary� sandc
Mount Rushmore
54 13000 Highway 244 monument within its own national u
br �bypark.
�O e The
.9� ary�1 e
13000 HWY Ma 244by� #31-1,
7 , � Building 31, Suite 1 address given on the officialay,�F National
9 u
54. anriq Parks
nri Osc 2024 r d 6. 2
Keystone, SD u q a Keystone, SD 57751 Service website confirms
Sa 172.1the result address as
tu M
e r�Ma �from
rt�n Correct. IP �
ez

109
8.3.2. POIs Without an Expected Address m
4 � fro ez
POIs without an expected address 2 rt�n from regular POIs and businesses in that the user would not
7 , �20 differ
a
expect a street name and rnumber y �1 ar�Mto be shown. Sa
ua �Osc t
F e b r
�b y e I P�1 urda
These types of POIs y,� include, u
4.9 nriqbut are not limited to: 72 y,�F
da
r 16. Ma2 5 .16 eb
t u .25 rua
Sa 172. 4.9 ry
• Parks I(Golf
P� courses and theme parks not included) Ma �by�O �17,�2
• Monuments nri sc 024
qu ar�M �fr
• National Landmarks e art om
�ne
• Park-like heritage sites z
• Bridges
• Squares
• Parking lots
• Transit POIs - these can include airports (including airport terminals), ferry ports, subways,
bike share stations, train and bus stops

The rating criteria described in the sections below apply to all features without an expected address.

See Official Address Present if this kind of POI has an official address

[Link]. Minimum Address Component

Whether there is an official street address or not, POIs without an expected address do not need to
show it. The locality must be returned whenever a POI is small enough to fit entirely within it. A POI
that covers an area overlapping several localities does not require a locality component.

See your Country Specific guidelines for more information on mandatory address components.

Result Official Address Rating and Explanation

Address Accuracy Correct

m
Sa �fro ez
IP� turda 2 4
0 art�n
17 Station
Quincy
2.1 y,�Fe 220 S. Wells St, This is a transit POI so no street address�17is,�2expected.
�M
Chicago,6.2IL bru Chicago, IL 60606 The result address is just the locality. u aThe car is
ry sPOI
54 r y�O
.9� ary�1 physically located within the given F eblocality
�b and
e it
Ma by�O 7,�2 ay 54.9 nriqu
, �
nri sc 024 matches the one listed within
tur the
d 6.2official
Ma address.
qu ar�M �fr Sa 172.1
e art om
�ne IP�
z

110
 Result Official Address m Rating and Explanation
4 � fro ez
2 n
7 , �20 art� Address Accuracy Correct
1 �M
a ry� scar Sa
u
ebr 9�by�O ue I � turda
, � F This is a heritagePsite
17 so yno street address is
Stonehenge rday .254. anriq 2.1 ,�Fe
expected. The result address
6.2 bris uajust the locality.
atu 72.16
Amesbury,SSalisbury MNone 5
1 There is no official street address
4 .9� ry�but since the POI is
IP� M by� 17,�
physically located only within an given
riq car 24� it can be
Os locality
20
considered correct. ue �M fro
art m
�ne
z
Address Accuracy Correct

Tongariro National This is a park and heritage site POI so no street

Park None address is expected. No locality is listed for this
New Zealand result. Since this POI covers an area that overlaps
several localities no locality component is required.

Address Accuracy Incorrect – Locality

351 N Union St, This is a park POI so no street address is expected.
Founders Park
Alexandria, VA No locality is listed for this result. Since this park fits
Virginia
22314 into only one locality, Alexandria, the missing locality
component must be considered incorrect.

[Link]. Official Address Present

Official address is a full street address:

Some of these features have an official street address listed on their website or found on other official
sources, but users wouldn’t necessarily expect the address to be shown. Since a full address is not
expected, the result does not need to contain a full address even if there is one found via official
sources. Do not automatically consider any missing street address components as incorrect.

Full Address: When the result contains a full address it should be rated Correct if:
• The result and official addresses are identical
Street: When the result address is just a street it should be rated Correct if:
• The result address street is the same as the street within the official address

Consider the following examples for Embarcadero Station in San Francisco:

m
Sa �fro ez
IP� turda 0 2 4 �n
17 Result Official Address Rating and Explanation 17,�2 Mart
2.1 y,�Fe �
6.2 bru a ry� scar
54 Address Accuracy u
Correct ebr by�O e
Embarcadero .9� ary�1 �
M by� 7, y,�F 54.9 nriqu
Station anri Osca �2024 d a 2
tur 2.16. Ma
q
e r�Ma �from
298 Market St, uSan The result has a full address
Sa 17that is the same as the
Francisco, CA 94111
rt�n
ez IP� website.
address listed on the official

111
 Result Official Address m Rating and Explanation
4 � fro ez
2 n
7 , �20 art� Address Accuracy Correct
Embarcadero 1 �M
a ry� scar Sa
Station u
ebr 9�by�O ue IP� istujust
The result address r
, � F . iq 17 day,a� street. Since the street
Market St, day 6.254 anr
2.1 within
matches the street listed F
6.2 ebru the official address it
u r
San Francisco,
Sa 17CA
t 2.1 M should be considered correct. 5 4.9 ary�
IP � Ma �by�O 17,�2
nri sc 024
Address Accuracy Incorrectqu –aStreet
e r�Ma �fNumber
ro
Embarcadero 298 Market St, San rt�n m
Francisco, CA 94111 ez
Station The result has a full address. The street number does
388 Market St, San not match the number listed within the official
Francisco, CA 94111 address and should be considered incorrect.

Embarcadero Address Accuracy Incorrect – Street Name

Station The result address is just a street. The street is not
Davis St, the same as the street listed within the official
San Francisco, CA address and should be considered incorrect.

Embarcadero Address Accuracy Incorrect – Locality

Station The result has no address details at all. Locality is the
minimum component required for this kind of result
and should be rated Incorrect – Locality if missing.

Official address is a partial street address

When the result address is more specific than the official address it can be rated as Can’t Verify or
Incorrect, unless another official source can be found to confirm the returned address.

Full Address: When the result contains a full address it should be rated Can’t Verify if all of the
following apply:
• It does not belong to another POI/entity
• The street within the result address matches the street listed as the official address

If the full address belongs to another building not associated with the POI it should be rated
Incorrect.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

112
Consider St Nicholas’ Church in Berlin, m Germany:
� f ro
ez
, �2 024 art�n
17 �M
a ry� scar Sa
Result u Official Address Rating t and Explanation
Fe b r
�b y � O
e I P�1 urda
y,� 54.9 nriq u 72 y,�F
da
r 16. Ma2 Address Accuracy .16 eb Can’t Verify
.25 rua
t u
Sa 172. 4.9 ry�
St. Nicholas’ � Church The result POI is a landmarkM church
�b 17and museum.
I P an y�Os ,�202
Nikolaikirchplatz 3, The result has a full address. rThe iqu street
car number is
e �M 4�fro
10178 Berlin, not associated with any other POI or entity a rt�n and the
m
Germany street within the address matches the official
ez street
address.
Address Accuracy Incorrect – Street Number
St. Nicholas’ Church Nikolaikirchplatz The result has a full address. The street number
Nikolaikirchplatz 5, 10178 Berlin, belongs to a building not associated with the POI and
10178 Berlin, Germany should be considered incorrect. The street within the
Germany address matches the official street address.
Incorrect – Street Number,
Address Accuracy
St. Nicholas’ Church Street Name
Poststraße 1, The result has a full address. The street name does
10178 Berlin, not match the official street name, so both address
Germany components should be considered incorrect.

[Link]. No Official Address

If no official street address is found, the result street address can be rated as Can’t Verify or
Incorrect unless another official source, like street imagery, can be found to confirm the returned
address. When there is no official address the returned street address cannot be confirmed and
therefore cannot be considered correct. (Please see your Country-Specific guideline for more
details.)

Full Address: If the full address belongs to another building not associated with the POI (even if they
are on the same street) it should be rated Incorrect. When the result contains a full address it should
be rated Can’t Verify if all of the following apply:

• It belongs to a building associated with the intended POI/entity

• The street provides access to the intended POI

m
Sa �fro ez
Street:t
IP� rdau When the result address is just a street it should be rated Can’t Verify if: 2 4
20 art�n
1 y , �
• 72The.16 ,�street
F provides access to the intended POI 1 7 �M
.25 ebrua ary� scar
u
4.9 ry� ebr 9�by�O ue
Determining Access:
� b 1 , � F
Ma y�O ,�2
nri sc 024
7
r d ay .254. anriq
qu ar �fro atu 72.16 M
A person must beeable�Mtoarreach m the POI directly from the given street byS walking
� 1 or driving. This
t�n IP
includes: ez
• Streets providing access by following the boundaries of the feature or leading into it.
113
 • T-intersections: m
• A street ending at an 4 � fro ez
intersection does not provide access to the feature on the other
side of it. , �2 02 art�n
17 ar�M
• A street provides a ry� scaccess to a feature when it continuesSa through the feature (even as a
tur
r u �O I
different road Fe b type
�b y with
u e or without a different name) as Plong
� 1 72 as
da it keeps its original name on
y,�F
y ,� 4.9 riq
the other d a side
2 5 of nthe feature, and by doing so provides physical . 16 .25access.
ebr
• Ignore Ma
tur 2.16. restrictions ua
Sa access
1 7 when considering whether a street provides 4 .9� access
ry�
17
or not.
I P � M b y ,
an �Os �202
riq car
ue �M 4�fro
art m
�ne
z

Result Rating and Explanation

Address Accuracy Can’t Verify

Grosvenor Square Garden The result address is the street in front of the result POI. Like the
Grosvenor Square, example illustrated above, this street provides direct access to the
London result POI.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 Address Accuracy Incorrect – Street Name ,
2.1 y,�Fe 1 7 �M
Grosvenor b
6.2 Square ry� scar
54 ruar Garden The street ends in a T-intersection with the parkebon u a
r the �Oother side.
N Audley M St..9�by y�17, � F 9 �by que
an �Os �202 The street does not continue on the other side y as 4it becomes
, . ri S
London riq car Audley St. and is therefore rated Incorrect.
urda 16.25 Man
ue �M 4�fro t
Sa 172.
art m
�ne IP�
z

114
 Result m Rating and Explanation
4 � fro ez
2 rt�n
7 , �20 Address
a Accuracy Incorrect – Street Name
y �1 ar�M S
r c atu
rua y�Os The result address is just a street. I The street does not provide
Charles de Gaulle F
b
Airport
e e
�b qu direct access to the result POI and P �17 rday,
, � . 9 i should
2.1 �Febe considered Incorrect.
Rue A. Parreux,
u r day 6.254 anr 6.2 bru
t 2.1 M 54
Mauregard 17
S a
� .9� ary�1
IP Ma by�O 7,�2
nri sc 024
qu ar�M �fr
e art om
�ne
Address Accuracy Incorrect – Street Number z
Charles de Gaulle Airport The result has a full address. The street provides direct access
4 Rue de la Fossette, however, the street number belongs to a building not associated
Mauregard with the result POI and should be considered Incorrect.

Address Accuracy Incorrect – Street Number, Street Name

Charles de Gaulle Airport The result has a full address. The street does not provide direct
64 Rue de Claye, access to the suggestion POI and the street number is associated
Mauregard with another entity. Both address components should be
considered Incorrect.
Address Accuracy Incorrect – Locality

Zurich Airport Since the airport is associated with a distinct locality “Kloten” it
requires at least a locality name and is rated Incorrect – Locality if
this is missing.

9. Pin Accuracy
For each result returned, you will find a pin on the map. Rate the accuracy of each pin’s placement
using this scale:

• Perfect
• Approximate
• Next Door
• Wrong
• Can’t Verify

The pin should be a reflection of the result: The location represented by the pin should reflect the
Sa Pin ratings should be evaluated individually and not influenced by address or other data.�frAompin
result.
can
tur
IP� be correct
d when other rating components are rated wrong. 2 0 24 rt�nez
17 a , � a
2.1 y,�Fe y �17 ar�M
6.2 bru ar s c
Missing Pins
54
.9� ary�1 e bru �by�O e
Ma by�O 7,�2 � F 9 u
nri sc 024 r d ay, .254. anriq
qu ar�M �fr tu 2.16 M
If a pin for a result e doesanotoappear
m Sa happens
on a map, rate the pin Wrong. If this 1 7 five or more
r P �
times in a row, release thet�ntask
ez for technical reasons and explain why inIthe comments box.

115
 om
9.1. General Considerations 24�fr nez
0 rt�
�1 7,�2 r�Ma
The following chapters will ryprovidea more detail on how to evaluateSapin placement based on the
r ua �Osc IP� turthe
feature presented. They Fe b describe
�b y e issues to consider when evaluating
17 day,�pin.
y ,� 4.9 riq u 2.1 Fe
a
rd 16.25 Man 6.2 bru
t u
9.1.1. PinSResources 54
a 72.
� 1 .9� ary�1
IP Ma by�O 7,�2
Rate pin placement according to consensus from multiple reliable online resources. 0
nri sc These
qu ar�M 24�frresources
should include both aerial and street-level views whenever possible. Reliable resourcesarinclude:e o
t�n m
ez
• Reliable online map resources, including vector and hybrid views
• Hybrid views may provide additional points of reference including the locations of
streets
• Street imagery
• Accurate street-level imagery can also be found on claimed social media sites,
crowdsourced user review sites, and articles in primary publications (newspapers or similar
publications that do their own reporting)
• Official venue maps and directories, which can contain information not available in street
imagery
• Government property registries

Note: After consulting these research resources, always verify pin placement using the layers
provided in the TryRating tool. This means that even if you have gathered coordinates elsewhere, you
must rate pin placement based on what you can actually see in the TryRating layers.

Leave comments including coordinates and links to resources if the pin rating was difficult to
determine or if you could not verify the pin’s placement.

9.1.2. Satellite Imagery vs. Vector Map

When there is a difference between where the pin drops in satellite imagery and the vector map,
always use the map layer in the TryRating tool that is more generous toward the pin. For example, if
the pin drops on the rooftop in satellite imagery, but in the parking lot in vector map, rate using
satellite imagery because a pin on a rooftop will get a better rating than a pin placed in a parking lot.
Even if there is a major shift between satellite imagery and the vector map in a larger area, such as a
complete city or region, rate according to the most generous layer.

Note: When deciding between the generosity of the vector and satellite views for pin rating, use only
the vector/satellite views provided in the TryRating tool.
m
In cases
Sa
t u where the vector map is more generous toward the pin but does not show any building
2 4 �fro ez
IP� rda use satellite imagery as a reference to locate buildings on the vector map to allow
contours,
17 y 7 , � 20forart�n
2 ,�F 1 ar�M
rooftop.1ratings.
6.2 ebruIf satellite imagery is unavailable, use your best judgment to determine a ry� the c correct
location of 5the ary
4.9 pin. e b r y�Os
u
�b e
Ma �by�O �17,�2 ay,�F 54.9 nriqu
nri sc 024 d .2 Ma
In the screenshot a
qu below, turit2is .16difficult
e r�Mathe �frovector map does not provide any contours,Saso
m � 1 7 to determine
r
where each building is. Satellite ez imagery should be used instead.
t�n I P

116
 m
� fro ez
Vector Image 2 4 n Satellite Image
7 , �20 art�
1 �M
a ry� scar Sa
u
ebr 9�by�O ue IP� turda
F 17
, � . iq 2.1 y,�Fe
u r day 6.254 anr 6.2 bru
t M
Sa 172.1 54
.9� ary�1
IP � Ma by�O 7,�2
nri sc 024
qu ar�M �fr
e art om
�ne
z

9.1.3. Boundaries of the Feature

To rate a pin for a feature, you must first understand where the feature begins and ends. Some
features have rooftops (houses, businesses, malls, and so on) and sit on a parcel of land that belongs
to or is associated with them. Other features do not have rooftops (mountains, parks, waterfalls), but
there is still a place where they begin and where they end.

A boundary is a real or imaginary line that separates one feature, or the parcel it sits on, from another.
The boundaries of a feature always include half of the road when a road is present (see the Half 'n
Half rule below).

Boundaries can include:

• Fences
• Walls
• Garden plants and bushes
• Bodies of water (lakes, rivers, oceans)
• Other dividers
• Property boundaries confirmed by official sources

If there is no divider, draw an imaginary 90-degree line to the road or use the Half 'n Half rule below.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

117
 Example m Explanation
4 � fro ez
2 n
EXAMPLE TYPE: SINGLE RESIDENTIAL 7 , �20 art� PROPERTY
1 �M
a ry� scar Sa
1556 Tobias Dr u
ebr 9�by�O ue IP� turda
F 17
San Jose, CA 95118 , � . iq 2.1 y,�Fe
u r day 6.254 anr 6.2 bru
t M
Sa 172.1 54
.9� ary�1
IP � Ma by�O 7,�2
nri sc 024
qu ar�M �fr
The property boundary is defined
e by
art half
om of the
road on one side and physical dividers �nelike brick,
z
concrete, and wooden fences on the others.

EXAMPLE TYPE: SHOPPING CENTER

2086 NewPark Mall

Newark, CA 94560

The property boundary is defined by the roads

surrounding the shared parking lot.

$"#"N"#"%O9CU%VB%O9CU%9B,%2)BB>;%.:C);

In dense areas it may be difficult to find boundaries between parcels. In these cases, divide the space
between the street or next building in half to create a boundary. Use this "Half 'n Half" rule to
determine the Approximate and Next Door pin locations. m
Sa
t u 2 4 �fro ez
IP� rda
17 y 7 , � 20 art�n
2.1 ,�Fe 1 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
b ,
Ma y�O ,�2 7
nri sc 024 r d ay .254. anriq
qu ar�M �fr tu 6 M
e art om Sa 172.1
IP �
�ne
z

118
 Example m Explanation
4 � fro ez
02 art�n
�2TO
EXAMPLE TYPE: HALF ’N HALF 1 7 ,
�MSTREET
a ry� scar Sa
e bru �by�O e IP� turda
F 17
a y,� 54.9 nriqu 2.1 y,�Fe
d 6.2 Ma 6.2 bru
tur
Sa 172.1 54
.9� ary�1
IP� Ma by�O 7,�2
nri sc 024
qu ar�M �fr
e a om
Extend the feature boundaries to thert�middle
nez of
the road(s). The example shows how Will Rogers
Dr (to the south) and Saratoga Ave (to the east)
are divided in half to define the outer limits of the
Approximate area.

EXAMPLE TYPE: HALF ’N HALF TO NEXT BUILDING

The space between two buildings can be divided

in half to create a boundary for an Approximate
pin placement.

Use natural boundaries as much as possible to draw the line between a Perfect, Approximate,
Next Door, and Wrong pin locations.

To address close calls, apply the Tennis Rule:

•If the tip of the pin is still touching the line, the pin is considered inside the
boundary. m
Sa
t u 4 �fro ez
IP� rda •If the tip of the pin points outside, it is outside of the boundary. 20 rt�n 2
� a
17 y
2.1 ,�Fe y � 17, ar�M
6.2 bru a r s c
54
.9� ary�1 e bru �by�O e
Ma by�O 7,�2 � F 9 u
nri sc 024 r d ay, .254. anriq
qu ar�M �fr tu 6 M
e art om Sa 172.1
IP �
�ne
z

119
$"#"N"G"%%RA:B,9E>);%>B%7H9E),%7(9*); m
4 � fro ez
02 art�n
�2or
When a feature shares a parcel 7 , parking lot with other entities and the same space is used to
�1 ar�M
access many entities, itrucan ary O bes c difficult Sa
to determine a feature’s boundaries.
tur In cases like this:
e b y � e I P da
�b qu �17
• Use theuguidance
d a y,�F 54.9provided
n ri in Boundaries of the Feature
2.1 y,�Fe
2 6.2 bru
t r 2.16. Ma 54 rule
S a
• If the shared 7 parcel contains any through roads, apply the Half ’n Half .9� aryto them:
� 1 b � �17,�
IP
• Through roads are part of the public road network that can be M an yto
used Ogo to2 places other
riq scar 024�
than the specific parcel u e �M fro
art m
• The Half n‘ Half Rule may also be applied to the parcel’s internal access roads �neif they
meet all three of these conditions: z
• They must continue all the way through the parcel and
• They must have an exit and entrance to public roads at both ends and
• They must be continuously and clearly separated from the shared parking areas by
curbs, barriers, road markings, do not cross lines, or similar features
Note: If all three of the conditions above do not apply, then an internal access road cannot be
considered a boundary.

Example Explanation
EXAMPLE TYPE: BOUNDARIES OF AN ENTIRE CAMPUS

Stanford Shopping Center

This is the Stanford Shopping Center, a campus

containing multiple buildings and POIs. When
this shopping center is the result, the entire
parcel is Perfect. This includes all buildings,
parking lots, and parking structures on both the
north and south sections of the mall on either of
side Arboretum Rd, the public road that cuts
through the parcel.
m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

120
 Example m Explanation
4 � fro ez
2
20 AaPOI n
rt� IN A SHARED SPACE WITH THROUGH ROADS
EXAMPLE TYPE: BOUNDARIES 7,�OF M
�1 ar �
ry Sa
ua �Osc t
Nordstrom @ Stanford Fe b r
Shopping
�b y e Center I P�1 urda
y,� 54.9 nriq u 72 y,�F
da
r 16. Ma2 .16 eb
t u .25 rua
Sa 172. 4.9 ry�
�b 17
� M
I P an y�Os ,�202
riq car
ue �M 4�fro
art m
�ne
z

The Nordstrom department store is located in

the south section of the shopping center’s
parcel.

When Nordstrom (shown in green) is the result,

only the south part of the mall up to 1/2 of
Arboretum Road is rated Approximate (shown
in yellow). This is because Arboretum Road is a
public road that can be used to access places
outside the parcel. The north side of the parcel
(shown in red) is rated Wrong since the public
road acts as boundary to Nordstrom’s
Approximate area.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

121
 Example m Explanation
4 � fro ez
2
20 AaPOI n
rt� IN A SHARED SPACE WITH NO THROUGH ROADS
EXAMPLE TYPE: BOUNDARIES 7,�OF M
�1 ar �
ry Sa
ua �Osc t
Pho 2 Love
F e b r
�b y e I P�1 urda
6593 W Colfax Ave y,� 54.9 nriq u 72 y,�F
da
r80214 2
. Ma .16 eb
Lakewood, CO t u 1 6 .25 rua
Sa 172. 4.9 ry�
�b 17
� M
I P an y�Os ,�202
riq car
ue �M 4�fro
art m
�ne
z

Pho 2 Love is a Vietnamese restaurant in a strip

mall with shared parking that has no public or
internal access roads passing through it. The
entire shared parcel is rated Approximate
(yellow area) and only the section of the rooftop
over the restaurant is rated Perfect (green
area). This is because the exact location of the
business can be confirmed with street imagery
or other strong evidence.

9.1.4. Next Door

A pin is considered Next Door if it drops on the immediate property next to the intended one. A Next
Door pin must be:
• On the same street as the intended property
• The Next Door property must share the same street name as the intended property
• On the same side of the street as the intended property
• The first property to any side of the intended property
S•a On the same block as the intended property m
t u 2 4 �fro ez
IP� rda
17 y 7 , � 20 art�n
2.1 ,�Fproperty"
"Immediate refers to the boundaries of the property as a whole, even if there 1 ar�M
6.2 ebru ary� isscno rooftop.
Determine 5the boundaries
a
4.9 ry as explained in Boundaries of the Feature. b r u � O
y
Ma �by�O �17,�2 y , �Fe 4.9�b ique
r
n i sc 024 rda 16.25 Man
Note that the rHalf qu ’narHalf rule
�M �fro explained in Section [Link] also applies to Next
t u
Sa 172. Door properties
e art m
�ne IP�
z

122
No Next Door for Shared Spacesrom
0 2 4�f �nez
rt
�2 aanother
A feature cannot be Nexty�Door 17, ar�toM feature within the same property boundaries. This
means that two buildings r in thec same shared parking lot or parcelSacan
IP� turdanever be rated as Next
u a s
e br �by�O e
Door to one another. F
y,� 54.9 nriq u 17
2.1 y,�Fe
r da 2
. Ma 6.2 bru
S atu 72.16 54 ary
There will also�1be no Next Door ratings made outside the parcel or shared Ma y�O �17Any
.9space.
� b pin falling
I P ,
outside of the Approximate area will be marked Wrong. nri sc �2024
qu ar�M �fr
e art om
�ne
z

9.1.5. Can’t Verify (Smallest Identified Area)

When a specific rooftop or boundary cannot be identified, Perfect cannot be given. In these cases,
Can’t Verify can be used if the pin is within the smallest area that can be identified as a potentially
correct location. A pin outside of this area is considered Wrong.

The Can’t Verify rating will also be used when an address is rated Incorrect (Address does not
exist).

Example Explanation
920 Remour Ln
Mount Shasta, CA 96067

There is no street imagery in the area, so the

exact location of 920 Remour Ln cannot be
determined, though its existence is confirmed
by the postal service. Remour Ln is a dead-end
street, and satellite imagery allows us to confirm
the location of the the last properties on the
street. The last building number that can be
confirmed is 912. We can now create a m
Sa perimeter within which the pin should be 4�fro ez
IP� turda dropped (teal area).
2
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 Can’t Verify -> All pins dropped F y�O e the teal
ebr 9�bwithin
Ma by�O 7,�2 , � . u
nri sc 024 area r d ay .254 anriq
qu ar�M �fr
e atu 72.16 outside
Wrong -> All pins Sdropped M the teal area
art om � 1
�ne IP
z

123
 Example m Explanation
4 � fro ez
2 n
350 352 Bukit Batok Street 34 7 , �20 art�
1 �M
Singapore, 650352 a ry� scar Sa
u
ebr 9�by�O ue IP� turda
F 17 imagery
, � . iq There is satellite2.1 y,�Fe for this area, but
r day 6.254 anr b
6.2 exact
t u M clouds cover the the 54 rualocation of the
Sa 172.1 ry�
.9� from
� address. Using evidenceMa y�O 7,�2 reliable
b 1 other
IP
resources, a perimeter nfor riq where
sc the 02 pin should
ue ar�M 4�fro
be dropped can be established (teal art area).
m
�ne
z
Can’t Verify -> All pins dropped within the teal
area
Wrong -> All pins dropped outside the teal area

9.2. Single Rooftop

Rating Explanation
Perfect Pin falls on the rooftop of the intended property.

Approximate Pin falls within the boundaries of the property, including on any rooftop that’s not
the intended one.
Next Door Pin falls on the next door property.
Pin falls outside of the property boundaries or next door property. Any pin falling
Wrong
outside of the Approximate area in a shared space will be rated Wrong.
m
Can't
Sa Verify See Can’t Verify �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

124
 m
Best Available Evidence 4 � fro ez
2 n
7 , �20 art�
1 ar�M
Pin rating for most features a ry� found
sc under rooftops is based on theSbest atu available evidence for that
b r u � O I rda a feature’s location, the
feature's location.,�That
F e is,
�b the
y more evidence that can be found to�17verify
e P
. 9
ypin’s54location r i q u 2.1 y,�Fe
more precise uthe da 2 n must be in order to be rated Perfect. This
6.2 isbrtrue whether or not
at r 2.16. Ma 5 ua
the feature's 1address
S includes a unit number, because the goal is to .find 4 rthe
y location of the
� 7 9
Ma �by�O �17,�2
feature. IP nri sc 024
qu ar�M �fr
e art om
If street imagery or other strong evidence can be found to confirm a feature’s specific location �ne
under a shared rooftop, only that location will be considered Perfect. z

If a shared rooftop can be identified but there’s no strong evidence to confirm the feature’s specific
location under it, the entire rooftop will be considered Perfect.

If several rooftops share an address and there’s no strong evidence to confirm which rooftop the
feature is under, all rooftops will be considered Can’t Verify.

Note: This general pin rating rule does not apply to transit POIs, which have their own pin rating
rules.

Example Explanation

EXAMPLE TYPE: INDIVIDUAL HOME

5507 Dent Ave

San Jose, CA 95118

Perfect -> The pin is on the rooftop specified in

the query address (green area)
Approximate -> The pin is within the boundaries
of the feature (yellow area)
Next Door -> The pin is on the immediate property
next to the intended feature (purple area)
Wrong -> The pin falls outside of the property m
Sa �fro ez
IP� turda boundaries or Next Door property (everything 2 4
�20 art�
n
17 ,
2.1 y,�Fe else) 1 7 �M
6.2 bru ary� scar
Can’t Verify -> See Can’t Verify u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

125
 Example m Explanation
4 � fro ez
2 rt�n
EXAMPLE TYPE: MULTIPLE STREET 7 , �20 aNUMBERS UNDER ONE ROOFTOP WITHOUT SHARED PARKING
1 �M
a ry� scar Sa
t
u �O
e b r
�b y e I P�1 urda
Breitensteinstrasse 77,
F 8037
y,� 54.9 nriq Zurich
u 72 y,�F
da
r 16. Ma2 .16 eb
t u .25 rua
Sa 172. 4.9 ry�
�b 17
Available resources
I P � can have a big impact on rating when a pin is droppedM anonya�Orooftop
,�2 with multiple
street numbers under it. riq car 024�
s
ue �M fro
art m
This result is a residential townhouse without shared parking. �ne
z
Note that the same rating principles apply to buildings with patchwork rooftops.

Using street imagery or other strong evidence, four

entrances for the street numbers can be identified:
75, 77, 79 and 81. Once the rooftop area where the
pin should be dropped is determined, draw
imaginary lines to delimitate that area. A pin
With evidence dropped within that area will be rated Perfect. A
pin dropped within the property boundaries of the
perfect rooftop will be rated Approximate. The
rest of the connected rooftop with the appropriate
property boundaries will be rated Next Door
(purple area) or Wrong (red area) if the
corresponding rooftop portion is farther than the
Next Door property.
Perfect -> The pin is on correct portion of the
rooftop (green area)
Approximate -> The pin is within the boundaries
of the feature (yellow area)
Next Door -> The pin is on the immediate property
next to the intended feature (purple area)
Wrong -> The pin falls outside of the property
boundaries or Next Door property. (everything else)
Can’t Verify -> See Can’t Verify

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

126
 Example m Explanation
4 � fro ez
2 n
7 , �20 art�
1 �M
a ry� scar Sa
u
ebr 9�by�O ue IP� turda
F 17
, � . iq 2.1 y,�Fe
u r day 6.254 anr 6.2 bru
t M
Sa 172.1 54
.9� ary�1
IP � Ma by�O 7,�2
nri sc 024
qu ar�M �fr
e art om
�ne
z

Without street imagery or other strong evidence,

research may indicate that the address range under
the rooftop is 75 to 81, but the locations where the
middle numbers 77 and 79 start and end cannot be
determined. In this case, a pin falling anywhere on
Without evidence the correct rooftop will be rated as Perfect, even if
the precise location on the rooftop for #77 cannot
be determined. A pin falling within the property
boundaries will be considered Approximate and
the buildings to the right and to the left will be
considered Next Door.
Perfect -> The pin is on the rooftop (green area)
Approximate -> The pin is within the boundaries
of the feature (yellow area)
Next Door -> The pin is on the immediate property
next to the intended feature (purple area)
Wrong -> The pin falls outside of the property
boundaries or Next Door property (everything
else)
Can’t Verify -> See Can’t Verify

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

127
 Example m Explanation
4 � fro ez
2 rt�n
EXAMPLE TYPE: ONE BUILDING , �20WITHa
y �1 ar�M MULTIPLE STREET NUMBERSSIN A SHARED PARKING LOT
7
ar sc a
Supercuts e bru �by�O e IP� turda
,�F 4.9 riqu 17
1054 E El Camino a yReal 5 n 2.1 y,�Fe
d
r 16. Ma 2 6.2 bru
Sunnyvale,SCAatu 94087
7 2 . 54
.9� ary�1
� 1 Ma by�O 7,�2
IP
The result is a business (or an address) under a connected rooftop with multiple nri sstreet
qu car�M 24numbers
0
�f
under it. This result shares a parking lot with other features. e art rom
�ne
z
Note: If there are any other buildings within the shared parking lot that are not connected to the
Perfect location, they will also be rated Approximate.

This guidance also applies to residential buildings with shared rooftops, like townhouses.
With evidence
With street imagery or other strong evidence, the
exact location of the business (or address) can be
confirmed. Draw imaginary lines on that part of the
shared rooftop to create the area for Perfect. The
rest of the connected rooftop and the shared
parking lot are rated Approximate.

Remember: Make no Next Door ratings outside

the parcel or shared space. Any pin falling outside of
the Approximate area in a shared space will be
rated Wrong.

Without evidence

Without street imagery or other strong evidence,

only the location of the entire rooftop under which
the business (or address) is located can be
determined. The business’ exact location under the
rooftop cannot be determined. In this situation, the
whole rooftop becomes Perfect. The shared
parking lot will be Approximate. m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

128
 Example m Explanation
4 � fro ez
2 rt�n
EXAMPLE TYPE: ONE BUILDING , �20WITHa
y �1 ar�M A SINGLE STREET NUMBER AND
7
S
MULTIPLE UNIT NUMBERS IN A
SHARED PARKING LOT ru �Os a r c a
e b �by e IP� turda
F 17
a y,� 54.9 nriq u 2.1 y,�Fe
Subway d 2 6.2 bru
tur 2.16. Ma 54
S a
1923 59th Ave1#155
� 7 .9� ary�1
P
Greeley, CO I80634 Ma by�O 7,�2
nri sc 024
qu ar�M �fr
The result is a business (or an address) under a rooftop that has a single street enumber, om
art multiple
�ne
unit numbers, and shares a parking lot with other features. It will be rated exactly the samezway as a
result whose address does not include a unit number. Whether a result contains a unit number or
not, the goal is to use the best available evidence to find the result’s location.

Note: If there are any other buildings within the shared parking lot that are not connected to the
Perfect location, they will also be rated Approximate.

This guidance also applies to residential buildings with shared rooftops, like townhouses.
With evidence

With street imagery or other strong evidence, the

exact location of the business (or address) can be
confirmed. Draw imaginary lines on that part of the
shared rooftop to create the area for Perfect. The
rest of the connected rooftop and the shared
parking lot are rated Approximate.

Without evidence

Without street imagery or other strong evidence,

only the location of the entire rooftop under which
the business (or address) is located can be
determined. The business’ exact location under the
rooftop cannot be determined. In this situation, the
Sa whole rooftop becomes Perfect. The shared�from
IP� turda parking lot will be Approximate. 2 0 24 rt�nez
17 , � a
2.1 y,�Fe y �17 ar�M
6.2 bru a r s c
54
.9� ary�1 e bru �by�O e
Ma by�O 7,�2 � F 9 u
nri sc 024 r d ay, .254. anriq
qu ar�M �fr tu 6 M
e art om Sa 172.1
IP �
�ne
z

129
 Example m Explanation
4 � fro ez
2 n
EXAMPLE TYPE: MULTIPLE ROOFTOPS 7 , �20 art� WITH THE SAME STREET NUMBER AND MULTIPLE UNIT
1 �M
NUMBERS a ry� scar Sa
t
u
F e b r
�b y � O
e I P�1 urda
Samurai Sam’s ay,� 54.9 nriq u 72 y,�F
d
r 1St, 2
. Suite a5 .16 eb
4801 Washingtont u 6 M .25 rua
Sa 172. 4.9 ry�
Phoenix, AZ 85034� M �b 17
I P an y�Os ,�202
r q car
The result is a business (or an address) under a rooftop that's one of several irooftops ue 4�f
�M sharing a
art rom
single street number and containing multiple unit numbers. All the buildings share a parking �ne lot.
z
(The small rectangles on the bottom right are solar parking covers, not buildings.)

This guidance also applies to residential buildings with shared rooftops, like townhouses, and to
situations where the feature's address does not includes a unit number, because the goal is to find
the location of the feature (see Best Available Evidence sidebar on page 125).

With evidence for rooftop and unit With street imagery or other strong evidence for
locations the location of the rooftop and the unit under it, the
exact location of the business (or address) can be
confirmed. Draw imaginary lines on that part of the
shared rooftop to create the area for Perfect. The
rest of the connected rooftop and the shared
parking lot are rated Approximate.

Note: If there are any other buildings within the

shared parking lot that are not connected to the
Perfect location, they will also be rated
Approximate.

When there is street imagery or other strong

With evidence for rooftop location only evidence for the location of the specific rooftop at
the address where the unit is, but no evidence for
the location of the unit under it, only the location of
the entire rooftop can be confirmed. In cases like
this, the entire rooftop will be Perfect. The shared
parking lot will be Approximate.

Note: If there are any other buildings within the

shared parking lot that are not connected to the
Perfect location, they will also be rated
Approximate. m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

130
 Example m Explanation
4 � fro ez
2 n
7 , �20 art�
1 �M
a ry� scar Sa
u �O
ebr 9rooftop IP� turda
Without evidence Ffor �by que or unit 17
, � .
54 anri for parcel
ay .2evidence 2.1 y,�Fe
locations, butu r dwith6 6.2 bru
t M
Sa 172.1 54
.9� ary�1
IP � Ma by�O 7,�2
nri sc 024
When there is no strong evidencequ arfor
e �M the
�frolocation
of the rooftop or the specific unit underart it, m
�ne but there
is evidence for the location of the parcel, all z
rooftops within the parcel will be rated Can't Verify
and the parcel will be rated Approximate.

EXAMPLE TYPE: ONE BUILDING WITH SINGLE STREET NUMBER AND MULTIPLE BUSINESSES UNDER
THE ROOFTOP

Circle K
925 Wonderland Rd South
London, Ontario, Canada N6K 2V8

The result is a business under a single rooftop that has one street number and contains multiple
business.

A nail salon, a pharmacy, a dental office, and other businesses all share this address.

With evidence

With street imagery or other strong evidence, the

exact location of the result under the shared rooftop
can be confirmed. Draw imaginary lines on that part
of the shared rooftop to create the area for Perfect.
Sa The rest of the connected rooftop and parcel, from
IP� turda including all other rooftops that are not the 2 0 24� rt�nez
intended
17 , � a
2.1 y,�Fe one on the parcel, if they exist, are rated y �17 ar�M
6.2 bru a r s c
54 Approximate. bru �by�O e
.9� ary�1 � F e 9 u
Ma by�O 7,�2 ay, .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

131
 Example m Explanation
4 � fro ez
2 n
7 , �20 art�
1 �M
a ry� scar Sa
u
ebr 9�by�O ue IP� turda
F 17
, � . iq 2.1 y,�Fe
u r day 6.254 anr 6.2 bru
t M
Sa 172.1 54
.9� ary�1
IP � Ma by�O 7,�2
nri sc 024
qu ar�M �fr
e art om
�ne
z

Without evidence

Without street imagery or other strong evidence,

only the location of the entire rooftop under which
the business is located can be determined. The
business’ exact location under the rooftop cannot
be determined. In this situation, the whole rooftop
becomes Perfect. The parcel will be Approximate.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

132
 Example m Explanation
4 � fro ez
02 art�n
EXAMPLE TYPE: SHOPPING�1MALL 7,�2 r�MWITH A SINGLE ROOFTOP
a ry sca Sa
t
u �O
Westfield Valley Fair Fe b r
�b y e I P�1 urda
y,� Blvd4.9 nriq u 72 y,�F
2855 Stevens Creek da
r 16. Ma2 5 .16 eb
t u .25 rua
Santa Clara, 2.
SaCA1795050 4.9 ry�
� M �b 17
I P an y�Os ,�202
riq car
This large shopping mall contains many stores under one rooftop at the same �M 4�fro
uaddress.
e art m
�ne
z

Perfect -> The pin is on the rooftop (green area)

Approximate -> Parking structures (entire
structure included). Approximate boundaries are
found when Half 'n Half rule is applied to the street
and parking lots are included (yellow area)

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

133
 Example m Explanation
4 � fro ez
02 rt�n
EXAMPLE TYPE: STORE IN A�1MULTI 7,�2 r�M-aSTORY MALL
ry a Sa
b r ua �Osc IP� turda
H&M e y
y ,�F 4.9�b rique 17
2.1 y,�Fe
1004 Stoneridge d Mall
a 25Rd Suite
an A 105 6.2 bru
tur 9458816. M 54
Pleasanton,SaCA
17 2 . .9� ary�1
IP� Ma by�O 7,�2
With evidence nri sc 024
qu ar�M �fr
e art om
�ne
z

The exact location of this POI cannot be determined

by using street imagery, but the official mall
directory provides strong evidence for the H&M's
location. Using this evidence, the exact location of
the result under the shared rooftop can be
confirmed. Draw imaginary lines on that part of the
shared rooftop to create the area for Perfect. The
rest of the connected rooftop and parcel are rated
Approximate.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

134
 Example m Explanation
4 � fro ez
2 n
7 , �20 art�
1 �M
a ry� scar Sa
u
ebr 9�by�O ue IP� turda
F 17
, � . iq 2.1 y,�Fe
u r day 6.254 anr 6.2 bru
t M
Sa 172.1 54
.9� ary�1
IP � Ma by�O 7,�2
nri sc 024
qu ar�M �fr
e art om
�ne
z

Without evidence

Without street imagery or other strong evidence,

only the location of the entire rooftop under which
the business is located can be determined. The
business’ exact location under the rooftop cannot
be determined. In this situation, the whole rooftop
becomes Perfect. The parcel will be Approximate.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

135
 Example m Explanation
4 � fro ez
2 n
EXAMPLE TYPE: EMPTY PLOT 7 , �20 art�
1 �M
a ry� scar Sa
t
u
86 Liberty St. Fe b r
�b y � O
e I P�1 urda
y,� 54.9 nriq u 72 y,�F
Binghamton, NY da
r 16. Ma2 .16 eb
t u .25 rua
Sa 172. 4.9 ry�
All features Ithat
P� do not have a rooftop will be rated as Perfect if the pin Mis dropped
�b 17 within the
an y�Os ,�202
boundaries of the feature. riq car
ue �M 4�fro
art m
�ne
z
Perfect -> The pin is within the boundaries of the
feature (green area)
Approximate -> There is no Approximate
Next Door -> The pin is on the immediate property
next to the intended feature (purple area)
Wrong -> The pin falls outside of the property
boundaries or Next Door property (everything else)
Can’t Verify -> See Can’t Verify

EXAMPLE TYPE: HIGH-DENSITY URBAN AREA

57 Neal Street
London, England
m
In
Sa
this
t u example, the rooftop behind the intended feature will not be considered Next Door. Next
2 4 �fro ez
IP� rda
, � 20 art�n
Door172will ,be
.16 �Febconsidered to the left or right of the intended feature.
y 1 7 �M
.25 rua a ry� scar
u �O e
The screenshot
4.9 ry�
� shows
1 that the boundaries of the Next Door property contain � ebr of
half
F 9 � bythe ustreet. The
b , .
Ma y�O ,�2 7 ay .254 anriq
building behind nri the scaPerfect
02 building is not considered Next Door because r d it has a different street
qu r�M 4�fro S atu 72.16 M
address. e art m 1
�ne IP�
z

136
 Example m Explanation
4 � fro ez
2 n
7 , �20 art�
1 �M
a ry� scar Perfect -> The pin Sa is on the rooftop specified in
t r
u
ebr 9�by�O ue I
the address (greenP�1 uarea)
d
, � F . iq 72 ay,�F
u r day 6.254 anr Approximate -> The . 16pin eisbrwithin the boundaries
.25
t
Sa 172.1
M of the feature (yellow area) 4.9 uary�
� �by 17,
IP Next Door -> The pin isMon an the �Osimmediate
�20 property
24
next to the intended featureri(purplequ car�Marea)
e � f ro
Wrong -> The pin falls outside of theaproperty rt�n m
ez
boundaries or Next Door property (everything
else)
Can’t Verify -> See Can’t Verify

EXAMPLE TYPE: CORNER HOUSE

44 Russel Square
London, England

Here there is only one property that qualifies as Next Door. The property marked in red is on
another street (Montague Street) and does not meet all the criteria for the rating of Next Door.

When a property is on a corner, the Next Door property can be behind it as long as that property
shares the same street name.

Perfect -> The pin is on the rooftop specified in

the address(green area)
Approximate -> The pin is within the boundaries
of the feature (yellow area)
Next Door -> The pin is on the immediate property
next to the intended feature (purple area)
Wrong -> The pin falls outside of the property
boundaries or Next Door property (everything m
Sa �fro ez
IP� turda else) 2 4
�20 art�
n
17 ,
2.1 y,�Fe Can’t Verify -> See Can’t Verify ry�1 car�M 7
6. br a s
44 Russel25Square,
4.9 uary� London, England e bru �by�O e
Ma �by�O 17,�2 � F 9 u
nri sc 024 r d ay, .254. anriq
qu ar�M �fr tu 6 M
e art om Sa 172.1
IP �
�ne
z

137
 Example m Explanation
4 � fro ez
02 t�n
EXAMPLE TYPE: RURAL AREA7,�2 Mar
1 �
a ry� scar Sa
t
u
100 Mulligan Rd
Fe b r
�b y � O
e I P�1 urda
Laytonville CA ay,� 54.9 riq u 72 y,�F
d 2
r 16. Ma n .16 eb
t u .25 rua
Sa 172. 4.9 ry�
In rural areas, �the Next Door property will often be quite large. This is expected.
M �b 17
I P an y�Os ,�202
riq car
ue �M 4�fro
art m in
Perfect -> The pin is on the rooftop specified �ne
the address (green area) z
Approximate -> The pin is within the boundaries
of the feature (yellow area)
Next Door -> The pin is on the immediate property
next to the intended feature (purple area)
Wrong -> The pin falls outside of the property
boundaries or Next Door property (everything
else)
Can’t Verify -> See Can’t Verify

EXAMPLE TYPE: PIN ON THE SAME BLOCK

1491 Kooser Rd
San Jose, CA 95118

This property has only one next door neighbor because the property to the left, in red, is not on the
same block as the intended property.

Perfect -> The pin is on the rooftop specified in

the address (green area)
Approximate -> The pin is within the boundaries
of the feature (yellow area)
Next Door -> The pin is on the immediate property
next to the intended feature (purple area)
Wrong -> The pin falls outside of the property
boundaries or Next Door property
Can’t Verify -> See Can’t Verify

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

138
 m
9.2.1. Leaning Buildings 4 � fro ez
2 n
7 , �20 art�
1 �M
a ry� scar Sa
u
ebr 9�by�O ue IP� turda
Normal , � F Building
. iq Leaning17Building
2.1 y,�Fe
u r day 6.254 anr 6.2 bru
t M
Sa 172.1 54
.9� ary�1
IP � Ma by�O 7,�2
nri sc 024
qu ar�M �fr
e art om
�ne
z

Sometimes a building or buildings seem to be leaning in satellite view. They do not

appear to be standing straight and their rooftops are not aligned with their bases.

When a building or buildings appear to be leaning in satellite view, the satellite photos do not always
give accurate information about their shape or location. This is why even when a pin appears to land
on a leaning building, you cannot rely on satellite photos alone to rate pin placement.

Research the leaning building’s true location using consensus from multiple reliable resources,
including:

• Vector views
• Hybrid views, which may provide additional points of reference, including the locations of
streets the buildings lean over
• Street imagery
• Reliable online map resources

Always rate the pin based on the building’s actual location as confirmed by reliable resources, not on
the appearance of leaning caused by satellite photography.

If no reliable resources are available and the pin is not objectively wrong, rate Can’t Verify and leave
a comment.

Rating Explanation m
Sa
t u 2 4 �fro ez
IP� rda
1 Pin falls on the building’s actual location as confirmed by consensus , � 20 art�n
Perfect
72 y
.16 ,�Feb among multiple reliable sources. 1 7 �M
.25 rua ary� scar
u
4.9 ry�
� 1 F ebr 9�by�O ue
b
Ma y�O ,�2Pin falls
7 within the boundaries of the property including on any , � rooftop
ay .254. anriq
Approximate nri that’s 02 the intended one.
sca not r d
4 tu 6 M
qu
e r�Ma �from Sa 172.1
rt n IP �
Next Door See Next �Door. ez

139
Wrong Pin falls outside of�fthe rom property boundaries or next door property.
2 4 �n ez
0
�2 ar t
y �17, ar�M Sa
Can't Verify See Can’t r sc
ua Verify. t
Fe b r
�b y � O
e I P�1 urda
y,� 54.9 nriq u 72 y,�F
da
r 16. Ma2 .16 eb
t u .25 rua
Sa 172. 4.9 ry�
Satellite
� View Vector View M �b 17
I P an y�Os ,�202
Langham Tower and Jollibee Langham Tower and Jollibee riq car
ue �M 4�fro
art m
�ne
z

The tallest building seen in satellite view, above left, is Langham Place Office Tower,
located at the corner of Argyle and and Portland streets in Hong Kong.

While in satellite view the building appears to lean over both Argyle and Portland
streets, the vector view, above right, shows the building’s actual location.

The fast food restaurant Jollibee, circled in red on vector diagram, above right, is
located at 16 Argyle Street. It cannot be seen in satellite view because the tower leans
over it.

Target Screenshot Pin Rating

Location
Research shows that the pin lands
across the street from the building’s
actual location (green area), making
it Wrong.

Langham m
Sa
Place �fro ez
IP� turOffice 2 4
�20 art�
n
17 day,�
Tower 7 ,
2.1 Fe 1 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

140
 Target Screenshot m Pin Rating
� fro ez
Location 2 4 n
7 , �20 art�
1
ry� scar
�M Research shows Sa that the pin lands
a
u
ebr 9�by�O ue IP� turooftop
off the building’s rda (green
, � F . iq area), but on its17property,
y
2.1 Fe making it
, �
r day 6.254 anr 6.2 bru
t u M Approximate.
Sa 172.1 54
.9� ary�1
IP � Ma by�O 7,�2
nri sc 024
Langham qu ar�M �fr
e art om
Place Office �ne
Tower z

Although this pin appears to land

on Langham Place Office Tower in
the satellite photo, research shows
that the pin actually lands across
Jollibee, the street from the Tower on the
16 Argyle rooftop of the Jollibee at 16 Argyle
Street, Street (green area), making it
Mong Kok, Perfect.
Kowloon,
Hong Kong Note that while Jollibee cannot be
seen in satellite view, its location
can be confirmed by reliable
resources.

9.2.2. Residential Property with Multiple Buildings

Some residential properties consist of more than one building associated with a single address. A pin
falling on any house(s) on the property will be rated Perfect. If the evidence shows that any other
structure on the property could also be a dwelling, it can also be rated Perfect.

In cases where the property also contains support or auxiliary buildings, including, but not limited to,
sheds, garages, greenhouses, playhouses, pergolas, and doghouses, these structures should be m
considered
Sa
t u part of the Approximate area.
2 4 �fro ez
IP� rda
17 y 7 , � 20 art�n
2.1 ,�Fe 1 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
b ,
Ma y�O ,�2 7
nri sc 024 r d ay .254. anriq
qu ar�M �fr tu 6 M
e art om Sa 172.1
IP �
�ne
z

141
 Rating m Explanation
4 � fro ez
Pin falls on , 202 of
�any a
�n rooftop(s) of the house(s) within the boundaries of the
rtthe
Perfect 1 7 �M
property. a ry� scar Sa
t
u
e b r
b y � O
e I P�1 urda
Pin
� F falls
9 � withinu the boundaries of the property (or
72on ysupport or auxiliary
Approximate rday, .254. anriq .16 ,�Feb
tu buildings
6 M within it) .25 rua
Sa 172.1 4.9 ry�
�b 17
� M
Next Door I
P
The next door property. an y�Os ,�202
riq car
ue �M 4�fro
art m
Pin falls outside of the property boundaries or outside of the Next Door �ne
Wrong z
property.

Can’t Verify See Can’t Verify

Example Explanation
EXAMPLE TYPE: INDIVIDUAL HOME WITH SEPARATE GARAGE

1351 Navarro Dr
Sunnyvale CA 94087

This property contains two buildings: the main house and a garage. Both buildings are on the same
parcel, belong to the same entity, and share an address.

Perfect -> The pin is on the rooftop of the house (green

area)
Approximate -> The pin falls on the garage or within
the property boundaries (yellow area)
Next Door -> The pin falls on the next door property
(purple area)
Wrong -> The pin is outside the boundaries (everything
else)
Can’t Verify -> See Can’t Verify

m
Sa
t u 2 4 �fro ez
IP� rda
17 y 7 , � 20 art�n
2.1 ,�Fe 1 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
b ,
9.3. Multiple Ma Rooftops
y 7 ,
nri �Osc �2024 r d ay .254. anriq
qu ar�M �fr tu 6 M
e a om Sa 172.1
Some POI results consistrof �
t�n multiple buildings associated with/owned byIPa single business or POI. To
e
rate the pins for these resultsz correctly, you must research and understand the relationship of the
structures within the boundaries of the property (or parcel of land) to the POI.
142
 om z
�frmultiple
Two kinds of ratings are possible2for 4 e rooftop POI results:
, �2 0 art�n
17 ar�M
1. Multiple-Rooftop: When ry� the
u �Osc result is a POI that contains no other
a Sa POIs and consists of more than
t
one building with multiple
r
rooftops on the property. In cases likeI P�1 urprimary
this,
72 ay,�F rooftops will be rated
e b �b y e d
y F
,� 4.9 riq u
Perfect. The parcel
d 6of
a 25 land an inside the boundaries of the POI will be rated . 16 Approximate.
.25 ebrua Properties
2 . 1 . M one will be rated Next Door.
tur intended
next door toSathe 4 r
17 .9 y
IP� Ma �by�O �17,�2
nri sc 024
2. Campus: When a multiple-rooftop result is a higher education institution like a
qu a university
e r�Ma �fromor a
medical, retail, or other type of business complex, most often containing other public-facing rt�n POIs. In
ez
cases like this, the entire parcel or property inside the boundaries of the POI, including all rooftops,
will be rated Perfect. There will be no Approximate or Next Door ratings.

9.3.1. Multiple-Rooftop Rating

Single entities with multiple rooftops are single businesses or POIs that operate out of more than one
building. This category includes, but is not limited to, entities like factories, gas stations, apartment
complexes, company headquarters, lumberyards, and breweries, and other types of POIs that
generally do not contain additional businesses or POIs within them.

Every primary rooftop on the property will be rated Perfect. The parcel of land inside the boundaries
of the POI will be rated Approximate. Properties next door to the intended one will be rated Next
Door.

In cases where the property also contains support or auxiliary buildings, including, but not limited to,
guardhouses, dumpsters, storage sheds, donation bins, utility buildings, and toilets, these buildings
should be considered part of the Approximate area.

Rating Explanation

Perfect Pin falls on rooftops within the boundaries of the property.

Pin falls within the boundaries of the property (or on support or

Approximate
auxiliary buildings within it)

Next Door The pin falls on the Next Door property.

m
Sa �fro ez
t
IP� rdau Pin falls outside of the property boundaries or outside of the Next 2 4
20 art�n
Wrong
17 y , �
2.1 ,�Fe Door property. 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Can’t Verify b See ,Can’t Verify ,
Ma y�O 7
nri sc �2024 r d ay .254. anriq
qu ar�M �fr tu 6 M
e art om Sa 172.1
IP �
�ne
z

143
 Example m Explanation
4 � fro ez
2 rt�n
EXAMPLE TYPE: BUSINESS �WITH 7 , �20 MULTIPLE
a ROOFTOPS AT SAME ADDRESS (GAS
y 1 ar�M Sa
STATION) a r c
u �Os t
Fe b r
�b y e I P�1 urda
y,� 54.9 nriq u 72 y,�F
Super Gaz d a
r 16. Ma 2 .16 eb
t u . .25 rua
700 ChamblySa Road
1 7 2 4.9 ry�
�b 17
Longueuil, QC
�
I J4H 3M1 M
P an y�Os ,�202
Canada riq car
ue �M 4�fro
art m
�ne
This business (or address) is a gas station with a main building and a canopy over the z
pumps. All structures are on the same property, belong to the same business, and
share an address.

Perfect (green area in Figure 2) -> If the

pin falls on any rooftop.
Approximate (yellow area in Figure 2) ->
If the pin falls within the property
boundaries.
Next Door (purple area in Figure 2) -> If
the pin falls on the immediate property
next to the intended one.

Figure 1: Satellite view of a gas station

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6 b ary� scar
54 ruar satellite view of gas
Figure 2:.2Annotated u
ebr 9�by�O ue
.9 y
station Ma �by�O �17,�2 , � F
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

144
 Example m Explanation
4 � fro ez
2 rt�n
EXAMPLE TYPE: BUSINESS �WITH 7 , �20 MULTIPLE
a ROOFTOPS ON A SHARED PARCEL (GAS
y 1 ar�M Sa
STATION) a r c
u �Os t
Fe b r
�b y e I P�1 urda
y,� 54.9 nriq u 72 y,�F
Canadian Tire Gas+da
r 16. Ma2 .16 eb
.25 rua
t u
401225 ON-401
Sa 172. 4.9 ry
Woodstock,IONP� N4S 7W8 Ma �by�O �17,�2
nri sc 024
Canada qu ar�M �fr
e art om
�ne
z
This business is also a gas station with a canopy over the gas pumps, but it shares a
parcel with other businesses and a wooded picnic area.

With street imagery or other strong

With evidence evidence for the location of the rooftops,
the exact location of the business (or
address) can be confirmed. When the
exact location of the rooftops can be
found, the green area is Perfect and the
rest of the parcel is Approximate.

Without evidence Without strong evidence for the location

of the gas station’s rooftops, all rooftops
are Can't Verify (since there is not
enough evidence to narrow the location
down to specific rooftop or rooftops). The
rest of the parcel is Approximate.

EXAMPLE TYPE: BUSINESS COMPLEX CONTAINING A GAS STATION

When the result is the entire business

complex that contains the gas station
seen above as well as restaurants and m
Sa �fro ez
IP� turda other services under multiple rooftops, 2 4
�20 art�
n
17 ,
2.1 y,�Fe the result is considered a campus. In cases 1 7 �M
6.2 bru ary� scar
like this, the entire parcel is considered u
54
.9� ary�1 ebr 9�by�O ue
Ma by�O 7,�2 Perfect. , � F
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

145
 Example m Explanation
4 � fro ez
2 rt�n
EXAMPLE TYPE: BUSINESS �WITH 7 , �20 MULTIPLE
a ROOFTOPS AT SAME ADDRESS
y 1 ar�M Sa
a r sc t
u �O
Bremac Fe b r
�b y e I P�1 urda
y,� Tpke4.9 nriq u 72 y,�F
8133 Mechanicsvilleda
r 16. Ma2 5 .16 eb
t u .25 rua
Mechanicsville,
Sa 17VA 2. 23111 4.9 ry�
United States � M �b 17
I P an y�Os ,�202
riq car
ue �M 4�fro
The business has three buildings. All buildings are on the same property, belong to theart�n m
same business and share an address. ez

This business consists of three buildings.

Perfect (green area in Figure 2) -> If the

pin falls on any of the buildings
Approximate (yellow area in Figure 2) ->
If the pin falls within the property
boundaries.
Next Door (purple area in Figure 2 ) -> If
the pin falls on the immediate property
next to the intended one.
Figure 1: Satellite view of multi-rooftop
POI

Figure 2: Annotated satellite view of multi-

rooftop POI

EXAMPLE TYPE: BUSINESS WITH MULTIPLE ROOFTOPS AT SAME ADDRESS (FACTORY)

Fazerintie 2
01230 Vantaa Finland m
Sa �fro ez
IP� turda 2 4
�20 art�
n
This
17is a ylarge
2.1 ,�Fe factory consisting of several buildings. 1 7 ,
�M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

146
 Example m Explanation
4 � fro ez
2 n
7 , �20 art�
1 �M
a ry� scar Perfect (green area SinatFigure 2) -> If the
u ur
� Febr 9�by�O ue IP� buildings.
pin falls on any of the 17 day,�
, . iq 2.1 inFFigure
u r day 6.254 anr Approximate (yellow area 6.2 ebru 2) ->
t M
Sa 172.1 54
If the pin falls within the property.9� ary�1
IP � boundaries. Ma by�O 7,�2
nri sc 024
qu ar�M �fr
e art om
This particular POI has no Next Door �ne
area. z

Figure 1: Satellite view of multiple-rooftop

POI

Figure 2: Annotated satellite view of

multiple-rooftop POI

EXAMPLE TYPE: MULTIPLE BUILDINGS ON ONE PARCEL SHARING ONE ADDRESS

(APARTMENT COMPLEX)

Merkuriuksentie 13
00750 Helsinki
Finland

This query is for an address that is shared by several apartment buildings on the same
parcel.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

147
 Example m Explanation
4 � fro ez
2 n
7 , �20 art� There are five buildings with the same
1 �M
a ry� scar address on the parcel. Sa A pin on any of
tur
u
ebr 9�by�O ue I
them is rated Perfect P�1 while
d a pin on the
, � F . iq 72 ay,�F
u r day 6.254 anr parcel or any of the support. 16 structures
.25 ebrua
is
t M
Sa 172.1 rated Approximate. 4.9 ry�
IP � Ma �by�O 17,�2
nri sc 024
qu ar�M �fr
e art om
�ne
z

EXAMPLE TYPE: BUSINESS WITH A SHED IN THE BACK

33 Mile Roadhouse
33 Mile Haines Hwy
Haines AK 99827
United States

This business is a restaurant with a support building — a storage shed — in the back.
This restaurant has a detached storage
shed on its property.

Perfect (green area in top image) -> If the

pin falls on the main restaurant building.
Approximate (yellow area in top image)
-> If the pin falls within the property
boundaries, including the small support
shed behind the restaurant.
Next Door (purple areas in top image) ->
If the pin drops on either of the immediate
properties next to the intended one.

Annotated satellite view shows restaurant

and shed (arrow points to street imagery
of Sshed). m
a �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

148
9.3.2. Campus Rating m
4 � fro ez
2 n
7 , �20 art�
Some POIs will encompass 1 ar�M
a ry�entiresc
business complexes, meaning that Sa there are multiple buildings
tur
associated with/owned u
by the POI. These POIs include (but are not
Fe b r
�b y � O
e I P�1limited
da to) institutional complexes
, � 9 u 7 y,�F
like universities,dhospitals,
a y 54 and
2
.
n r airports. Other POI types that can be 2rated
i q . 1 as
ebrcampuses include
r 16. Ma 6 .
shopping and t strip
u
Sa 172. malls with multiple rooftops, amusement parks, resorts, 25 [Link] zoos.
� 9�b ry�17
IP Ma y�O ,�2
In cases like this, the entire parcel or property inside the boundaries of the POI, s 0
nri including
qu car�M 24�fall
rom
rooftops,
will be rated Perfect. There will be no Approximate or Next Door ratings. e a rt�n
ez
The property of a campus complex includes the buildings themselves, any shared parking lots, and
half ’n half as described in the guidelines.

How to Identify Campus Results

Wondering if a multiple-rooftop result is a campus? Many, though not all, campuses can be
identified by the presence of POIs within the POI. That is, individual stores within multiple-rooftop
malls, departments within hospitals, libraries and colleges within universities, spas and
restaurants within multiple-rooftop resorts, terminals within airports, and so on.

Rating Explanation

Perfect Pin falls within the campus/complex boundaries, as determined by

research.
Approximate N/A - Campuses and business complexes do not have Approximate
ratings.
Next Door N/A - Campuses and business complexes do not have Next Door
ratings.
Wrong Pin falls outside of the campus/business complex boundaries.

Can't Verify See Can’t Verify

Note: The result may be for an address that should have the campus rule applied.

Some of these types of POIs may have polygons outlining the boundaries of the POI on the map.
These
Sa polygons may not always be present or perfect, so rate against the true boundaries of the m
�fro ez
campus t
IP� rdau or complex as determined by research. A few examples of campuses are below, including
20 art�none
2 4
1 y , �
that is
72missing
.16 ,�Feb its polygon. 1 7 �M
.25 rua ary� scar
u
4.9 ry�
� 1 � F ebr 9�by�O ue
b ,
Ma y�O ,�2
nri sc 024
7
r d ay .254. anriq
qu ar�M �fr tu 6 M
e art om Sa 172.1
IP �
�ne
z

149
 POI type m Screenshot
4 � fro ez
2 n
7 , �20 art�
1 �M
a ry� scar Sa
u
ebr 9�by�O ue IP� turda
F 17
, � . iq 2.1 y,�Fe
u r day 6.254 anr 6.2 bru
t M
Sa 172.1 54
.9� ary�1
Hospital IP � Ma by�O 7,�2
nri sc 024
qu ar�M �fr
e art om
�ne
z

Park

Airport

Outlet Mall

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

150
 POI type m Screenshot
4 � fro ez
2 n
7 , �20 art�
1 �M
a ry� scar Sa
u
ebr 9�by�O ue IP� turda
F 17
, � . iq 2.1 y,�Fe
u r day 6.254 anr 6.2 bru
t M
Sa 172.1 54
.9� ary�1
IP � Ma by�O 7,�2
nri sc 024
qu ar�M �fr
e art om
Amusement Park �ne
z
No Polygon available

$"N"G"#"%%%7>B?C)L4AM(C)'%49M(:;

Entities made up of a single cluster of buildings are the easiest to identify. On the map, these entities
can be represented by a single, continuous polygon. Remember, the polygons on the map may not
always be perfect or present, so rate against the true boundaries of the campus or complex as
determined through research.

The property of a complex includes the buildings themselves, any shared parking lot and half n half
as described in the guidelines.

Note: Parking facilities may be included in the polygon if they are owned by the POI
and contiguous to the campus (contiguous means that they are not separated from
the campus by a street).
Tip: Start by looking at the pin's location, then determine if the property surrounding
the pin belongs to the POI you are looking at.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

151
 POI m Screenshot Rating Explanations
4 � fro ez
2 n
7 , �20 art�
1 �M
a ry� scar Sa
u
ebr 9�by�O ue IP� turda
F 17
, � . iq 2.1 y,�Fe
u r day 6.254 anr 6.2 bru
t M
Sa 172.1 54
.9� ary�1
IP � Ma by�O 7,�2
nri sc 024
qu ar�M �fr
e art om
�ne
z
Perfect (green area in Fig. 2) ->
If pin falls within campus
boundaries.
Wrong (everything else outside
Fig. 1: Vector view of Stanford
of green area in Fig. 2)-> If pin
University campus
falls outside campus
Stanford University
boundaries.

Remember, there is no
Approximate or Next Door
rating for campus and business
complexes.

Fig. 2: Annotated vector view of

Stanford University campus

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

152
 POI m Screenshot Rating Explanations
4 � fro ez
2 n
7 , �20 art�
1 �M
a ry� scar Sa
u
ebr 9�by�O ue IP� turda
F 17
, � . iq 2.1 y,�Fe
u r day 6.254 anr 6.2 bru
t M
Sa 172.1 54
.9� ary�1
IP � Ma by�O 7,�2
nri sc 024
qu ar�M �fr
e art om
�ne
z

Perfect (green area in Fig. 2) ->

If the pin falls within the hospital
Fig. 1: Vector view of El Camino
boundaries.
Hospital campus
Wrong (everything else outside
El Camino Hospital
of green area in Fig. 2)-> If the
pin falls outside of hospital
boundaries, as determined by
your research.

Fig. 2: Annotated vector view of

El Camino Hospital campus

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

153
 POI m Screenshot Rating Explanations
4 � fro ez
2 n
7 , �20 art� There is no polygon available for
1 �M
a ry� scar Sa this POI, so an imaginary
u
ebr 9�by�O ue IP� tupolygon
r outline must be created
, � F . iq 17 day,�
2according
u r day 6.254 anr .16 Feb to the actual
.25 rua
t M
Sa 172.1 boundaries
4.9 ryof the POI.
IP � Ma �by�O �17,�2
nri sc 024
To determine a
qu where
e r�Ma �ftheromvalid
pin area is, look at the
r t�n location
ez
of the attractions within the
amusement park and visualize
the boundary of the park to
determine the POI’s polygon.
Fig. 1: Vector view of The green area highlighted in a
Disneyland Park Disneyland Park satellite view of the POI (Fig. 2)
represents the valid area for the
pin to land in. A pin landing
anywhere outside of this green
area would be a Wrong pin.

Note: Parking lots separated by

a road should not be included in
the polygon because they
outside the boundary. Utility
buildings located outside of the
public park premises are not
Fig. 2: Annotated satellite view included in the polygon.

[Link]. Dispersed Campus

In some cases, a campus will not have a single, continuous location that a polygon can be drawn over,
but rather be spread out across a large area like a city. Sometimes, the pin will fall on this type of
campus and there may not be a polygon for the campus. If this occurs, research to determine where
the polygon should be. Pins that fall on campus-associated, non-parking facilities are valid pins.
Apply
Sa the single rooftop rules to any standalone, non-parking facility, campus building. m
t u 2 4 �fro ez
IP� rda
1 y , � 20 art�n
If two72or .16more
,�F campus buildings are next to each other, apply the single complex campus 1 logic.
7 �M
.25 ebrua ary� scar
u
4.9 ry�
� 1 � F ebr 9�by�O ue
b ,
Ma y�O ,�2
nri sc 024
7
r d ay .254. anriq
qu ar�M �fr tu 6 M
e art om Sa 172.1
IP �
�ne
z

154
 m
4 � fro ez
POI 2 Screenshot
n Rating Explanation
7 , �20 art�
1 �M
a ry� scar Sa
u
ebr 9�by�O ue IP� turda
F 17
, � . iq 2.1 y,�Fe
u r day 6.254 anr 6.2 bru
t M
Sa 172.1 Perfect 54-> Ifarthe pin falls the
.9� y�1
� green M b
polygon 7,� campus-
IP an y�Osminus 20
24
r
associated qparkingc
i ue r�Mfacilities
a �fro and
non-campus-associated a r t�n m
ez
buildings.

Wrong -> If the pin falls on a

standalone, campus-associated
parking facility, or on a non-
campus-associated building.

In this example, Virginia

Fig. 1: Annotated vector view of Virginia Commonwealth University (VCU)
Commonwealth University is a campus that is spread out
Virginia
around the city (campus
Commonwealth
properties are highlighted in
University Fig. 2: Zoomed-in view of pin location green).

A pin falling on the rooftop of the

Virginia Commonwealth University
- School of Medicine building (in
VCU Medical Center complex)
would be considered a valid pin
for this POI, but a pin falling on a
VCU parking lot would not be a
valid pin for the same POI.

Zooming into the pin shows that

the result is Perfect in this
example.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

155
 m
4 � fro ez
POI 2 Screenshot
n Rating Explanation
7 , �20 art�
1 �M
a ry� scar Sa
u
ebr 9�by�O ue IP� turda
F 17
, � . iq 2.1 y,�Fe
u r day 6.254 anr 6.2 bru
t M
Sa 172.1 54
.9� ary�1
IP � Ma by�O 7,�2
nri sc 024
qu ar�M �fr
e art om
The Boston University �campus
nez is
also spread out across the city, as
represented by the highlighted
green areas. In this case, the pin
happens to fall on the Boston
Boston University Center for
University Computational Neuroscience and
Neural Technologies building. The
building is a standalone, non-
parking facility building that is
Fig. 1: Annotated vector view of the Boston associated with the campus, so
University campus the pin is Perfect.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

156
9.4. Features Without a Rooftop m
2 4 �fro ez
This chapter will describe how , 0 rate
�2to a rt�npin accuracy for features that typically do not have a rooftop.
1 7 �M
a ry� scar Sa
t
u
9.4.1. Natural Features F e b r
�b y � O
e I P�1 urda
y,� 54.9 nriq u 72 y,�F
d a
r include 2
. M a are not limited to: .16 eb
Natural features
t u 1 6 but .25 rua
Sa 172. 4.9 ry�
�b 17
� M
I P an y�Os ,�202
• Lakes (Lake Victoria) riq car
ue �M 4�fro
• Oceans (Pacific Ocean) art m
�ne
• Creeks (Bear Creek in Colorado) z
• Rivers (the Danube river)
• Ponds (Antonelli Pond in California)
• Wetlands (Laguna de Rocha)
• Seas (Black Sea)
• Forests (Black Forest)
• Mountains (Carpathian Mountains)
• Hills (Chocolate Hills of the Philippines)
• Plateaus (Colorado Plateau)
• Valleys (Death Valley)
• Plains (The North American Great Plains)
• Fjords (Geirangerfjord in Norway)
• Peninsulas (Indian Peninsula)
• Volcanoes (Etna)
• Deserts (Gobi Desert)
• Glaciers (Patna Glacier in Iceland)
• Waterfalls (Niagara Falls)

A natural feature may also have other natural features within or surrounding it. These could include,
but are not limited to, the shore of a lake, an island in a river, and a forest surrounding a mountain.

Similar natural features, even if not listed above, should be rated using these guidelines.
Rating Explanation
If the natural feature has a defining feature (water for a river/ocean, cliffs/peak of
a mountain, the sand for a beach), pin should fall on that feature or if the natural
Perfect
feature is defined by an arbitrary boundary (parks, national forests), pin should
fall in their polygon or where it would be if we had that information.
The pin falls outside of the defining features of a natural feature but still on it
(slope of a mountain rather than the peak, the shore of a river or lake). Consider
Approximate each situation individually. Not all natural features will have an Approximate. If
m
Sa
t u
the natural feature exists within an urban or suburban area, you may apply4the
2 �fro ez
IP� rda
17 y Half 'n' Half rules. 7 , � 20 art�n
2.1 ,�Fe 1 �M
6.2 bru ary� scar
Next Door54 N/A - Natural features do not have Next Door ratings. u
.9� ary�1 � F ebr 9�by�O ue
b ,
Ma y�O ,�2
n s
7
The 0pin falls in an area that does not meet the criteria for r d ay .254. or
Perfect anri
q
Wrong r c
iqu ar� 4�f 2 tu 6 M
e Approximate.
Ma rom Sa 172.1
rt�n IP �
ez
Can't Verify See Can’t Verify

157
 m
4 � fro ez
Type of POI Screenshot 2
�20 art�
n Explanation
7 ,
1 �M
a ry� scar Sa
u
ebr 9�by�O ue IP� turda
F 17
, � . iq 2.1 y,�Fe
u r day 6.254 anr 6.2 bru
t M
Sa 172.1 54
.9� ary�1
IP � Lake Merritt Ma by�O 7,�2
nri sc 024
qu ar�M �fr
e art om
�ne
z

Perfect (green area in Fig. 2) -> Anywhere on

the defining feature of the lake. In this case, the
defining feature would be the water.
Fig. 1: Vector view of Lake Merritt
Body of
Approximate (yellow area in Fig. 2) -> The
water
shore of the lake.

Wrong (everything else in Fig. 2) -> Anywhere

past the shore of the lake.

Fig. 2: Annotated vector view of

Lake Merritt

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

158
Type of POI Screenshot m
fro ez Explanation
2 4 �
n
Land feature Mount Rainier 7 , �20 art� Land features, such as mountains, mountain
1 �M
a ry� scar Sa
ranges, or volcanoes, should use the following
u
ebr 9�by�O ue IP� turda
F guidelines. 17
, � . iq 2.1 y,�Fe
u r day 6.254 anr 6.2 bru
t M
Sa 172.1 54
Perfect (area above green .9� aline
by� y�17in Fig. 4) ->
r
IP � M
Anywhere on the defining Os ,�20of the
an feature
riq car 24�
mountain (peak or ridge, depending
ue �M on f the
art rom
mountain). �ne
z
Approximate (area between green and yellow
lines in Fig. 4) -> Anywhere on the slope of the
mountain.

Fig. 1: Vector view of Mount Wrong (area below yellow line in Fig. 4) ->
Rainier Valley of the mountain, anywhere farther out
than the obvious slope.

Tip: If available, try using a 3D view of the

mountain to determine where its peak or ridge is.
Check to see if there is a 3D view before using
other sources.

Use common sense to determine the pin rating

for these types of land features. For example, a
peak of a mountain can span a large area and
Fig. 2: Satellite view of Mount may have a more gradual slope area, so make
Rainier sure you're not being too strict or too generous
when rating the pin.

Fig. 3: 3D view of Mount Rainier

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma bFig.
y 7, ,
ay .254. anriq
nri �Osc4: �Annotated
20
24
3D view of r d 6
qu ar�Rainier
Mount tu M
e Ma rom� f Sa 172.1
rt�n IP �
ez

159
 m
4 � fro ez
2 n
9.4.2. Administrative Divisions 7 , �20 art�
1 �M
a ry� scar Sa
Administrative divisions u
ebr can �Orefer to, but are not limited to: IP� turda
F �by que 17
, �
• Countriesday 254 nri . 9 2.1 y,�Fe
6. Ma 6.2 bru
• States tur
Sa 172.1 54
.9� ary�1
• Counties
IP� Ma by�O 7,�2
• Provinces nri sc 024
qu ar�M �fr
• Cities e art om
�ne
• Neighborhoods z

Rating Explanation
Perfect Pin should fall in within the boundaries/polygon of the administrative division.
Approximate N/A
Next Door N/A
Wrong Pin falls in an area that does not meet the criteria for Perfect.
Can’t Verify See Can’t Verify

Type Screenshot Explanation

Perfect – the pin can fall

anywhere within the
neighborhood boundaries
Approximate – not applicable
Neighborhood
Next Door – not applicable
Wrong – everything outside of
Perfect

Tenderloin in San Francisco

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

160
9.4.3. Streets m
4 � fro ez
In this chapter, rating pins for streets 2 �n be explained.
7 , �20 artwill
1 �M
a ry� scar Sa
Rating u Explanation t
Fe b r
�b y � O
e I P�1 urda
� 4.9 iq
y,Pin u 72 y,�F
da
r 16. Ma2 5 can nfall
r anywhere on the street, including medians .16 and
.25 ebruintersections the
Perfect t u
4.9 ary�
Sa 172. street passes through completely (but not on sidewalks).
IP� Ma �by�O 17,�2
Approximate N/A nri sc 024
qu ar�M �fr
e art om
Next Door N/A �ne
z
Wrong Pin falls in an area that does not meet the criteria for Perfect.
Can’t Verify See Can’t Verify

Example Explanation
Perfect – The pin can fall anywhere on the street,
including medians and intersections the street
passes through completely, whether seen in
satellite view or on the vector map. If there is a
discrepancy between the satellite view and vector
map of the street boundaries, use the most
favorable layer. Note that sidewalks are not part of
the Perfect area.
Approximate – not applicable
Next Door – not applicable
Wrong – everything outside of Perfect, including
intersections the street does not pass through

Here, only the Jersey St. & Lafayette St.

intersection is a valid intersection for the pin to fall
on, since Jersey St. completely passes through
Jersey St. in New York City Lafayette St. The intersections where Jersey St.
meets Mulberry St. and Crosby St. are not included
because Jersey St. does not pass through these
streets.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

161
 m
4 � fro ez
Query: [highway�292] 02 art�n
7 ,
1 �M
a ry� scar Sa
User and fresh viewport u in San
br �by�O e Francisco, CA IP� turda
e
,� F .9 iq u Perfect – The pin17can
2.1 yfall
,�F anywhere on the street,
u r day 6.254 anr including bridges [Link]
ebr
25 part of the street. Both
t
Sa 172.1
M 4.9 uary�
� result 1 and result 2 areMPerfect
�by since
1 the pin falls
IP
on the San Mateo-Hayward �Os 7,�2which
an Bridge,
riq car 24� is part of
0
the highway. ue �M fro
art m
Approximate – not applicable �ne
z
Next Door – not applicable
Wrong – everything outside of Perfect, including
intersections the street does not pass through

Rate pins falling on physical road dividers (the

middle of a road with lanes in both directions) as
Perfect, even if they fall into water, as in result 3.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

162
9.5. Parking Lots and Structures m
2 4 �fro ez
Shared parking lots are considered , rt�n
�20 aApproximate even though they do not belong entirely to the
� 7
1 lots �M
feature. Assume that parking r y a r belong to the feature and do notSsplit
atu them. When Sourdough & Co
r ua �Osc
(green building) is the Fe result,
b �by qthe e approximate area (yellow) extends I P�1 up
rdato the public road to the north.
a , �
y 54 nr . 9 i u 72.1 y,�Fe
d 2
6. Ma 6.2 bru
tur
Sa 172.1 54
.9� ary�1
IP � Ma by�O 7,�2
nri sc 024
qu ar�M �fr
e art om
�ne
z

m
In cases
Sa
t where the parking structure can be verified in satellite imagery (by either parked cars4or �fro ez
u
IP� rdlot 2 t�n no
parking
17 ay,�striping), consider the entire structure a parking lot. The assumption is that there , �20willarbe
2.1 Fwithin 1 7 �M
businesses 6.2 ebru the structure other than parking-related businesses. ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
b ,
Ma y�O ,�2 7
nri sc 024 r d ay .254. anriq
qu ar�M �fr tu 6 M
e art om Sa 172.1
IP �
�ne
z

163
 m
4 � fro ez
2 n
7 , �20 art�
1 �M
a ry� scar Sa
u
ebr 9�by�O ue IP� turda
F 17
, � . iq 2.1 y,�Fe
u r day 6.254 anr 6.2 bru
t M
Sa 172.1 54
.9� ary�1
IP � Ma by�O 7,�2
nri sc 024
qu ar�M �fr
e a om
Always consider parking lots and parking structures as belonging to the feature. There’srtno
�ne need
z
split them by applying the Half n' Half rule.

In the example below, the result is a shopping mall with both a parking lot and parking structures. Pins
that fall on the building (rooftop) of the mall are Perfect. Apply the Half 'n Half rule to the street and
internal access roads, if any, to determine the area for Approximate, as parking lots and parking
structures are also Approximate.

9.6. Transit POIs

Transit POIs include, but are not limited to, POIs that are transit stops, stations, toll booths, and
terminals. A transit stop is a small, transit location typically designated by a bench or covered bench m
Sa
t u 2 4 �fro ez
area,
IP� arposted
17 day,� sign, or street markings. Transit stations, on the other hand, are typically larger , �20 stops
a rt�n
7
�1 ar�M
that have2.1 a Fmajor
6.2 ebru structure associated with them, which include, but are not limited uto, ryplatforms,
c
a
r y�Os
ticketing offices,
54 a
.9� y�1enclosed
r waiting/seating areas, or terminal buildings/structures eencompassing
b the
transit area. MaThe by�term7,�“station” is primarily used to refer to transit locations that y , �F
are 4 larger
. ue
9�b riqand
nri Osc 2024 rda 16.25 Man
typically a terminal qu housing
ar� �
Ma rom f multiple routes. All stations are stops, but not
S 172stops
a tuall . are stations.
e �
rt�n I P
If a transit POI does not meet ez the criteria to be rated under the Single Rooftop or Campus/Complex
guidelines, please use the following criteria to rate.
164
 Rating m Explanation
4 � fro ez
2 t�n
The pin falls7on , �20thearpolygon for the transit POI or in the area where you
�1 ar�M
Perfect would wait r for transit or within the entrance polygon
y Sa for an
ua �Osc t
underground
F e b r
�b y transit
e station I P�1 urda
y,� 54.9 nriq u 72 y,�F
da
r The 2
. pinMfallsa within 50 meters of where you would wait .16 eb
t u 1 6 for
.25 transit
4.9 uary�or
r
Sa 172.
Approximate
IP� within station parking lots and surrounding property up to Mawhere
�by the
1
�Os 7,�20
Half 'n' Half rule allows. n riq car 24�
ue �M fro
art m
Next Door Transit POIs do not have Next Door ratings. �ne
z
The pin is wrong if it falls:
• Farther than 50 meters from the ideal location
Wrong • Within 50 meters on a non-associated rooftop
• Outside of the boundaries as allowed by the Half 'n' Half rule
• Beyond half a city block (applies to bus stops only)

Can't Verify See Can’t Verify

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

165
9.6.1. Bus, Tram, and Streetcar Stops m
4 � fro ez
Bus, tram and streetcar stops ,are 2 rt�n but not always, on the side of the street and have one spot
7 �20 often,a
where users can wait to board y �1 the a r �Mbus. Perfect pins should be placed Sa on the spot where a user would
r sc
uapins t
wait while Approximate
Fe b r
�b y � O cane be placed within 50m of the I P�1 urdspot
waiting ay, and within the Half 'n' Half
rule. , � . 9 i q u 7 2.1 �Fe
u r day 6.254 anr 6.2 bru
t 2.1 M 54
POI S a
� 1 7 Screenshot Rating Explanation .9� ary�1
IP Ma by�O 7,�2
Perfect (green area in Fig. 2) -> Where nri ascuser02would
qu ar�M 4�fr wait for
e art om
the bus. �ne
z
Approximate (yellow area in Fig. 2) -> 50 m away from
where a user would wait for the bus but no farther out than
the Half 'n' Half rule allows and not on a building rooftop.

Wrong (everything else in Fig. 2) -> Farther than 50 meters,

or beyond half a city block from where user waits for the
Noriega Fig.1: Vector view of bus bus, or farther out than the Half’n’Half rule allows, or on a
St and stop rooftop, or in an agricultural field where a person would not
46th wait for transit.
Ave bus
stop
Can’t Verify – See Can’t Verify

Special Note: A satellite view shows that this pin might

actually fall in the street for this bus stop. Remember, favor
the map view that gives a more generous rating for the pin
these cases. In this case, the vector map is used to rate the
pin.
Fig.2: Annotated satellite
view of bus stop

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

166
9.6.2. Transit POI with Multiple Rooftops/Platforms m
4 � fro ez
If the POI has multiple rooftops/platforms, 2 n apply similar ideas from the campus/complex pin
7 , �20 art�
guidelines when determining 1 M
ry the ar valid area for the pin to land on. Sa
� �
b r ua �Osc IP� turda
Fe �b y e 17 y,�F
y,� 54.9 naripolygon
For campuses/complexes, u was created using the boundaries 2.1 of the
ebr campus. Use the same
a q
d
r 16. Ma2 6 .
concept with transit
t u
Sa 172. POIs and create a polygon for the transit POI using the25 [Link]'s
ua multiple rooftop/
9�b ry�17
platforms. IP � Ma y�O ,�2
nri sc 024
qu ar�M �fr
e a om
POI Screenshot Explanation rt�ne
z

Here is the San Jose Diridon train station, so

rate the pin according to the train station
platforms and rooftops.

Perfect -> Polygon of the station or rooftop/

platform of the station or area between
rooftops/platforms of the station (green area).
Fig. 1: Vector view of San Jose
Diridon Station Approximate -> Within transit station parking
San Jose
lots and surrounding property up to where the
Diridon
Half 'n' Half rule allows (yellow area).
Station
Wrong -> Anywhere outside of transit station
boundaries.

Can’t Verify – See Can’t Verify

Fig. 2: Annotated satellite view of Remember, if there is a polygon available in
San Jose Diridon Station vector view for the POI, rate against the
polygon.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

167
 POI Screenshot m Explanation
4 � fro ez
2 n
7 , �20 art�
1 �M
a ry� scar Sa
u
ebr 9�by�O ue IP� turda
F 17
, � . iq 2.1 y,�Fe
u r day 6.254 anr 6.2 bru
t M
Sa 172.1 54
.9� ary�1
IP � Ma by�O 7,�2
Some transit stops only nri have
s 02
qu cara�M
platform
4�f
rom
where
e
a user can wait for the transit. a rt�n
ez
Perfect (green area in Fig. 2) -> Where a user
would wait for transit or the area between
where a user would wait for transit.

Fig. 1: Vector view of Sunnyvale Approximate (yellow area in Fig. 2) -> Within
Station 50 meters of where you would wait for transit
Sunnyvale
or within transit stop parking lots and
Station
surrounding property up to where the Half 'n'
Half rule allows.

Wrong (everything else in Fig. 2) -> Farther

than 50 meters from where user waits for
transit or farther out than the Half 'n' Half rule
allows.

Can’t Verify – See Can’t Verify

Fig. 2: Annotated satellite view of

Sunnyvale Station

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

168
 POI Screenshot m Explanation
4 � fro ez
2 n
7 , �20 art� Some stations have both a building rooftop
1 �M
a ry� scar and an openSaplatform waiting area. Both of
tur
u
� Febr 9�by�O ue these areas IP�are
17 dconsidered
ay valid places for
, . iq pins to fall on. 2.16 ,�Feb
u r day 6.254 anr .25 rua
t M
Sa 172.1 4.9 ry�
17-> Pin falls on
IP � Perfect (green area Main �Fig.
by 2) ,
nri �Osc �2024
the platform(s) where the qu userr�M
e
a would�frowait or
the area between the platforms or artthe m
�ne rooftop.
z
Solana
Fig. 1: Vector view of Solana Beach Approximate (yellow area in Fig. 2) -> Pin
Beach
station falls within 50 meters of where you would wait
Amtrak for transit or within transit stop parking lots
Station and surrounding property up to where the Half
'n' Half rule allows.

Wrong (everything else in Fig. 2) -> Farther

Fig. 2: Annotated satellite view of than 50 meters from where user waits for
Solana Beach station transit or farther out than the Half 'n' Half rule
allows.

Can’t Verify – See Can’t Verify

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

169
9.6.3. Transit POIs with a Single Rooftop m
4 � fro ez
If the POI has a single rooftop,,�apply
7 202 arthe t�n single rooftop guidelines.
1 �M
a ry� scar Sa
t
u
POI Fe b r
�b � O
yScreenshot
e I P�1 urdaExplanation
y,� 54.9 nriq u 72 y,�F
da
r 16. Ma2 .16 eb
t u .25 rua
Sa 172. 4.9 ry�
�b 17
� M
I P an y�Os ,�202
riq car
ue �M 4�fro
art m
�ne
z

Perfect -> Rooftop of transit station or stop

Approximate -> Transit POI parking lots and

surrounding property up to where the Half 'n'
Grand Fig. 1: Vector view of Grand Central Half rule allows
Central Terminal station
Terminal Wrong -> Farther out than the Half 'n' Half
rule allows from POI property

Can’t Verify – See Can’t Verify

Fig. 2: Annotated satellite view of

Grand Central Terminal station

9.6.4. Underground Transit Stations

Some transit stations are underground. For stops that do not have polygons available on the tool map, m
Sa similar rules to the satellite campus and use your imagination to draw a polygon using the
apply t u 2 4 �fro ez
IP� rda 20 of n
rt�this
entrances
17 y to the underground station as polygon coordinates. A pin dropped within 50 meters
7 , � a
2.1 ,�Fe 1 �M
polygon 6should
.25 brube rated Approximate. ary� scar
u
4.9 ary�
� 1 � F ebr 9�by�O ue
b ,
Ma y�O ,�2
If a pin is placed
7
nri onsca building
02 within the polygon, the building must containran d . 254. anrto
ay entrance iq the transit
stop for the pin qto �M 4�fro If the pin falls on any other building within
uebearPerfect. 16
tu 2polygon, M rate it
art m Sathe
� 1 7 .
Approximate. �ne IP
z

170
Some entrances can be seen via satellite m view of the station, while other entrances can only be found
ro
by doing more research, including24using � f zstreet imagery of the station area to find entrances or using a
0 artthat �ne
station map from the transit provider , �2 shows entrances to the station.
y �17 ar�M Sa
r
ua �Osc t
[Link]. How to Establish Fe b r
an�b yEntrancee Polygon
I P�1 urda
y,� 54.9 nriq u 72 y,�F
da
r 16. Ma2 .16 eb
t u .25 rua
Sa 17three
1. Find at least 2. entrances to the underground transit station, if possible.
4.9 ry�
� M �b 17
I P an y�Os ,�202
r q car
• Use street imagery or an official source to determine where the transit istation ue �M 4�f
entrances are
art rom
located. �ne
z
• Tip: A good place to start looking for transit entrances is near the pin's location. This will
make it easier to determine whether or not the pin falls within the polygon.

2. Connect the entrance points to create an enclosed polygon, where each entrance is a point of the
polygon.
3. Determine whether or not our pin falls within 50 meters of the polygon or within the property
covered by the Half 'n' Half rule.

If the underground transit station only has two entrances, use the following steps to create an
entrance polygon.

POI Steps Satellite Views

1. Imagine property boundaries around

the underground transit station
entrances using the Half ’n’ Half
Rule.

Note: Entrances are designated by stars

and property boundary polygons are
designated by the letters A and B.

2. Connect the closest points of the two

boundaries from step 1 to create an
entrance polygon.

Note: In this case, we have taken points m

Sa
1 and 2 from polygon A and connected �fro ez
IP� tuSt
16th r 2 4
�20 art�
n
17 da&y,� 7 ,
2.1 Fe them with points 3 and 4 from polygon 1 �M
Mission 6.2 bru ary� scar
54 B,arrespectively. Exclude building u
.9 ebr 9�by�O ue
BART by� y�17,�
Ma �rooftops , � F
nri Osc 20that do not contain an entrance d ay .254. anriq
Station ar� 24�f tu r 6 M
q
to the
u e underground
Ma rom station from the Sa 172.1
rt�n IP �
entrance polygon. ez

171
 POI Steps m Satellite Views
4 � fro ez
2 n
7 , �20 art�
1 �M
a ry� scar Sa
u
ebr 9�by�Owhether IP� turda
3. Determine
y , � F . i q ue or not the pin falls 17
2.1 y,�Fe
da 2 5 4 n r 6.2 bru
tur within6. M 50
a meters of the polygon.
Sa 172.1 54
.9� ary�1
IP� Ma by�O 7,�2
nri sc 024
Note: For underground transit POIs that qu ar�M �fr
e art om
only have one entrance, create the same �ne
polygon around the entrance as the z
Perfect pin rating area, then measure
50 meters from that polygon for the
Approximate pin rating area.

[Link]. Examples

POI Screenshot Explanation

If the underground POI already has a
polygon available, rate the pin against
the polygon.

In this case, there is a blue-colored

polygon on the map for the POI.

Perfect (green area in Fig. 2)

Polygon of transit station.
Fig. 1: Vector view of Jingu Marutamachi
Station Approximate (yellow area in Fig. 2)
Jingu Pin lands within 50 meters from the
Marutamachi polygon or on transit station parking
Station lots and surrounding property up to
where the Half'n'Half rule allows. In this
case, the station does not have a
station parking lot, so only look at the
surrounding property within 50 meters m
Sa
of the polygon. �fro ez
IP� turda 2 4
�20 art�
n
17 Fig. 2: Annotated vector view of Jingu ,
2.1 y,�Fe 7
y�1 car�M
6.2 bruMarutamachi Station Wrong (everything else u arin Fig.
s 2)
54
.9� ary�1 e br �by�O e
Ma by�O 7,�2 Farther out thanythe
,� 4.9 riqu rule
F Half'n'Half
a
allows fromtstation 5 an
nri sc 024
qu ar�M �fr a ur .16.2property.
d
M
e art om S 172
�
IP – See Can’t Verify
�ne Can’t Verify
z

172
 POI Screenshotm Explanation
4 � fro ez
2 n
7 , �20 art�
1 �M
a ry� scar Sa
u
ebr 9�by�O ue IP� turda
F 17
, � . iq 2.1 y,�Fe
u r day 6.254 anr 6.2 bru
t M
Sa 172.1 54
.9� ary�1
IP � Ma by�O 7,�2
nri sc 024
qu ar�M �fr
e art om
�ne
z

Fig. 1: Vector view of 16th St Mission BART

station Perfect -> Pin falls within the entrance
polygon and not on a building rooftop
(unless there is an entrance to the
station within the building).

Approximate -> Pin falls within 50

meters of the entrance polygon or
within the property that Half 'n' Half
rule covers.

Wrong -> Pin falls more than 50

meters outside of the entrance polygon
16th St and or outside the Half 'n' Half rule area.
Mission St
BART Station Can’t Verify – See Can’t Verify
Fig. 2: Satellite view of 16th St Mission
BART Station showing station entrances

In this case, there are only two

entrances to the transit station (Fig. 2).
We'll use the Half 'n' Half rule to
determine the points for our entrance
polygon (Fig. 3).

Sa Our pin falls within the entrance �from z

IP� turda polygon created, so it is a Perfect 24 t�ne
17 , �20 arpin.
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e 3: Annotated
art om satellite view of 16th St Sa 172.1
Fig. �ne IP �
Mission BART. z Stars represent the
entrances.
173
 POI Screenshotm Explanation
4 � fro ez
2 n
7 , �20 art�
1 �M
a ry� scar Sa
t
u
ebr 9�by�O ue I P�1 urd->
Perfect Pin falls within the entrance
, � F . iq 72 ay,�F
r day 6.254 anr polygon1and
. 6.2 not
eb on a building rooftop
t u
Sa 172.1
M (unless there 54 isran
u
� .9� arentrance
y�1 within the
IP building). an �O �20
M b y 7 ,
riq scar 24�
ue �M fro
Approximate -> Pin fallsarwithin t�n m 50
ez
meters of the entrance polygon or
within the property that Half 'n' Half
Fig. 1: Vector view of Tuileries Station
rule covers.
Tuileries
Wrong -> Pin falls more than 50
Station
meters outside of the entrance
polygon or outside the Half 'n' Half rule
area.

Can’t Verify – See Can’t Verify

In this example, the pin falls within the

Half 'n' Half rule area for the entrance
polygon, so it is an Approximate pin.
Fig. 2: Annotated satellite view of Tuileries
Station. Stars represent the entrances.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

174
 POI Screenshotm Explanation
4 � fro ez
2 n
7 , �20 art�
1 �M
a ry� scar Sa
u
ebr 9�by�O ue IP� turda
F 17
, � . iq 2.1 y,�Fe
u r day 6.254 anr 6.2 bru
t M
Sa 172.1 54
.9� ary�1
IP � Ma by�O 7,�2
n i sc 024
Perfect -> Pinrfalls
qu within
a entrance
e r�Ma �from
polygon and not on a building
rt�n rooftop
ez
(unless there is an entrance within the
building)

Approximate -> Pin falls within 50

meters of the entrance polygon
Fig. 1: Vector view of Jay St-MetroTech
Wrong -> Pin falls more than 50
station
meters outside of the entrance
polygon

Can’t Verify – See Can’t Verify

With underground transit stations that

Jay
have multiple entrances, you'll need to
Street-
use street imagery or an online
MetroTech
resource to find the transit entrances
then draw a polygon using the
entrances as points of the polygon.
Here, we were able to find 5 entrances
represented by the yellow stars that
Fig. 2: Annotated vector view of Jay
were near our pin (Fig. 2). These
St-MetroTech station with entrance polygon
entrances were found via street
imagery, since satellite view does not
clearly show entrances to this transit
station (Fig. 3). There is also a transit
station map available from the official
transit website that shows the
entrances to this station.

In this example, our pin is placed within m

Sa �fro ez
IP� turda the entrance polygon for this2station, 2 4
� 0 art�
n
17 ,
2.1 y,�Fe so we rate it as Perfect. y�1 r�M 7
6.2 bru ar sca
54
.9� ary�1 e bru �by�O e
Ma by�O 7,�2
d ay,�F 54.9 nriqu
nri sc 024
qu ar�M �fr tur 6.2 Ma
e art om Sa 172.1
Fig. 3: Satellite
�ne view of Jay St-MetroTech IP�
station z

175
10. How to Rate Results m
4 � fro ez
2 rt�n
This chapter shows how to �rate 7 , �20a variety
a of examples.
y 1 ar�M Sa
a r sc
u �O
ebr need y IP� turda
For each result, you,�Fwill . 9�b riqto
ue answer questions about: 17
2.1 y,�Fe
a y 4
d 25 n 6.2 bru
tur 2.16. Ma 54
a
• Relevance
S
�17 .9� ary�1
I P Ma by�O 7,�2
• Name accuracy nri sc 024
• Address accuracy qu ar�M �fr
e art om
• Pin accuracy �ne
z

10.1. Specific Address

When the query is an address, and the user explicitly states their location intent by including the
name of a locality, this is an explicit location query and the user’s viewport and location are irrelevant.
The query refers to a unique location, so a result for this exact location should be rated Navigational.

Query Results Ratings and Explanation

Is there a Navigational Result for this Query? Yes

[12112 Relevance Navigational

sugarloaf key Name Accuracy n/a
st tampa fl
33626] Address Accuracy Correct

Pin Accuracy Perfect

12112 Sugarloaf Key St

12112 Sugarloaf Key St
Tampa, FL 33626
Classification: n/a

This address belongs to an apartment complex,

where all buildings have the same address.

The pins falls on one of the rooftops of this

Sa mutiple-rooftop result and is rated [Link]
IP� turda 2 0 24� rt�nez
17 , � a
2.1 y,�Fe y �17 ar�M
6.2 bru a r s c
54
.9� ary�1 e bru �by�O e
Ma by�O 7,�2 � F 9 u
nri sc 024 r d ay, .254. anriq
qu ar�M �fr tu 6 M
e art om Sa 172.1
IP �
�ne
z

176
 Query Results m Ratings and Explanation
4 � fro ez
2 n
7 , �20 art� Relevance Navigational
[12112 Camden ry�Westchase Park
1 ar�M Sa
sugarloaf key Apartments a s c
u
ebr 9�by�O ue IP� turda Correct
Name Accuracy
st tampa fl a12112 F 17
y [Link]
, � q
nri33626
Key St 2.1 y,�Fe
33626]at r d Tampa,
. 2 FL
a Address Accuracy6.2 Correct
b
u
S 172.1
6 M 54 ruar
.9� y�1
� Classification: Apartment Pin Accuracy MWrong b 7
IP an y�Os ,�202
riq car
ue �M 4�fro
art m
�ne
z
The result includes the name of the business,
which is located at this address.

The pin falls outside the boundaries of the

apartment complex.

12112 Sugarloaf Key St Relevance Navigational

12112 Sugarloaf Key St
Tampa, FL Name Accuracy n/a
Classification: n/a Address Accuracy Incorrect - Postal Code
Pin Accuracy Perfect

The result is missing a postal code so Address

Accuracy is Incorrect (with Postal Code
specified as the incorrect component). Postal
code is a mandatory component for a
residential address result. The pin falls on one
of the rooftops of this multiple-rooftop POI.

Sugarloaf Key St Acceptable (User Intent

Relevance
Sugarloaf Key St, Tampa, FL Issue)
33626
Classification: n/a Name Accuracy n/a
Address Accuracy Correct
Pin Accuracy Perfect

The result is a whole street result instead of a

Sa specific address. As the user query is for arom
f
IP� turda specific, full address, the information 2provided 0 24� rt�nez
17 �
, Ma be
2.1 y,�Fe by the result is incomplete. The user y �17 would
ar�
6.2 bru ar c
able to find the street, but not the exact
u s
54
.9� ary�1 ebr 9�by�O ue
Ma by�O 7,�2 address s/he is looking afor. y 54. pin
, � FThe riis
q dropped
nri sc 024 on the street mentioned d 2 n
qu ar�M �fr tu in6the M
r . result and is
a
e art om Perfect. Sa 172.1
IP �
�ne
z

177
 Query Results m Ratings and Explanation
4 � fro ez
2 rt�n
11244 Windsor 7 , �20 Pl a Relevance Bad (User Intent Issue)
y �1 ar�M Sa
ar sc Pl Cir
11244ruWindsor
e b �by�O e IP� turda n/a
Name Accuracy
Tampa,
y,�F 54.9 FL 33626
u 17
2.1 y,�Fe
a riq
d 2
[12112 atur Classification:
. Ma n n/a Address Accuracy6.2 Correct
b
S 2 .16 54 ruar
sugarloaf key 1 7 .9� y�1
IP� Pin Accuracy
b
MPerfect 7
an y�Os ,�202
st tampa fl riq car
33626] ue �M 4�fro
The result does not satisfy the queryart andm is not
�ne
considered relevant. However, the address z and
pin placement are Correct and Perfect.
Remember, the data and relevance of the result
are considered separately. The data can be
correct even when the result’s relevance is
Bad.
[220 yonge st Is there a Navigational Result for this Query? Yes
toronto]
CF Toronto Eaton Centre Relevance Navigational
User in Toronto, 220 Yonge St
Toronto ON M5B 2H1 Name Accuracy Correct
Canada
Classification: Shopping Center Address Accuracy Correct
Pin Accuracy Perfect

This query is the address of the best-known

mall in downtown Toronto. Even though many
businesses have this address as their official
address, the mall is rated Navigational due to
its prominence.

The result includes the correct address plus the

name of the mall, which is useful additional
information. The pin is dropped on the mall’s
rooftop.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

178
 Query Results m Ratings and Explanation
4 � fro ez
2 n
Indigo 7 , �20 art� Relevance Good
1 ar�M
220 Yonge a ry� St c Sa
Toronto,
b u
r ON y � OsM5B 2H1 IP� turda Correct
Name Accuracy
[220 yonge st ,�F .9�b que
e 17
y 54 nri 2.1 y,�Fe
toronto] urdaClassification:
6.2 Ma Book Shop Address Accuracy 6.2 Correct
b
t
Sa 172.1 54 ruar
.9� y�1
IP�
User in Toronto, Pin Accuracy MPerfect
b 7
an y�Os ,�202
riq car
Canada ue �M 4�fro
art m
�ne
z

This large, well-known bookstore is inside the

Eaton Centre and shares the 220 Yonge Street
address. It is demoted to Good because it is
less prominent than the Eaton Centre.

The name and address are Correct. Based on

the best available evidence (including interior
maps of the mall available online) the exact
position of the bookstore under the rooftop can
be found. A pin falling on the green area
(bookstore’s position) is Perfect. The rest of
the mall is Approximate.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

179
 Query Results m Ratings and Explanation
4 � fro ez
2 rt�n
Moneysworth , �20 & aBest Acceptable (Distance/
7
1 ar�M Relevance S
220 Yonge a ry� St c a Prominence)
Toronto,
b u
r ON y � Os M5B 2H1 IP� turda
[220 yonge st ,�F .9�b que
e 17
y 54 nri Name Accuracy 2.1 y,�FCorrect
toronto] turdaClassification:
6.2 Ma Shoe Repair 6.2 ebru
Sa 172.1 54
Address Accuracy Correct.9� ary�1
IP�
User in Toronto,
Ma by�O 7,�2
nri sc 024
Canada Pin Accuracy Perfect
qu ar�M �fr
e art om
�ne
z

Most people come to the mall to shop, so this

shoe repair service, also at 220 Yonge Street, is
much less prominent and a much less likely
intent than other stores in the mall. Its
relevance is demoted to Acceptable.

The store is very small and located

underground. When comparing the official map
provided by the mall with the satellite, the
store’s location can be established inside the
green area.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

180
 Query Results m Ratings and Explanation
4 � fro ez
02 t�n
[220 yonge st Subway �17,�2 �Mar Relevance Bad (User Intent)
toronto] 260 Yonge ry Star Sa
r ua �Osc IP� turda Correct
Name Accuracy
Toronto,
e b ON
y M5B 2H1, CAN
a y ,�F 4.9�b rique 17
2.1 y,�Fe
User in Toronto, 5
d Classification:n Fast Food Address Accuracy 6.2 Correct
tur 6.2 Ma b
54 ruar
CanadaSa 172.1 .9� y�1
IP� Pin Accuracy MPerfect
b 7
an y�Os ,�202
riq car
ue �M 4�fro
art m
�ne
z

This fast-food restaurant is not located at 220

Yonge Street. The name and address in the
result are Correct and the pin placement is
Perfect.

The official venue map shows the precise

location of the restaurant, but finding the
perfect area is a little tricky. Given all evidence,
the Perfect location (green area) can be
estimated generously.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

181
 Query Results m Ratings and Explanation
4 � fro ez
2 n
[1141 Swiss Chalet 7 , �20 art� Relevance Excellent
1 �M
Highbury 1141 Highbury a ry� scarAve Sa
Ave, London, London,
u
ebr 9�bON y�O N5Y IP� turda
y , � F
4 . i q ue 1A5 CAN Name Accuracy 17
2.1 y,�FCorrect
Ontario] rd a 5 n r 6.2 ebru
tu 6.2 Ma
Sa 172.1 54
.9� ary�1
IP�
User in London, Address Accuracy MCorrect b 7
an y�Os ,�202
Canada riq car
ue �M 4�fro
Pin Accuracy Approximate art m
�ne
z
All four of these businesses:

1. Swiss Chalet
2. Wings Kitchen
3. Fast Photo
4. Globally Local

share the 1141 Highbury Ave address and are of

similar prominence. They are all equally likely to
be the intent of a user with this query. This
means that all results can be rated Excellent.

Compare this example to the Eaton Centre

example, above, where there is a single most
prominent POI at the address that is the
dominant user intent.

In the diagram at left, the pin is in the parking

lot and would be rated Approximate for any of
the results.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

182
Address queries can also be just the name m of a street, neighborhood, intersection, or city. Results for
ro
streets, neighborhoods, intersection, � and
f ez city queries are eligible for Navigational.
, �2 024 art�n
The expectation is that we �17 ar�M
u �Osc the requested entity with the same
a ryreturn Sa level of broadness that the user
t
requested, which may Fe b r
not �binclude
y e all of the elements of a full I P�1 urda
address.
y,� 54.9 nriq u 72 y,�F
da
r 16. Ma2 .16 eb
t u .25 rua
S a 72. 4 r
Query P�1 Results RatingsM&.9Explanation
�by y�17,
I an �Os �202
r c
Is there a Navigational Result for this Query? Yes ique ar�M 4�fro
art m
�ne
Relevance Navigational z
Name Accuracy n/a
Address
Correct
Accuracy
Pin Accuracy Perfect

Stevens Creek Blvd

Stevens Creek Blvd
Cupertino, CA
Classification: n/a

The query is for a street in Cupertino, CA. The

postal code is optional for such results, but if
the postal code is returned, any portion of the
street has to belong to that postal code area.
The pin appears to fall outside the street
[stevens
boundaries in the vector view. However, in
creek blvd
satellite it is still within the boundaries.
cupertino]
Whenever there is a discrepancy the most
favorable layer should be used to determine
pin accuracy.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

183
 Query Results m Ratings & Explanation
4 � fro ez
2 n
7 , �20 art� Relevance Bad (User Intent)
1 �M
a ry� scar Sa
u
ebr 9�by�O ue IP� turda n/a
Name Accuracy
F 17
, �
y 54. nriqCA 2.1 y,�Fe
r daCupertino,
.2 Ma Address 6.2 bru
t u .16
Sa 172Cupertino, CA Correct
54
.9� ary�1
� Accuracy
P Ma by�O 7,�2
I Classification: n/a nri sc 024
Pin Accuracy Perfect
qu ar�M �fr
e art om
�ne
z

This result for an entire city does not satisfy

user intent when the query was for a street in
that city. Pin is dropped within the boundaries
of the city of Cupertino and is rated Perfect.

Relevance Bad (User Intent)

Name Accuracy n/a
Address
Correct
Accuracy
[stevens Pin Accuracy Perfect
creek blvd 19062 Stevens Creek Blvd
cupertino] 19062 Stevens Creek Blvd
Cupertino, CA, 95014
Classification: n/a

The result includes a street number when the

query is just for a street, making this result too
specific for the requested query. The pin is
dropped on the result address. m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

184
 Query Results m Ratings & Explanation
4 � fro ez
2 n
7 , �20 art� Relevance Bad (User Intent)
1 r�M
Happy ry� scaHot
Lamb
a Pot Sa
e
u
br �by�O e IP� turda Correct
Name Accuracy
19062
F Stevens
y,� 54.9 nriq u Creek Blvd 17
2.1 y,�Fe
a Address
tur Cupertino,
. Ma CA, 95014
d 2 6.2 bru
.16
Sa 172Classification: Correct
54
.9� ary�1
Chinese Accuracy
IP� Ma by�O 7,�2
nri sc 024
Pin Accuracy Perfect
qu ar�M �fr
e art om
�ne
z
The result is for a business on the street. When
the query is for an entire street, returning a
business is too specific a result for the
requested query.

Stevens Creek and De Anza Relevance Bad (User Intent)

Blvd. Stop
Cupertino CA 95014
Name Accuracy Correct
Classification: Bus Stop
Address
Correct
[stevens Accuracy
creek blvd
cupertino] Pin Accuracy Perfect

The result is for a bus stop on the street. This

random result does not satisfy the user's intent
and lacks prominence compared to the very
long street.
m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

185
 Query Results m Ratings & Explanation
4 � fro ez
2 n
[upper east 7 , �20 art�
Is there a Navigational Result for this Query? Yes
�1 ar�M
side] y
ar sc S a
e bru �by�O e Relevance IP turd Navigational
,�F 4.9 riqu �17 ay,
a y 2.1 �Fe
r d 6.25 an Name Accuracy 6.2n/abru
t u UpperMEast Side
Sa 172.1 54
.9� ary�1
� Upper East Side Address Ma by�O 7,�2
IP Correct
New York, NY 10021 Accuracy
nri sc 024
qu ar�M �fr
e art om
Classification: n/a �ne
Pin Accuracy Perfect z

The result is the requested neighborhood and

therefore is rated n/a for Name Accuracy. The
postal code is correct and belongs to the
requested neighborhood. A Perfect pin can
drop anywhere within the boundaries of the
neighborhood.

Relevance Good (User Intent)

Name Accuracy Incorrect
Address
Correct
Accuracy
Metropolitan Museum of Art
1000 5th Ave Pin Accuracy Perfect
New York, NY 10028 Research shows the Metropolitan Museum,
Classification: Art Gallery one of the most famous museums in the world,
is located on the Upper East Side. Its
extremely high international prominence
qualifies it for a Good rating due to secondary
intent for this query.

The Name Accuracy rating for this result is

Incorrect due to the misspelling of the
classification.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

186
 Query Results m Ratings & Explanation
4 � fro ez
2 n
7 , �20 art� Relevance Bad (User Intent)
1 �M
a ry� scar Sa
u
ebr 9�by�O ue IP� turda Correct
Name Accuracy
F 17
, � . iq 2.1 y,�Fe
u r day 6.254 anr Address 6.2 bru
t
Sa 172.1
M Correct
54
.9� ary�1
� Accuracy
IP Ma by�O 7,�2
Boqueria Upper East Side Pin Accuracy
nri sc 024
Perfect
qu ar�M �fr
1460 2nd Ave e art om
New York, NY 10075 �ne
z
Classification: Spanish

The result is for a business within the queried

neighborhood. Even though the business
name contains the query terms, this result
does not satisfy user Intent, and is not
internationally prominent enough to be
considered relevant for the query.

Relevance Bad (User Intent)

Name Accuracy n/a
Address
Correct
Accuracy
1596 2nd Ave
1596 2nd Ave Pin Accuracy Perfect
New York, NY 10028
Classification: n/a

The result is for a specific address within the

neighborhood. This result is too specific forom
Sa r
IP� turda the broader query. The address is not 024�f t�nez
internationally prominent enough �to �2 ar the
17
2.1 y,�Fe 17,satisfy
�M
6.2 bru intent for the query. ar scar
y
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

187
 Query Results m Ratings & Explanation
4 � fro ez
2 n
7 , �20 art�
Is there a Navigational Result for this Query? Yes
y �1 ar�M S
ar sc a
e bru �by�O e Relevance IP turd Navigational
,�F 4.9 riqu �17 ay,
a y 2.1 �Fe
u r d 6.25 an Name Accuracy 6.2n/abru
t M
[Cork] Sa 172.1 54
.9� ary�1
IP � Address Ma by�O 7,�2
Correct
nri sc 024
Accuracy qu ar�M �fr
e art om
Cork Pin Accuracy Perfect �ne
z
Cork, Ireland
Classification: n/a

The result is for the city of Cork in Ireland. A

perfect pin can drop anywhere within the city
boundaries.

Relevance Good (User Intent)

Name Accuracy Correct

Cork Airport Address

Correct
Kinsale Rd Accuracy
Cork, Ireland Pin Accuracy Perfect
Classification: Airport

The result is for a transit POI, which satisfies a

Sa � from z
IP� turda secondary query intent. The address and 24 pinne
17 are correct. , �20 art�
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

188
 Query Results m Ratings & Explanation
4 � fro ez
2 n
7 , �20 art� Relevance Bad (User Intent)
1 �M
a ry� scar Sa
u
ebrCity �O e IP� turda Correct
Name Accuracy
Cork F �by Library 17
a y 54 nriqu
, � . 9 2.1 y,�Fe
d 57-61 2 Grand Parade Address 6.2 bru
tur .16. Ma Correct
54
Sa 172Cork, Ireland Accuracy .9� ary�1
IP� Classification: Library Ma by�O 7,�2
nri sc 024
Pin Accuracy Perfect
qu ar�M �fr
e art om
�ne
z

The result is for a POI within the city. This does

not satisfy secondary intent for the query as it
is neither internationally prominent nor a
transit POI.

[Stevens Is there a Navigational Result for this Query? Yes

Creek and
De Anza] Relevance Navigational
Name Accuracy n/a
Address
Correct
Accuracy
Pin Accuracy Perfect

Stevens Creek and De Anza

Blvd
Stevens Creek and De Anza Blvd
Cupertino CA 95014
Classification: n/a

The query is for an intersection and the

specific intersection is returned.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

189
 Query Results m Ratings & Explanation
4 � fro ez
2 n
, �20 art� Good/Acceptable (User
1 7 �M Relevance S
a ry� scar a Intent)
u
ebr 9�by�O ue IP� turda
F 17
, �
y 54. nCreek riq Name Accuracy 2.1 y,Correct
�F
u r daStevens
6 . 2 a and De Anza 6.2 ebru
t .1 M 54
Sa 172Blvd. Stop Address .9� ary�1
IP� Cupertino CA 95014 MCorrect
b 7
an y�Os ,�202
Accuracy riq car
Classification: Bus Stop ue �M 4�fro
Pin Accuracy Perfect art m
�ne
z

The query is for an intersection and a bus stop

with the same name is returned. In some
countries, bus stops carry the same name as
the intersection where they are located and
can satisfy a secondary intent for the query.
The pin falls where a user would wait for the
bus.

Relevance Bad (User Intent)

Name Accuracy n/a
Address
Correct
Accuracy
Pin Accuracy Perfect

Stevens Creek Blvd

Stevens Creek Blvd
Cupertino CA 95014
Classification: n/a

The query is for an intersection and we return

just one of the streets from the query. This
does not satisfy user intent.
m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

190
 Query Results m Ratings & Explanation
4 � fro ez
2 n
[95051] 7 , �20 art�
Is therera y�1Navigational
�M Result for this Query?S Yes
u a s car atu
F ebr 9�by�O ue IP� rda
17
a , �
y 54 nr . i q Relevance 2.1 y,Navigational
�F
u r d 95051
6 . 2 a 6.2 ebru
t .1 M 54
Sa 172Santa
� Clara, CA, 95051 Name Accuracy n/a.9� ary�1
IP Classification: n/a Ma by�O 7,�2
nri sc 024
Address qu ar�M �fr
Correct e art om
Accuracy �ne
z
Pin Accuracy Perfect
The expectation for this result is to include
locality, state and postal code. Other
components are optional, but if present they
need to be correct.

The pin must drop within the boundaries of the

locality presented in the result.

10.2. Non-Specific Address

For queries where the location intent is not explicitly stated in the query, you must infer the location
intent from the user’s viewport and the user’s location. One difficulty in evaluating address queries
has to do with partial addresses, which could refer to multiple locations.
Generally, for partial addresses, users are looking for the location closest to their position or within/
near the fresh viewport. Some general considerations:
• Exact location that exists returned very close to the user is eligible for Navigational, unless
other addresses that satisfy the user intent are also very close.
• Exact location returned within a fresh viewport is eligible for Navigational, unless other
addresses that satisfy the user intent are also very close.
• Results that are farther away from an ideal result but can potentially satisfy the user’s intent
can be rated as high as Good (Distance/Prominence)
• Results are demoted based on distance.
• Results are demoted based on the density of potential results in a given area
• Results that are too far away will be rated Bad (Distance/Prominence)
Consider the query [154 orchard st] in different scenarios:

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

191
Scenario 1: Fresh viewport over Midtown m Manhattan in New York City.
� f ro
ez
, �2 024 art�n
17 �M
a ry� scar Sa
Query u �O User t and Viewport
Fe b r
�b y e I P�1 urda
y,� 54.9 nriq u 72over y,�F
a User and fresh viewport . 1 Midtown
ebr Manhattan in
[154 orchard u rst]16. Ma
d 2 6 . 2 u
t
Sa 172. New York City 5 4.9 ry�a
� M �b 17
User Intent: P
I The query does not specify in which locality the address is expected. an y�Os ,Use
riq car 024�the
�2
location intent given by the user and viewport to rate the results. u e �M fro
art m
�ne
Is there a Navigational Result for this Query? Yes z

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

192
 Results m Ratings and Explanation
4 � fro ez
2 n
① 154 Orchard St 7 , �20 art� Relevance Navigational
1 ar�M
154 Orchard St, New York, a ry�NYsc 10002 Sa
u
br �by�O e Name Accuracy IP tun/a
e �17 rday,
Classification: n/aa y,�F 54.9 nriqu 2.1 �Fe
tur
d 6.2 Ma Address Accuracy Correct
6.2 bru
Sa 172.1 54
.9� ary�1
IP� Pin Accuracy Ma by�O 7,�2
Perfect
nri sc 024
qu ar�M �fr
e art om
�ne
z

The result is in Lower Manhattan, very close to the user

location.

② 154 Orchard St Relevance Good (Distance/Prominence)

154 Orchard St, Newark, NJ 07102
Classification: n/a Name Accuracy n/a
Address Accuracy Correct
Pin Accuracy Perfect

The result is farther away from the viewport, but still

matches the query.
m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

193
 Results m Ratings and Explanation
4 � fro ez
2 n
③ 154 Orchard St , �20 art�
7
y�1 car�M Relevance Sa Good (Distance/Prominence)
154 Orchard St, Garfield, a rNJ s07026
e
u
br �by�O e IP� turda
F 17 n/ay,�
Classification: n/a
da y,� 54.9 nriqu Name Accuracy 2.1 Fe
tur 6.2 Ma 6.2 bru
Sa 172.1 Address Accuracy
54
Correct .9� ary�1
IP� Ma by�O 7,�2
n 0
s
Pin Accuracy Perfectriqu car�M 24�fr
e art om
�ne
z

The result is farther away from the viewport, but still

matches the query.

④ 154 Orchard Dr Relevance Bad (Distance/Prominence)

154 Orchard Dr, Levittown, Pennsylvania
19054 Name Accuracy n/a
Classification: n/a
Address Accuracy Correct

Pin Accuracy Wrong

The result is in a different state and very far away from

the user’s viewport. The street type does also not
match the query.

The pin lands on the house with the street number 114,
which can be verified via street imagery. Since this is
several houses down from the intended address, it is
incorrect.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

194
 m
Scenario 2: Viewport/user’s location 4 � fro isezin Maine. There is no address in the vicinity that contains
2 rt�n
[154 Orchard St]. All locations 7 , �20witha this address are far from the location intent of the query.
y �1 ar�M Sa
r
ua �Osc t
e b r
�b y e I P�1 urda
da yQuery
F
,� 4.9 riq
5 n
u User72andy,Viewport
.16 �Feb
u r 6 . 2 a .2 ru
t 2.1 M
[154 orchard
Sa 1st]7 User and viewport in Maine 54.9� ary�1
IP� Ma by�O 7,�2
nri sby 02 user and
User Intent: Since there is no matching result close to the location intent given qu carthe
e �M 4�fro
viewport, the closest address is rated without demotion for user intent or distance/prominence. art m
�ne
z
Is there a Navigational Result for this Query? No

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

195
 Results m Ratings and Explanation
4 � fro ez
2 n
① 154 Orchard St 7 , �20 art� Relevance Excellent
1 ar�M
154 Orchard St, New York, a ry�NYsc 10002 Sa
u
br �by�O e Name Accuracy IP tun/a
e �17 rday,
Classification: n/aa y,�F 54.9 nriqu 2.1 �Fe
tur
d 6.2 Ma Address Accuracy Correct
6.2 bru
Sa 172.1 54
.9� ary�1
IP� Pin Accuracy Ma by�O 7,�2
Perfect
nri sc 024
qu ar�M �fr
e art om
�ne
z

This location is among the closest possible results to

the viewport/user’s location.

② 154 Orchard St Relevance Excellent

154 Orchard St, Newark, NJ 07102
Name Accuracy n/a
Classification: n/a
Address Accuracy Correct
Pin Accuracy Perfect

This location is among the closest possible results to

the viewport/user’s location.

③ 154 Orchard St Relevance Excellent

154 Orchard St, Garfield, NJ 07026
Name Accuracy n/a
Classification: n/a
Address Accuracy Correct
Pin Accuracy Perfect

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 7
1 ar�M
6.2 bru This location is among the closest possible ary� results
sc to
54 u
br �by�O e
.9� ary�1 the viewport/user’s location. � F e 9 u
Ma by�O 7,�2 ay, .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

196
 Results m Ratings and Explanation
4 � fro ez
2 n
④ 154 Orchard Dr 7 , �20 art� Relevance Bad (User Intent)
1 ar�M
154 Orchard Dr, Levittown, a ry� Pennsylvania
sc Sa
tur
u
br �by�O e
19054 e Name Accuracy IP�17 n/a da
da y,�F 54.9 nriqu 2.1 y,�Fe
2 6.2 bru
turn/a 6. Ma
Classification: Address Accuracy Correct
Sa 172.1 54
.9� ary�1
IP� Pin Accuracy Wrong
Ma by�O 7,�2
nri sc 024
qu ar�M �fr
e art olocation
m
This location is farther from the viewport/user �ne
than the result in New York and therefore demoted z for
distance. The user is also looking for a Street, but has
been presented with a Drive.

The pin lands on the house with the street number 114
which can be verified via street imagery. Since this is
several houses down from the intended address, it is
Wrong.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

197
Here is another example of an addressmquery with implicit location intent. Although this is a common
address in US cities, it overwhelmingly 2 4 �fro erefers
z to the location of the White House and should be
considered the primary intent7,of t�n
�20thearquery unless an additional location modifier is provided (i.e.
�1 ar�M
state, city, or postal code) ua or�Oascdifferent 1600 Pennsylvania Ave that’s
r y Sa not the White House is already
t
in or very near the locationFe b r
�b yintent.
e I P�1 urda
y,� 54.9 nriq u 72 y,�F
da
r 16. Ma2 .16 eb
t u .25 rua
Scenario 1:SFresh
a 72. viewport on Los Angeles, CA (not near Richmond, CA):
1
4.9 ry�
� M �b 17
I P an y�Os ,�202
riq car
Query Results ue
Ratings and Explanation�M 4�fro
art m
�ne
Is there a Navigational Result for this Query? Yes z

The White House Relevance Navigational

1600 Pennsylvania Ave,
Washington, DC, 20500 United Name Accuracy Correct
States Address Accuracy Correct
Classification: Landmark
Pin Accuracy Perfect

The POI associated with this address is

[1600 overwhelmingly prominent and this is the
pennsylvania most likely intent.
ave]

Fresh viewport
on Los Angeles,
1600 Pennsylvania Ave Acceptable/Bad
CA (not near Relevance
1600 Pennsylvania Ave, (Distance/Prominence)
Richmond, CA)
Richmond, CA 94801
Name Accuracy n/a
Classification: n/a
Address Accuracy Correct
Pin Accuracy Perfect

Technically a match, but considering the

user’s viewport it is less likely that the user is
looking for this location.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

198
Scenario 2: The fresh viewport is in San m Francisco, CA (near Richmond, CA). The proximity of the
ro
user viewport to the Richmond location � f emakes
z this location just as relevant as the prominent location
in Washington DC. , �2 024 art�n
17 �M
a ry� scar Sa
Query u �O Results Ratings
t & Explanation
Fe b r
�b y e I P�1 urda
,� 4.9 riq u 72 y ,�F
r [Link]
25 ana Navigational Result for this Query? .16.2 No eb
t u
Sa 172.1
M 54 ruar
.9� y�1
IP� The White House Relevance MaExcellent
by� 7,�
O 2
1600 Pennsylvania Ave, n riq scar 024�
Washington, DC, 20500 Name Accuracy Correct
u e �M fro
art m
�ne
Classification: Landmark Address Accuracy Correct z

Pin Accuracy Perfect

[1600 Both results are equally valid, so neither can

pennsylvania get Navigational and should instead be rated
ave] Excellent.

Fresh viewport
on San 1600 Pennsylvania Ave Relevance Excellent
Francisco, CA
1600 Pennsylvania Ave,
(near Richmond, Name Accuracy n/a
CA)
Richmond, CA 94801
Classification: n/a Address Accuracy Correct
Pin Accuracy Perfect

Both results are equally valid, so neither can

get Navigational and should instead be rated
Excellent.

10.3. Query Address Does Not Exist

To be useful to the user, address results need to point to either a building with that address or a plot
of land that has been officially assigned the address. Sometimes your research will show that a full
query address does not exist (or no major search engine will be able to determine its exact location).
In cases like this, you will see one of three types of results:
S•a The closest verified address (on the same street and in the same city and state):�fRate rom z
t u
IP� rrelevance as Excellent. 2 4 ne
17 day,� 7 , �20 art�
• 2The same address as the query address: Rate relevance as Excellent and address �M
ry� scar as
.16 F 1
.25 ebrua u a
Incorrect
4.9 r–y�Address does not exist. The pin will be rated Can’t Verify. ebr �by�O e
• TheMqueried �b 17
an y�Os street
,�2 without a street number: Rate relevance as Acceptable.
d ay,�F 54.9 nriqu
riq car 024� r .2 Ma
ue �M fro S atu 72.16
When a queried addressadoes rt�n mnot exist, the answer to the question “Is there1
e IP� a navigational result for
this query” will always be No.z

199
 Query Results m Ratings and Explanation
4 � fro ez
2 n
[2001 Duncan Is there a 7Navigational , �20 art� Result for this Query? No
�1 ar�M
St, San y
ar Osc S a
Francisco] 1099 e bruDuncan
y � St Relevance IP turd Excellent
� F e
�b qu St., San �17 ay,
1099
,
y 54 nr Duncan
. 9 i 2 � Fe
u rda Francisco,
6 .2 Ma 94131, CA Name Accuracy .16.2 n/a br
t
Sa 172. 1 5 4.9 uary�
�b 17
IP� Classification: n/a Address Accuracy MCorrect an y�Os ,�202
riq car
Pin Accuracy Perfectue �M 4�fro
art m
�ne
z
If 2001 does not actually exist then selecting
1099, the closest address on the same street in
the same city and state that does exist, is
considered correct.
For a locale that uses the rule of even numbers
on one side of the street and the odd numbers
on the other, we need to return the closest
existing address on the same side of the street
as the query. If the rule of odds and evens does
not apply then the closest numeric number will
be considered correct.
The pin has to be correctly dropped on the
address presented in the result to be rated
Perfect.

2001 Duncan St Relevance Excellent

2001 Duncan St., San Name Accuracy n/a
Francisco, 94131, CA
Classification: n/a Incorrect – Address
Address Accuracy
does not exist
Pin Accuracy Can’t Verify
Duncan Street only goes up to number 1099,
but the query requests a non-existent number.
The result returned is the same as the queried
address and should be rated as Excellent.
The pin rating for addresses that do not exist is
Can’t Verify.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

200
 Query Results m Ratings and Explanation
4 � fro ez
2 �n
Duncan St7,�20 art Relevance Acceptable (User Intent)
y�1 San �M
Duncan a rSt, s car Francisco, Sa
94131,
u
ebr 9�CA O
by� ue
Name AccuracyIP� turda n/a
F 17
, � . iq 2.1 y,�Fe
r dayClassification:
. 254 anr n/a Address Accuracy 6.2 Correctb
t u
Sa 172.1
6 M 54 ruar
.9� y�1
IP� Pin Accuracy b
MPerfect 7
an y�Os ,�202
riq car
ue �M 4�fro
The result returns only the street withart a m pin
�ne
dropped within the boundaries of the street. z
This result technically satisfies the user intent,
but this intent is unlikely, so relevance should
be rated Acceptable.

10.4. Point of Interest

A correct location result should be rated Navigational for queries referring to a point of interest.
Consider the query [mount rushmore], the famous US monument. Although the query terms do not
contain an explicit location, the Mount Rushmore monument is so prominent and unambiguous that
its location should be considered the primary location intent. The user viewport and user location are
irrelevant for this query because the user is looking for the place of interest no matter where they
currently are.

Query Results Ratings and Explanation

Is there a Navigational Result for this Query? Yes
[mount
rushmore] Relevance Navigational
Name Accuracy Correct
Address Accuracy Correct
Mount Rushmore National Pin Accuracy Perfect
Memorial
13000 S Dakota 244, Keystone,
SD, United States
Classification: Landmark

Sa The pin can drop anywhere within the �from z

IP� turda boundaries of the park to be rated ,Perfect. 24 ne
17 �20 art�
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

201
 Query Results m Ratings and Explanation
4 � fro ez
2 n
Mount Rushmore , �20 art�KOA at
7
y�1 car�M Relevance S Bad (User Intent)
Palmer a rGulchs atu
u
12620
Fe b y�O e 244
br �Highway IP� rda
17
,� 4.9 riqu
yHill Name Accuracy 2.1 y,�FCorrect
da 25City,nSD 57745 6.2 ebru
tur 16. Ma 5
Sa [Link]: Campground .9� ary�1
Address Accuracy 4Correct
IP� Ma by�O 7,�2
nri sc 024
Pin Accuracy Perfect
qu ar�M �fr
e art om
�ne
z

This result is a campground within the park

and is not the park the user asked for.

Mount Rushmore Gift Shop

Relevance Bad (User Intent)
13000 SD-244, Keystone, SD
57751
Name Accuracy Correct
Classification: Gift Shop
Address Accuracy Correct
Pin Accuracy Perfect
This result is a gift shop inside Mount
Rushmore National Park and is not the park
the user asked for. Both the Name and
Address Accuracy are verified and rated
Correct. The pin falls on the shop and is
Perfect.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

202
 Query Results m Ratings and Explanation
4 � fro ez
2 n
Is there a 7Navigational
, �20 art� Result for this Query? Yes
y �1 ar�M S
ar Osc atu
Route bru 66 � Relevance
I Navigational
� Fe y
�b AZ u e P �17 rday,
Seligman,
,
y 54 nr . 9 i q 86337 2.1 Fe �
rda United
.2 MStatesa Name Accuracy 6.2 n/ab
t u
Sa 172. 1 6 54 ruar
.9� y�1
IP� Classification: n/a Address AccuracyMaCorrect by 7,
nri �Osc �2024
qu a
Pin Accuracy Perfecte r�Ma �from
rt�n
ez
This result represents Route 66 and is rated
Navigational regardless of user location,
viewport, or the locality in the address. The
pin can be dropped anywhere along the route.

Route 66 Indian buffet all 7 Relevance Bad (User Intent)

[route 66] days
397 Las Colinas Blvd, Name Accuracy Partially Correct
Fresh viewport
on Amarillo, TX Irving, TX 75039 Incorrect - Unit/Apt,
Address Accuracy
Classification: Indian Street Name
Pin Accuracy Perfect
The result is a randomly chosen business far
from the user whose name includes the query
terms. The result name differs from the
official name variations used on the website:
“Route 66 Fine Indian and American
Cuisines” or “Route 66 Indian Cuisine”.
However, the name is still recognizable and is
rated Partially Correct. The address on the
official website is “397 East Las Colinas Blvd”
whereas the result address excludes “East”.
Also, the official site lists a unit number, 180,
which is missing from the address in the
result.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

203
 Query Results m Ratings and Explanation
4 � fro ez
2 n
, �20 art�
Is there a 7Navigational Result for this Query? Yes
y �1 ar�M S
ar Osc a
Machu
e bru �bPicchu
y � e IP� turda Navigational
Relevance
,�F 4.9Calientes, 17
a yAguas5 riq
u Peru 2.1 y,�Fe
tur
d 2
6. Ma
n Name Accuracy6.2 Correctb
Sa 172.1 54 ruar
.9� y�1
IP� Address AccuracyMaCorrect by 7,
nri �Osc �2024
qu a
Pin Accuracy Perfect e r�Ma �from
rt�n
ez

The result is an internationally known historical

site and the most relevant result, making it the
primary user intent.
[Machu
Picchu]

Fresh viewport
over Relevance Good (User Intent)
Massachusetts,
some distance Machu Picchu Restaurant Name Accuracy Correct
away from 307 Somerville Ave, Somerville, MA
Somerville, MA
Address Accuracy Correct
02143
Pin Accuracy Perfect

Since the result is reasonably close to the

fresh user viewport, it will be considered
secondary intent for this query.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

204
10.5. Understanding Multiple Query m Interpretations: Beyond Viewport and User Location
f ro
24� rt�nez
0multiple
Many address/POI queries have , �2 a interpretations. Understanding which interpretation is most
likely often requires extraaresearch y �17 ar�Min addition to considering the viewport
Sa and user’s location. It is
r
r u �Osc tur
critical to fully understand e b the
y query through research rather thanP�guessing.
I
17 day,�
a y ,�F 4.9�b rique 2.1 Fe
t u rd 16.25 Man 6.2 bru
a 72. 54 ary
Query �1
S Results Ratings and .9� Explanation
IP Ma y�O �17,�2
b
nri sc 024
Is there a Navigational Result for this Query? Yes qu ar�M �fr
e art om
�
New York City Relevance Navigational nez
New York City, NY, US
Name Accuracy n/a
Classification: n/a
Address Accuracy Correct
Pin Accuracy Perfect

This is a very prominent result that satisfies

the user intent.

New York State Relevance Good (User Intent)

New York, US
Name Accuracy n/a
Classification: n/a
[new york] Address Accuracy Correct
Pin Accuracy Perfect
User and
viewport
somewhere in This result refers to the state of New York and
France satisfies a secondary intent of the query.

Avenue de New York Relevance Good (User Intent)

Avenue de New York, Paris,
France Name Accuracy n/a
Classification: n/a Address Accuracy Correct
Pin Accuracy Perfect

m
Sa �fro ez
IP� turda The result is within the fresh viewport, 2 4
�20 but
n
rt�is
17 , a
2.1 y,�Fe not a very prominent street. Although
7 �M
ry� scar this is
1
6.2 bru u a
54
.9� ary�1 still a possible interpretation, ebr 9it�bis
y�Onote a perfect
Ma by�O 7,�2 , � F u
match to the query and d ay is.2overshadowed
.
54 anriq by
nri sc 024 r 6
qu ar�M �fr the prominence Sofa New
t u . York City.
1 M
e art om P � 172
�ne I
z

205
 Query Results m Ratings and Explanation
4 � fro ez
2 n
, �20 art�
Is there a 7Navigational Result for this Query? Yes
y �1 ar�M S
ar sc a
Amsterdam
e bru �by�O eCafe RelevanceIP� turda Navigational
,�F South 17
a y410 5
u St
4.9 nriqGay 2.1 y,�Fe
d 2
6. Ma AL 36830
tur Auburn, Name Accuracy6.2 Correct b
Sa 172.1 54 ruar
.9� y�1
[amsterdam IP� Classification: American (New) Address AccuracyMaCorrect by 7,
nri �Osc �2024
qu a
cafe] Pin Accuracy Perfect e r�Ma �from
rt�n
ez
User and fresh The user and fresh viewport are close to
viewport in Auburn, Alabama, this cafe is an exact match,
Auburn, AL and can therefore be considered the main
intent.

The pin lands on the edge of the building, so

by applying the tennis rule the pin will be
rated as Perfect.
Is there a Navigational Result for this Query? No
Café de Jaren Relevance Excellent
Nieuwe Doelenstraat 20-22, 1012
CP Amsterdam, Netherlands Name Accuracy Correct
[amsterdam
cafe] Classification: Café Address Accuracy Correct

User and Pin Accuracy Perfect

viewport
somewhere in
Europe The user and viewport are in Europe, so cafes
in the city of Amsterdam are the expected
results.

Is there a Navigational Result for this Query? No

Relevance Excellent
Café de Jaren
Nieuwe Doelenstraat 20-22, 1012 Name Accuracy Correct
CP Amsterdam, Netherlands
Classification: Café Address Accuracy Correct
[amsterdam Pin Accuracy Perfect
Sa cafe] m
�fro ez
IP� turda 2 4
�20 art�
n
17 andy,�fresh
User 7 , M
2.1 Fe
6.2 inbru The user and viewport are in aarrural y�1 careaar� and
viewport u s
there is no relevant result in ebrthe �O e so the
�byarea,
54 a
Maine,M US.9�b ry�17 , � F . 9 qu
an y�Os ,�202 strongest matches are d aycafes 254 inathenri city of
riq car tu r 6 .
ue �M 4�fro Amsterdam. Sa 172.1
M
art m �
�ne IP
z

206
 Query Results m Ratings and Explanation
4 � fro ez
2 n
, �20 art�
Is there a 7Navigational Result for this Query? Yes
y �1 ar�M S
ar sc a
e bru �by�O e Relevance IP� turda Navigational
17
a y,�F 54.9 nriqu 2.1 y,�Fe
d
tur 16. Ma
2 Name Accuracy6.2 n/a b
Sa [Link] 54 ruar
.9� y�1
IP� Europe Address AccuracyMaCorrect by� 7,�
O 2
[europe] n riq scar 024�
Classification: n/a u �M fro
Pin Accuracy Perfect e art m
�ne
User and z
The query is clearly for the European
viewport
somewhere in continent, so returning the continent should
US be rated Navigational. If the name of a local
business exactly matches the query with no
extra words then that business may be a
reasonable interpretation of the query and
should be rated based on distance from the
user or viewport. All other businesses are
Bad.
Is there a Navigational Result for this Query? Yes
Relevance Navigational
Name Accuracy n/a
Paris
Paris, France Address Accuracy Correct
Classification: n/a Pin Accuracy Perfect

The query [paris] can mean either the capital

of France or one of the more than 10 towns
across the USA with the same name. Because
[paris] of the small population and lack of tourism in
these small towns, the city in France should
User and fresh be rated Navigational unless the query’s
viewport location intent is within or very close to one of
somewhere in these small US cities.
San Francisco,
CA Paris Acceptable/Bad (User
Relevance
Texas, USA intent)
Classification: n/a Name Accuracy n/a
m
Sa
Address Accuracy Correct �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe Pin Accuracy Perfect ary�1 scar�
7 M
6.2 bru u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d
qu ar�M �fr tu 2.16 M
e art om Sa 17to
This result is unlikely satisfy the user intent.
IP �
�ne
z

207
 Query Results m Ratings and Explanation
4 � fro ez
2 n
, �20 art�
Is there a 7Navigational Result for this Query? No
y �1 ar�M S
ar sc a
e bru �by�O e Relevance IP� turda Excellent
17
a y,�F 54.9 nriqu 2.1 y,�Fe
d 2
6. Ma Ho's Hunan Food
tur Brandy Name Accuracy6.2 Correct b
Sa 172.1 54 ruar
.9� y�1
I P� 217 Columbus Ave, San Address Accuracy by� 7,�
MaCorrect
[hunan] Francisco, CA 94133 n O 2
riq scar 024�
ue f
Classification: Hunan Pin Accuracy Perfect �Mar rom
User and fresh t�n
ez
viewport The query [hunan] represents both the
somewhere in seventh most populous province in China and
San Francisco, a popular type of cuisine. In this case, both
CA user location and viewport are in the San
Francisco Bay area. An online maps search
done by a user in this area shows that the
dominant intent of this query is for the
cuisine. The province is a less likely, but still
viable, intent that can be rated Acceptable.

10.6. Business Queries

Before you rate a business query, consider:

• Multiple interpretations: Are there ways to interpret the query terms other than as a
business name? French Laundry is both a famous restaurant in Napa and a type of
laundromat/cleaner.
• Number of locations: How many locations of this business exist? If there are many of them
(like Starbucks) then the user expects to find locations in or very close to the their location
intent.
• Population density: Is the area of the business results urban, suburban, or rural? City
dwellers are less willing to travel longer distances than suburban and rural users.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

208
10.6.1. Non-Chain Businesses m
4 � fro ez
Some businesses have only one 2 rt�n
7 , �20 location,
a so treat and rate them as navigational queries. The correct
1
location should be rated Navigational M and any other results should
ry � ar � Sa receive Bad (User Intent).
ua �Osc t
Fe b r
�b y e I P�1 urda
y,� .9 iq u 72 y,�F
Query urda 6.254 anr Results .16 and
Ratings .25 ebruExplanation
t 1 M 4.9 ary�
Sa 172. �by 17,
IP � Is there a Navigational Result for this Query? Ma Yes
nri �Osc �2024
qu ar�M �fr
Klein High School Relevance Navigational
e art om
16715 Stuebner Airline Rd �ne
Name Accuracy Correct z
Spring, TX 77379
Classification: High School Address Accuracy Correct
Pin Accuracy Perfect

This is a perfect result for the query. While

the city on the official website is ‘Klein’,
because USPS validates the full address, as
[klein high returned, in the city as ‘Spring’, we can rate
school] the address as correct.

User and Fresh

Viewport in Klein Independent School Relevance Bad (User Intent)
Spring TX District Central Office
7200 Spring Cypress Road Name Accuracy Correct
Klein, TX 77379 Address Accuracy Correct
Classification: School District
Office Pin Accuracy Perfect

The school district office is not relevant for

the query.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

209
 Query Results m Ratings and Explanation
4 � fro ez
2 n
Is there a Navigational
7 , �20 art� Result for this Query? Yes
y �1 ar�M S
ar sc a
Restaurant
e bru �by�O Gary e
Danko IP� turda
Relevance Navigational
800
, � F North
. 9 i q u
Point St, San Francisco, 17 y , �
y 54 nr 2.1 Fe
rdaCalifornia
.2 Ma 94109 Name Accuracy 6.2 bCorrect
t u
Sa 172. 1 6 54 ruar
.9� y�1
IP� Classification: American (New) Address Accuracy by
Ma Correct 7,
nri �Osc �2024
qu a
Pin Accuracy e r�Ma �from
Perfect rt�n
ez

This is a nationally famous restaurant in San

Francisco with no other possible results.

800 North Point Relevance Bad (User Intent)

800 North Point St, San Francisco,
California 94109 Name Accuracy n/a
[Gary Danko Address Accuracy Correct
800 North
Point St, San Pin Accuracy Perfect
Francisco,
When a user types in the name of a business
California
or a POI along with its address, they expect
94109]
to see the business mentioned in the query
as part of the result. If the result is the
address alone and does not mention the
business, the user cannot be certain that the
query and the result refer to the same thing.
This is why the result’s relevance is Bad.
Garry Lee, DDS Relevance Bad (User Intent)
1259 Mason St, San Francisco,
California 94108 Name Accuracy Correct
Classification: Dentist Address Accuracy Correct
Pin Accuracy Perfect

Result is unrelated to the queried restaurant.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

210
Sometimes there are multiple unrelated m businesses with the same name in the same area. In this
ro
case, rate each business independently � f ezconsidering its relevance and distance from the location
intent of the query. , �2 024 art�n
17 �M
a ry� scar Sa
t
u �O
e b r
�b y e I P�1 urda
da yQuery
F
,� 4.9 riq
5 n
u User72and
. 1
y,Viewport
�Fe
u r 6 . 2 a 6 . bru
at 72.1 M User inside a fresh viewport25over 4 .9� in
aryDearborn, MI (a
[lighthouse] �1
S
IP suburb of Detroit) Ma y�O �17,�2
b
nri sc 024
User Intent: When there are multiple unrelated businesses with the same name qu inarthe
�M same
�f area,
e art rom
rate each business independently considering its relevance and distance from the location �ne intent of
z
the query.
Is there a Navigational Result for this Query? No

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

211
 Results m Ratings and Explanation
4 � fro ez
2 n
① The Lighthouse 7 , �20 art� Relevance Excellent
y�1 r�M Sa
4474 W Jefferson Averuar �Osca Name Accuracy IP tuCorrect
b y
Ecorse, MI 48229y,�Fe 4.9�b ique �17 rday,
2.1 �Fe
d 6.25 anr
a
rPub Address Accuracy Correct
6.2 bru
Classification:
t u M
Sa 172.1 54
.9� ary�1
IP � Pin Accuracy Ma by�O 7,�2
Perfect
nri sc 024
qu ar�M �fr
This is one of the closest results that e fits the
art user’s
om
query. This result should receive a relevance�nratingez of
Excellent.

Both the Name and Address Accuracy are verified and

rated Correct.

The Pin lands on the correct rooftop.

② Lighthouse Ministries of Free Relevance Good (User Intent)

Methodist Church
2069 Chandler Ave Name Accuracy Correct
Lincoln Park, MI 48146
Classification: Church Address Accuracy Correct
Pin Accuracy Perfect
This is one of the closest results and partially fits the
query intent. This result is about the same distance from
the user’s location as the result above (The Lighthouse),
but is less likely to be the user's intent based on the
query. Therefore, this result should be demoted based
on secondary intent to Good.

Both the Name and Address Accuracy are verified and

rated Correct.

The pin lands on the correct rooftop and is Perfect.

10.6.2. Chain Businesses

A query for a chain business is generally not considered an explicit query and is therefore not eligible
a for Navigational rating unless the query contains a location modifier that points to a single unique
location (see Chain Business with Location Modifier). m
Sa
t u 2 4 �fro ez
IP� rda
1 , � 20 art�n
Chain72businesses
y
.1 ,�Feb are businesses that have more than one location, and include everything 1 afrom
7 r�M
national 6chains
.25 rulike Starbucks, Target, Auchan, Albert Heijn, and Boots down to small ary� scchains.
local
u
4.9 ary�
� 1 � F ebr 9�by�O ue
b ,
Ma y�O ,�2 7
d ay .254. anriq
Distance evaluations
nri sc should02 be based on chain business locations in the real
r world,M not only the
qu ar�M 4�fr S atu 72.16
returned results. e art mo 1
�ne IP�
z

212
 • The more locations the chain business m has in the area, the closer the results should be in
ro
order to be considered relevant. � f ez
• The fewer locations the , �2 024 arbusiness
chain t�n has in the area, the more you can widen the distance
�17 ar�M
for relevant results. r y
ua �Osc
Sa
t
F e b r
�b y e I P�1 urda
� 4.9 iq u 72 y,�F
ay, .25business’
Note: Go to therdchain official website and check the address .16of the
.25 ebruspecific branch you’re
n r
t u 6 M a
rating. For each 2. 1
Sa 17branch of a chain business, research to verify that it actually 4.9 exists
ary at the address
IP�
listed in the result. Ma �by�O �17,�2
nri sc 024
qu ar�M �fr
e art om
�ne
z

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

213
 m
� fro ez
Query 2 4 n User and Viewport
7 , �20 art�
1 �M
[whole foods] a ry� scar User and fresh Saviewport in Irvine, California
t
u
Fe b r
�b y � O
e I P�1 urda
� 4is
y,user .9 clearly u 72 Foodsy,�F
User Intent: The da 5 n riq looking for the grocery chain Whole . 1 ebclose to their location
r 16. Ma2 6 . r
or at least within
t u
Sa 172. the viewport. 25 u
4.9 ry�a
P � M �by 17,
I
Is there a Navigational Result for this Query? No anri �Osca �2024
qu
e r�Ma �from
rt�n
ez

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

214
 Results m Ratings and Explanation
4 � fro ez
2 rt�n
Is there a Navigational Result 7 , �20 for a this Query? No
y �1 ar�M S
ar sc a
bru �by�O e Relevance IP� tuExcellent
r
, � Fe
. 9 i q u 17 day,�
y 4 r 2.1 Fe
t u rda 16.25 Man Name Accuracy Correct
6.2 bru
54
Sa 172.
� .9� ary�1
IP Address Accuracy Ma by�O 7,�2
Correct
① Whole Foods nri sc 024
qu ar�M �fr
The District, 2847 Park Ave, Tustin, CA Pin Accuracy Approximate e art om
�ne
92782 z
Classification: Grocery

This is a Whole Foods store within the user’s viewport

as well as the closest Whole Foods location to Irvine.

The pin is dropped within the shared parking lot of the

result, making it Approximate.

② Whole Foods Relevance Good (Distance/Prominence)

Fashion Island, 415 Newport Center Dr,
Newport Beach, CA 92660 Name Accuracy Correct
Classification: Grocery Address Accuracy Correct
Pin Accuracy Perfect

This is a Whole Foods store in the same metro area, but

is outside the user’s viewport.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

215
 Results m Ratings and Explanation
4 � fro ez
2 n
③ Whole Foods , �20 art� Acceptable (Distance/
� 7
1 ar�M Relevance
y
ar sc 23932
Aliso Village ShoppingruCenter,
S a Prominence)
e b �by�O e IP� turda
Aliso Creek Rd, Laguna
y,�F 54.9Niguel, u CA 92677 Name Accuracy 17 Correct
2.1 y,�Fe
da 2 n riq 6.2 bru
6. Ma
turGrocery
Classification:
Sa 172.1 Address Accuracy
54
Correct .9� ary�1
IP � Ma by�O 7,�2
n s 0
Pin Accuracy Perfectriqu car�M 24�fr
e art om
�ne
This is a Whole Foods store in a neighboring city, z
outside of the viewport and a considerable distance
away. As such this result is less relevant to the user and
is rated Acceptable.

10.6.3. Chain Business with Location Modifier

If the query for a chain business includes a location modifier that points to a single unique branch of
that business, that specific branch can be eligible for a Navigational rating.

When there are multiple results available for the location modifier, the highest possible rating for all
results will be Excellent. Remember:

• User and viewport location should always be ignored when there is a location modifier
• Ratings must always be based on possible real-world results

There are two types of location modifiers:

• General location modifier (locality or postal code)

• Specific location modifier (street or full address)

#Y"J"N"#"%Z)B)E9C%5A*9@AB%/A,>[)E

Location modifiers in the form of localities or areas are considered to be general location modifiers.

Results inside the requested location

When the location modifier is general, results inside the specified location are not demoted for
distance. m
Sa
t u 2 4 �fro ez
IP� rda
17 y 7 , � 20 art�n
2.1 ,�Fe 1 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
b ,
Ma y�O ,�2 7
nri sc 024 r d ay .254. anriq
qu ar�M �fr tu 6 M
e art om Sa 172.1
IP �
�ne
z

216
 Quantity of results m
Location of � fro ez
inside the requested 2 4 n Rating and Explanation
results
location
7 , �20 art�
1 �M
a ry� scar Sa
t
u
e b r y � O
e If there is only one I P�1 urpresent
result d in the requested
y F
,� 4.9 riq �b u 72 ay,�F
a
d 6.25 an location, it should [Link]
. e of Navigational.
tur M 25 brua
Sa 172.1 One 4.9 ry�
�by 17,
IP� It is promoted because it is the Ma only
nri �Oresult
sca �20that
24
satisfies
Inside the the user intent q u e r �M ro� f
art m
requested When there are multiple results for the chain nbusiness
� e
z in
location the requested location, they should all receive a rating
of Excellent.
More than one
Ignore user and viewport location. The user has already
told you exactly where they are looking for results.

Results outside the requested location

When the location modifier is general, results outside the requested location are demoted based on
how many results there are inside it.

Location of Results inside the

Rating and Explanation
results requested location

If there are no results for the chain business inside the

requested location, results outside the area may be
Outside the demoted less severely depending on how close they are
requested to the named location and how many branches of the
location chain exist in the real world. Ratings may range from
Excellent to Bad.
None
This is because when there are no locations of a chain
business inside the requested area, results that are
Sa outside it can still be relevant. However, it's also �from z
IP� turda e
possible for results to be so far away from the�2location
, 024 art�n
17
2.1 y,�Fe that they have no relevance at all. 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

217
 Location of Results insiderothe m
� f ez Rating and Explanation
results requested0location2 4 n
7 , �2 art�
1 �M
a ry� scar If there are few resultsSafor the chain business inside the
t
u
Febr 9�by�O ue I P�1 urdaoutside the area may be
requested location, results
, � . iq 72 y,�F
u r day 6.254 anr demoted less severely depending
.16 eb on how close they are
.25 rua
t M
Sa 172.1 to the named location and how 4.9manyr branches of the
�by y�17,
� M
chain exist in the real world. Ratings
IP an �Osmay�2range from
Good to Bad. riq car 024�
Few ue �M ro f
art m
�ne
This is because when there are fewer locationszof a
chain business inside the requested area, results that
are outside it can still be relevant. However, it’s also
possible for results to be so far away from the location
that they have no relevance at all.
When there are many results for the chain business
inside the requested location, results outside the area
Many are demoted to Bad. This is because there are multiple
results that would satisfy user intent inside the
requested area, so there’s no need to look outside it.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

218
 m
� fro ez
Query 2 4 n User and Viewport
7 , �20 art�
1 �M
[Starbucks san francisco] a ry� scar User and fresh viewportSa in San Francisco, CA
t
u
F e b r
�b y � O
e I P�1 urda
User Intent: The � 4is
y,user .9 seeking u a Starbucks in a specific location.72The y,fresh
�Fe viewport and user
da 2 5 n riq . 1
location can
r 6 . a 6 . 25 brua there are so many
Sabe
t ignored
u
2 . 1 Msince the user has an area in mind for results. Because 4.9 ry�
Starbucks within� 17 the named area, results outside it are rated Bad. M �b 17
I P an y�Os ,�202
riq car
Is there a Navigational Result for this Query? No ue �M 4�fro
art m
�ne
z

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

219
 Results m Ratings and Explanation
4 � fro ez
2 n
① Starbucks 7 , �20 art� Relevance Excellent
y �1 ar�M S
2165 Polk St, San Francisco, ar sCA c a
bru �by�O e Name Accuracy IP� turCorrect
94102 e
,�F 4.9 riqu 17 day,�
a y 2.1 Fe
d 6.25 an
rCoffee Address Accuracy Correct
6.2 bru
Classification:
t u 1 M 54
Sa 172.
� .9� ary�1
IP Pin Accuracy Ma by�O 7,�2
Perfect
nri sc 024
qu ar�M �fr
e art om
This result is one of many Starbucks in the specified�ne
z
location, San Francisco, and is rated Excellent. All results
within San Francisco are eligible for the highest possible
initial rating of Excellent.

All the data for the result is correct.

Relevance Excellent
② STARBUCKS
1231 Market St, San Francisco, CA Name Accuracy Correct
94103 Address Accuracy Correct
Classification: Coffee
Pin Accuracy Perfect
This result is one of many Starbucks in the specified
location, San Francisco, and is rated Excellent. All results
within San Francisco are eligible for the highest possible
initial rating of Excellent.

The STARBUCKS name is written in capital letters. Because

this is how the business refers to itself on storefront signs,
it is Correct. The address is Correct and the Perfect pin
lands on the correct rooftop.

③ Starbucks Relevance Bad (Distance/Prominence)

1555 40th St. Emeryville, CA 94608
Classification: Coffee Name Accuracy Correct
Address Accuracy Correct
Pin Accuracy Approximate
This Starbucks is outside of the boundaries of the specified
location and should be rated Bad since there are so many m
Sa �fro ez
IP� turda Starbucks to choose from in San Francisco. 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru a ry� scar
54
.9� ary�1 The name and address are Correct. Using ebr 9the
u �Obest
� F �by que
Ma by�O 7,�2 available evidence — in this case, street
ay .25imagery
, 4 nri — the
.
nri sc 024
qu ar�M �fr urd rooftop
location of the Starbucks underatthe 1 6 Mcana be found.
e art om S 172.
�ne Since the pin falls on the correct
IP� rooftop, but not in the
z correct location, it is rated Approximate.

220
 Results m Ratings and Explanation
4 � fro ez
2 n
④ Starbucks , �20 art�
7
1 ar�M Relevance Sa Bad (Distance/Prominence)
601 Westlake Center, Daly a ry�City,
s c CA
e
u
br �by�O e IP� turda
94015 F
y,� 54.9 nriq u Name Accuracy 17 Correct
2.1 y,�Fe
da 2 6.2 bru
turCoffee
Classification: 6. Ma
Sa 172.1 Address Accuracy
54
Correct .9� ary�1
IP � Ma by�O 7,�2
n s 0
Pin Accuracy Perfectriqu car�M 24�fr
e art om
�ne
z
This Starbucks is outside of the boundaries of the specified
location and should be rated Bad since there are so many
Starbucks to choose from in San Francisco.

All the data for the result is correct.

⑤ Starbucks Relevance Bad (Distance/Prominence)

12 Manor Plaza, Pacifica, CA 94044
Classification: Coffee Name Accuracy Correct
Address Accuracy Correct
Pin Accuracy Approximate

This Starbucks is outside of the boundaries of the specified

location and should be rated Bad since there are so many
Starbucks to choose from in San Francisco.

The pin drops within the Half n' Half rule boundaries of the
shared parking lot.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

221
 Query m User and Viewport
4 � fro ez
2 n
[Aldi waco tx] 7 , �20 art� User and fresh viewport in Houston, TX
y �1 ar�M Sa
ar Osc t
User Intent: The user e b r uasked
y � for a specific chain business in a specific
I P�1 urda location. The fresh viewport
F �b u e y,�F
can be ignored since a y,� 5the 4.9 user riq has a specific area in mind for results. 72 Because
. 1 ebr there are very few
r d . 2 an 6
stores withinat [Link]
u 6 M area, results outside it are gradually demoted. . 25
4.9 uary�
S 17 1
IP � M �by 17
Is there a Navigational Result for this Query? Yes anr �Osc ,�202
iqu ar� 4�f
e Ma rom
rt�n
ez

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

222
 Results m Ratings and Explanation
4 � fro ez
2 n
7 , �20 art� Relevance Navigational
y �1 ar�M S
ar sc a
bru �by�O e Name Accuracy IP� turCorrect
e
,�F 4.9 riqu 17 day,�
a y 2.1 Fe
t u rd 16.25 Man Address Accuracy Correct
6.2 bru
54
① ALDI IP�1S a 72. .9� ary�1
Pin Accuracy Ma by�O 7,�2
Approximate
1220 N Valley Mills Dr, Waco, TX nri sc 024
qu ar�M �fr
76710 e art om
�ne
Classification: Grocery z

ALDI is a well-known chain business. Research confirms

that the location modifier in the query narrows possible
results to a single unique location. This is the only location
eligible for a Navigational rating.

The pin drops within the shared parking lot.

② ALDI Relevance Good (Distance/Prominence)

3310 S 31st St, Temple, TX 76502
Classification: Grocery Name Accuracy Correct
Address Accuracy Correct
Pin Accuracy Perfect
Although this result is not in Waco, research shows that,
unlike the many Starbucks in San Francisco, there are very
few Aldi stores in the Waco area. That is why this nearby
result should be demoted -2 for distance from the highest
possible initial rating of Navigational and rated Good.

The pin drops on the edge of the appropriate rooftop and

can be rated Perfect.
m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

223
 Results m Ratings and Explanation
4 � fro ez
2 n
, �20 art� Acceptable (Distance/
� 7
1 ar�M Relevance
③ ALDI
y
ar sc S a Prominence)
e bru �by�O e IP� turda
17 Correct
3623 W State Highway
da y,�F 54.931,nrCorsicana,
iqu Name Accuracy 2.1 y,�Fe
2
6. Ma 6.2 bru
TX tur
Sa 172.1 Address Accuracy
54
.9� ar–y�Postal
Incorrect Code
Classification:
IP Grocery
� Ma by�O 17,�2
n s 0
Pin Accuracy Perfectriqu car�M 24�fr
e art om
Although this result is not in Waco, research shows �ne that,
z
unlike the many Starbucks in the San Francisco example
above, there are very few Aldi stores in the Waco area. This
result has been demoted -3 from the highest possible
initial rating of Navigational to Acceptable because it is
significantly farther from the area of expected results.

The postal code, which is a mandatory address

component, is missing from the result address.

#Y"J"N"G"%7()*>[*%5A*9@AB%/A,>[)E

Location modifiers in the form of streets or full addresses are referred to as specific location
modifiers.

A specific location modifier might also be the name of a POI, as seen here: [university of kentucky
starbucks] in a query about the location of the coffee chain at a particular university.

When the a query includes a specific location modifier, results that satisfy the location intent should
not be demoted for distance:

Number of results
Location of
inside the requested Rating and Explanation
results
location

Consider the location modifier a general one and

None demote results based on distance to the specified
location.

If there is a only a single result present in the specified m

Sa �fro ez
IP� turda location it should receive a rating of Navigational. 2 4
�20 art�
n
17 ,
2.1 y,�Fe One 1 7 �M
Inside the6.2 bru ary� scar
5 a It is promoted because it is the only result ebr 9�bythat
u �O esatisfies
requestedM4.9�b ry�17 the user intent , � F . u
y ,
location anri �Osca �2024 r d ay .254 anriq
tu 6 M
qu
e r�Ma �from Sa 172.1
rt�n IP �
ez

224
 Number of results m
Location of � fro ez
inside the requested 2 4 n Rating and Explanation
results
location
7 , �20 art�
1 �M
a ry� scar Sa
t
u
e b r
�b y � O
e I P�1 urda
a
F
y,� 54.9 nriq u When there are multiple72results
.
y,�F in the location, they
d 2 16 eb
tur 6. Ma should all receive a rating of.2Excellent.
54 ruar
Sa 172.1 More than one .9 y
IP� Ma �by�O �17,�2
Ignore user and viewport location. nri The
qu causer
s 02 has already
r�M 4�fro
told you exactly where they are looking foraresults.
e
rt�n m
ez

Query Results Ratings and Explanation

Is there a Navigational Result for this Query? Yes

Kate Spade New York Relevance Navigational

[kate spade 789 Madison Ave, New York, NY Name Accuracy Correct
789 Madison 10065
Ave, New York] Classification: Accessories Address Accuracy Correct

User and large, Pin Accuracy Perfect

fresh viewport in
This chain business query includes a specific
New York, NY
location modifier in the form of a full address.
Research confirms that this is the address of
queried business, so this result is eligible for
a Navigational rating.

All the data for the result is correct and the

pin is Perfect.

Kate Spade New York Relevance Bad (User Intent)

205 Columbus Ave, New York, Name Accuracy Correct
NY 10023
Classification: Accessories Address Accuracy Correct
Pin Accuracy Perfect

This is a very specific query and the result

Sa does not satisfy the specific location �from z
IP� turda modifier and would not be useful to 24 rt�ne
17 , �20theauser
2.1 y,�Fe searching only for the locationryat 7
�1 the �M
6.2 bru u a s car
54
.9� ary�1 specified address. This result ebr 9�bisy�rated
O
e Bad.
Ma by�O 7,�2 , � F . q u
y 4 nri
nri sc 024
All the data for the urda 16.2is5 correct.
result Ma
qu ar�M �fr t
Sa 172.
e art om
�ne IP�
z

225
 m
� fro ez
Query 2 4 n User and Viewport
7 , �20 art�
�1 �M User and fresh Viewport
Sa in Austin, TX
[tacodeli burnet rd] uary scar t
F e b r
�b y � O
e I P�1 urda
User Intent: Since y,� there4.9 are u
riq two Tacodelis located on the named street, 72 y,�Fboth are primary intent.
da
r 16. Ma 2 5 n .16 eb
Any other location
t u is rated Bad. .25 rua
Sa 172. 4.9 ry�
�by 17,
I P � M
Is there a Navigational Result for this Query? No anri �Osca �2024
qu
e r�Ma �from
rt�n
ez

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

226
 Results m Ratings and Explanation
4 � fro ez
2 n
, �20 art� Relevance Excellent
① Tacodeli a
1 7
ry� scar
�M Sa
12001 Burnet Rd, Austin, u
ebr 9�bTXy�O78757 Name Accuracy IP� turCorrect
, � F . i q ue 17 day,�
Classification: rMexican
a y 4 r 2.1 Fe
d 6.25 an Address Accuracy Correct
6.2 bru
tu M
Sa 172.1 54
.9� ary�1
IP � Pin Accuracy Ma by�O 7,�2
Approximate
nri sc 024
qu ar�M �fr
At first glance, this chain business query
e with
art aomspecific
location modifier may suggest the user is looking �ne for a
z
unique location. However, research indicates that there
are two branches of this restaurant on the same road.
Both are therefore eligible for a rating of Excellent.

The pin drops off the edge of the appropriate rooftop

and should be rated Approximate.
Relevance Excellent
② Tacodeli
7301 Burnet Rd, Austin, TX 78758 Name Accuracy Correct
Classification: Mexican
Address Accuracy Correct
Pin Accuracy Perfect
At first glance, this chain business query with a specific
location modifier may suggest the user is looking for a
unique location. However, research indicates that there
are two branches of this restaurant on the same road.
Both are eligible for a rating of Excellent.

All the data for the result is correct.

Relevance Bad (User Intent Issue)
Name Accuracy Correct
③ Tacodeli
4200 N. Lamar Blvd, Austin, TX 78756 Address Accuracy Correct
Classification: Mexican Pin Accuracy Perfect

This result does not satisfy the specific location

modifier and would not be useful to the user searching
only for locations along Burnet Road and is therefore m
Sa rated Bad. �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 7
1 ar�M
6.2 bru However, if there are no results presentuon a ry�thisc road,
54 r y�Os
.9� ary�1 consider the location modifier as a�Fgenerale b onee and
Ma by�O 7,�2 y, to 5the
4 .9�b riqu
nri sc 024 demote results based on distance d a
6.2 Ma road
n
qu ar�M �fr tur
e art om Sa 172.1
�ne IP�
All the data for the result is correct.
z

227
 m
4 � fro ez
2 n
7 , �20 art�
When a query is for a POI �1 aanamed �M
a ryon s c r street, results for this POI that
Sa are on the named street but
t
u
have an official address Fe b r on
�b � O
y another e I P�1 urda
street can also be rated Excellent.
y,� 54.9 nriq u 72 y,�F
da
r 16. Ma2 .16 eb
t u .25 rua
Sa 172. 4.9 ry�
�b 17
� M
I P an y�Os ,�202
10.6.4. Back Offices and Businesses with no Physical Location riq car
ue �M 4�fro
art m
�ne
These type of results are most often rated Bad because they are either not useful to the user z or have
no maps intent at all.

Business Type Example Rating and Explanation

Businesses with no physical location, like mobile
Mobile
No Physical location locksmiths or mobile dog groomers, have no relevance for
locksmith
maps and are rated Bad.
Back offices are usually not open to the public. Rate them
Administrative
with a lower prominence. In most cases the relevance
Back Office offices of a
rating will be Bad unless these offices match the specific
company
user intent.
Unless your Country Specific guidelines state otherwise,
give businesses running out of a home very low
prominence.

These businesses see customers by appointment only

and have no regular opening hours or brick and mortar
Home based
Home Business businesses (like a store with regular hours where
calligrapher
customers can drop by and choose from a large selection
of merchandise).

The most likely relevance rating is Bad, unless there is a

likely user intent or the suggestion is similar to a bed and
breakfast or other business that a user may want to visit.

For these types of results, rate the address accuracy according to the official website or consensus
of three sources, otherwise rate Can’t Verify. If the entire address is missing, rate Can’t Verify. Ifman
address
Sa
t is present, rate the pin according to the address in the result. If no address is present,4�rate fro ez
u 2 n
IP�pinrCan’t
the 17 day,� Verify. 7 , �20 art�
2.1 Fe 1 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
b ,
Ma y�O ,�2 7
nri sc 024 r d ay .254. anriq
qu ar�M �fr tu 6 M
e art om Sa 172.1
IP �
�ne
z

228
 Query Results m Ratings and Explanation
4 � fro ez
2 n
, �20 art�
Is there a 7Navigational Result for this Query? No
y �1 ar�M S
ar sc a
e bru �by�O e Relevance IP� turda Bad (User Intent)
17
a y,�F 54.9 nriqu 2.1 y,�Fe
tur
d 2
6. Ma Name Accuracy6.2 Correct b
Sa 172.1Wendy's Flower Affair 54 ruar
.9� y�1
IP� 1175 E 930 N, Provo, UT 84604 Address AccuracyMaCorrect by 7,
nri �Osc �2024
Classification: Wedding Planning Pin Accuracy qu a
Perfect e r�Ma �from
[flower shop] rt�n
ez
Research shows that this is a business run
User and fresh out of a residential home, not a showroom full
viewport in of flowers. The relevance rating for this
Provo, UT location is Bad. We have been able to confirm
the address and pin for this business and they
will be rated Correct.

This business will not be rated Business/POI

is closed/does not exist because we want
to reserve that option for businesses and
POIs that truly do not exist.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

229
10.6.5. Business/POI does not Existm
2 4 �fro ez
There are situations where a result , a rt�n
�20 returned is for a business that does not exist. You must still rate
1 7 M
relevance as if the business ry were
� ar open.
� Sa
ua �Osc t
Fe b r
�b y e I P�1 urda
y,� .9 iq u 72 y,�F
Query urda 6.254 anr Results .16 and
Ratings .25 ebruExplanation
t 1 M 4.9 ary�
Sa 172. �by 17,
IP � Is there a Navigational Result for this Query? MaNo
nri �Osc �2024
qu ar�M �fr
Ocean Blue Sushi Club
1010 E El Camino Real,
Business/POI is closed/does
not exist
e art om
�ne
z
!
Sunnyvale, CA 94087
Relevance Excellent
Classification: Sushi
[sushi]
Research shows that this business is closed.
User and fresh
The checkbox for Business/POI is closed/
viewport in
Sunnyvale, CA
does not exist should be selected. Name,
address and pin accuracy questions will not
appear. The relevance rating for this location
is Excellent because if this business were
open, it would be a very good result for the
query.

Is there a Navigational Result for this Query? No

North Shore Hotel
99300 Sea View Drive, Hwy 11
Business/POI is closed/does
not exist
!
North Shore, CA
Relevance Excellent
[hotel] Classification: Hotel

Fresh viewport
over North
Shore, CA The North Shore hotel no longer exists at this
address, but its relevance is judged as if it
were still in business.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

230
10.7. Category Queries m
4 � fro ez
2 rt�n
Category queries are the broadest 7 , �20 querya type because they can return the greatest variety of results.
Give prominence more weight y �1 thana r �M distance when rating them. S
ar sc a
e bru �by�O e IP� turda
17
The highest relevance
a y,�F 5rating u
4.9 nriqmost category query results will [Link]
1
y,�F
Excellent.
tur
d 2
6. Ma 6 .25 ebrua
Sa 172.1 4.9 ry�
�b 1
Category queries � with a location modifier are the only category queries eligible
I P M an y�for
Os a7,�Navigational
2
rating (see Navigational Results for Category Queries). riq car 024�
ue �M fro
art m
�ne
You’ll need to determine the user’s intent based on the query: z

• Primary Intent refers to the businesses or POI the user is expecting to see for the given
category.
• Secondary Intent refers to businesses that fit the category intent but would not be the
user's first choice. Secondary intent results will receive a demotion of -1 or an initial rating of
Good.
• Unlikely Intent refers to results that technically match the query terms or category intent,
but woud not be an obvious, or even secondary, intent for most users. They receive a
demotion of -2 or an initial rating of Acceptable.

Significant Increase in Distance

Given how many results are often within close proximity to the location intent, results for category
queries are not demoted for distance simply because there is something closer (in the result set or in
real life). Instead, use significant increases in distance to group possible results for the appropriate
demotions.

It is important to understand the real-world distribution of all

possible results when assessing a significant increase in
distance.

The image on the left shows possible results around the user
as purple dots. In this example, demotion for distance starts
approximately 500m away from the user (around 3 to 6 blocks
away) due to the high number of possible results. This distance
will vary depending on how many or few results are available in
a given area.
m
Sa �fro ez
IP� turda Please note that no results inside the fresh Viewport should 2 4 nbe
17 , �20 art�
2.1 y,�Fe demoted to Bad for distance alone. 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

231
 m
[Link] for Distance with 4 � froUser
ez Inside Viewport
, �2 02 art�n
17 �M
a ry� scar Sa
t r
u �O
Query b r y I P�1 uand
User d
72 ay,Viewport
Fe �b u e
,� 4.9 riq
r a y
d 6.25 an . 16 �Febr
[pizza] u .25
User and fresh viewport in Campbell,
t
Sa 172.1
M 4.9 uary� CA
IP � Ma �by�O 17,�2
User Intent: The user is looking for a pizza place. nri sc 024
qu ar�M �fr
e art om
Is there a Navigational Result for this Query? No �ne
z

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

232
 Results m Ratings and Explanation
4 � fro ez
2 n
7 , �20 art� Relevance Excellent
�1 r�M
① Domino’s Pizza bruaryy�Osca Sa
At about 1 km away,IPthisturpizza place is among the
930 W Hamilton Ave
e 9�b ue
,�F Campbell, �17 day,
y . iq CA closest results to the user,
2.1 Fe is in an area with many
who
�
r d 6.254 anr
a 6 bru
Classification:
t Pizza M
u pizza options. Other results.2in 54the same general range
Sa 172.1 .9� ary�1
IP� would also receive this rating. b
Ma y�O 7,�2
nri sc 024
a
qu Distance)
Relevance Good (Significant e r�Ma �from
② Luigi's Pizza and Pasta rt�n
ez
2495 S Winchester Blvd, Campbell Luigi’s is significantly further away from the user is and
is demoted for distance, as are all other results in this
Classification: Pizza
general range.

Relevance Acceptable (Significant Distance)

③ Pizza My Dear
2590 S Bascom Ave, San Jose, CA Pizza My Dear is over 4km away from the user, which is
significantly further than many other results. It is
Classification: Pizza
demoted -2 for distance.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

233
 m
10.7.2. Demotion for Distance with 4 � fro User
ez Outside Viewport
, �2 02 art�n
17 �M
a ry� scar Sa
t r
u �O
Query b r y I P�1 uand
User d
72 ay,Viewport
Fe �b u e
,� 4.9 riq
r a y
d 6.25 an . 16 �Febr
u .25
Fresh viewport in New Braunfels,
t
Sa 172.1
[guns]
M 4.9 uTX,
ary with user north of
IP � San Antonio Ma y�O �17,�2
� b
nri sc 024
qu ar�M �fr
User Intent: The user is looking for guns. e art om
�ne
Is there a Navigational Result for this Query? No z

Results Ratings and Explanation

① EDC TX Relevance Excellent

m
Sa N Walnut Ave, New Braunfels, Tx
964 This result is inside the very specific viewport and �fro ez
IP� turda 2 4
0 rt�n
Classification:
17
2.1 y,�Fe Gun Store carries weapons and other accessories. �17,�2 �Ma
r
6.2 bru
54 r u ary Osca
.9� ary�1 Relevance ExcellentFeb �by � e
M by�O 7,�2 y,� 54.9 nriqu
② Freddy’sanPawnriq sca&r Jewelry
02 r d a .2 Ma
u � 4�f atu 72.16
671 S Seguin Ave, New aBraunfels,
e M ro
rt�n m TX S
The pawn shop is very closePto 1 the fresh Viewport and
I �
Classification: Pawn Store z e sells guns and related items.

234
 Results m Ratings and Explanation
4 � fro ez
2 n
7 , �20 art� Relevance Good (Significant Distance)
③ Guntrap a
1
ry� scar
�M Sa
t
850 Schneider, Cibolo,
u
ebr 9TX �O This weapons storeIsatisfies
P�1 urda the user intent but is
� F �by que y
, . i significantly further away
72 from
.16 ,�Fethe fresh viewport in a
day 6Store
Classification:urGun . 254 anr b r
t M more rural area, with fewer such
. 25 stores
4.9 uary� close by.
Sa 172.1
IP � M �by�O 17,�2
Relevance Goodan(Significant
riq scar 02Distance)
④ River City Pawn & Jewelry ue �M 4�fro
m
artequipment
417 Main St, Scherz, TX The pawn shop sells guns and other related �ne
but is also significantly further away from the fresh z
Classification: Pawn Store
viewport.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

235
10.7.3. Demotion for Distance withmFewer Possible Results
2 4 �fro ez
n
7 , �20 art�
1 �M
Query a ry� scar UserSa and Viewport
t
u
Fe b r
�b y � O
e I P�1 urda
y,� 54.9 nriq u y,�F
72in Kennesaw,
[bicycledapath] 2 User and fresh viewport . 16 ebr GA
t u r 16. Ma . 2 u
Sa The . 5 4.9 ry�a
User Intent: � 172 user is looking for places to ride a bike. These could M include
�b 17 trails, parks,
I P
and other paths that are frequented by bicyclists. an y�Os ,�202
riq car
ue �M 4�fro
art m
Is there a Navigational Result for this Query? No �ne
z

Results Ratings and Explanation

Relevance Excellent
① Deerfield Park Deerfield Park is among the closest results to the user.
2401 Deerfield Dr, Kennesaw, GA There are other results that are within an acceptable m
Sa
Classification: Park range given the number of other possible results 4that �fro ez
IP� turda are within 13km.
2
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
54
.9� ary�1 Relevance Good (Significant ebr 9�by�Distance)
u O
F e
② AllatoonaMa bCreek
y 7, y 54 nriqu
, � .
nri �Osc �2024 These mountain bike trails are a
turabout 6.225kmMa away from
d
qu ar�M GA
Pitner Rd NW, Acworth, �f 30101 2.1
Sa 17distant
e art rom the user and significantly more � than the closest
I P
Classification: MTB Trails �nez group of results. The result, and others in the same
general range, is demoted by -1 for distance.

236
 Results m Ratings and Explanation
4 � fro ez
2 n
, �20 art� Acceptable (Significant
1 7 �M Relevance
a ry� scar Sa Distance)
③ Iron Hill Trail Head u
ebr 9�by�O ue IP� turda
� F 17
Iron Hill Trail Head is about y,�F away. It is still within
Cartersville, GA
,
y 54. nriq 2.1 30km
da30121 2 6.2 ebru
t 2.16. Ma
u r the Good group in terms of distance
54 to the location
S a
Classification:�1Hiking
7 Area .9� ary�1
IP intent given the smaller number Ma y�O 7,�2 results in
of
b possible
the area, and gets a demotion of nri-2 for 02
qu cardistance.
s
e �M 4�fro
art m
�ne
z

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

237
10.7.4. Category Queries and User m Intent
� f ro
ez
, �2 024 art�n
�17 r�M
Query uary sca Suggestion Sa Ratings & Explanation
e br �by�O e IP� turda
da y,�F 54.9 nriqu
r 16.2 Ma
① The Art Institute 17
Relevance2.1 y,�Fe
6.2 bru Excellent
t u
[art] of Chicago 54 ar
Sa 172.
� 111 S Michigan Ave, This result isMan.9internationally
�by y�17, famous
IP a �Os �20
User in Chicago, IL Chicago art museum in Chicago
n riq carvery 2 close to the
(Viewport is stale) user's location.
ue �M 4�fro
Classification: Museum art m
�ne
z
Good
(User Intent &
② Arts & Artisans Relevance
Distance/
321 N Michigan Ave Prominence)
#1, Chicago
Classification: Art This art gallery should be demoted due
Gallery to distance to user as there are many
other possible art-related matches in
the user’s area.
③ The Art of Pizza Relevance Bad (User Intent)
727 S State St,
Chicago
Classification: Pizza

Even though it has the word “art” in its

name, this pizzeria does not meet the
user’s intent and should be rated Bad.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

238
 m
10.7.5. Category Queries and Prominence 4 � fro ez
2 n
7 , �20 art�
1 �M
a ry� scar Sa
u
ebr 9�by�O ue IP� turda
F 17
, � . iq 2.1 y,�Fe
Query
u r day 6.254 anr Suggestion Ratings
6.2 br& Explanation
t
Sa 172.1
M 54 uar
.9 y1
IP� ① Solomon R. Relevance Ma �by�O �Excellent
7,
nri sc �2024
[museum] Guggenheim qu a r�M �fro
Museum This result is a highlye prominent
art m
�ne primary
museum likely to fulfill the user’s
No user location (viewport is fresh) 1071 5th Ave z
New York intent.
Classification: Museum

Relevance Excellent
② 9/11 Memorial &
Museum This is another highly prominent result
180 Greenwich St likely to meet the user’s the primary
New York intent.
Classification: Museum

③ Houdini Museum Good/Acceptable

421 7th Ave Relevance (Distance/
New York Prominence)
Classification: Museum
This result is a small museum that’s
much less prominent than other
museums in this location, like the
Guggenheim.
④ Museum of the Bad (Distance/
Moving Image Relevance
Prominence)
36-1 35th Ave
Astoria
This result is also much less prominent
Type: BUSINESS than other possible results in the area. It
Classification: Museum is located outside of the viewport while
there are multiple other options available
inside of the viewport.

10.7.6. Category Query with Location Modifier

If the query contains a location modifier, all results within the specified location should receive the m
Sa
highestt u possible initial rating of Excellent. Results outside the expected location should be �fro ez
demoted
2 4
IP� rda � 20 art�n
based17 on ytheir
2.1 ,�Fe distance from the location modifier and the number of possible real-world 7 results
,
�1 ar�M
.25 band
within it.6User rua viewport location should be disregarded. Further demotions canrube aryapplied
sc based
4.9 ry� e b �by�O e
on how well Mathe�byresult
17 fits the intent of the category. � F 9 u
,
nri �Osc �2024 r d ay, .254. anriq
qu ar�M �fr atu 72.16 M
Note that location e modifiers
art ofor
m category queries can take many forms, Sfrom � 1 the names of cities,
neighborhoods, and streets IP
�neto the names of POIs, like [Aeropuerto barcelona gasolinera], a query
z
about gas stations at or near Barcelona’s airport.

239
 Query m User and Viewport
4 � fro ez
2 n
[Food montgomery tx] 7 , �20 art� User and viewport outside Montgomery, TX
y �1 ar�M Sa
ar Osc t
User Intent: Any food e b r uprovider
y � or restaurant within the named Ilocality
P�1 urda is considered primary
F �b u e y,�Fresults outside it are
intent. Given thealarge
y,� 54number
.9 riq of possible results within the explicit72area, . 1
d
rated Bad. atur 2.16. Ma
2 n 6 .25 ebrua
S 17 4.9 ry�
P � M �by 17
I
Is there a Navigational Result for this Query? No anr �Osc ,�202
iqu ar� 4�f
e Ma rom
rt�n
ez

Results Ratings and Explanation

Relevance Excellent
① Pizza Shack
20821 Eva St, Montgomery, TX Name Accuracy Correct
Classification: Pizza
Address Accuracy Incorrect – Postal Code
Pin Accuracy Approximate m
Sa �fro ez
IP� turda All results that satisfy the ‘Food’ intent located
2 4
�20in art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru Montgomery are eligible for an initial rating ary� ofscar
u
54
.9� ary�1 Excellent.
� F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d
qu ar�M �fr tu 2.16
The postal code, which is aSamandatory Maddress
e art om � 1 7
�ne component, is missing fromI the result address.
P
z The pin drops into the shared parking lot.

240
 Results m Ratings and Explanation
4 � fro ez
2 n
② Taco Bell 7 , �20 art� Relevance Bad (Distance/Prominence)
�1 ar�M
ryTX Sa
3207 W Davis St, Conroe, u a sc77304 Name Accuracy IP tuCorrect
e br �by�O e �17 rday,
Classification: Fast
a y,�FFood
5 4.9 nriqu 2.1 �Fe
tur
d 2
6. Ma Address Accuracy Correct
6.2 bru
Sa 172.1 54
.9� ary�1
IP� Pin Accuracy Ma by�O 7,�2
Perfect
nri sc 024
qu ar�M �fr
e art om
�ne
Given the large number of places to get food in z
Montgomery, results outside of it are rated Bad.

All the data for the result is correct.

10.7.7. Navigational Results for Category Queries

Sometimes it’s not clear whether a query is for a category or a specific business/POI. What first
appears to be a category query with a location modifier may lead to a single prominent result which
can be rated Navigational.

Due to the ambiguity of these queries, even if there is a Navigational result, the query should still be
treated as a potential category query and other results considered relevant.

When deciding if a category query could have a Navigational result, consider:

• The actual wording of the query

• Possible results in the real world
• Local knowledge
• Prominence

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

241
 Query Results m Ratings and Explanation
4 � fro ez
2 n
, �20 art�
Is there a 7Navigational Result for this Query? Yes
y �1 ar�M S
ar sc a
e bru �by�O e RelevanceIP turd Navigational
, � F . 9 q u �17 ay,
y 54 nr i 2 � F
u rda 1Hotel
6 .2 MKilkenny
a Name Accuracy.16.2 eCorrect
br
t
Sa [Link] Road, Kilkenny R95 5 4.9 uary�
�by 17,
IP� KP08 Address AccuracyMaCorrect
nri �Osc �2024
Ireland qu ar�M �fr
Pin Accuracy Perfect
e art om
Classification: Hotel �ne
z
This result is an exact match to the query. The
wording of the query leads to a single result,
so it’s likely the user intent is this specific
hotel.

The address is correct without a street

number because it matches what's found on
the official website. The pin landing in the
hotel's roof is Perfect.
[hotel
kilkenny]
Relevance Excellent
Name Accuracy Correct
Newpark Hotel
Castlecomer Road, Kilkenny R95 Address Accuracy Correct
KP63, Ireland Pin Accuracy Perfect
Classification: Hotel
Although the wording of the query suggests a
single result, there is still a possibility that the
intent is for any hotel in Kilkenny. Since this
could be a category query with a location
modifier, all hotels in this locality should be
rated as Excellent.

The address is correct without a street

number because it matches the address
shown on the official website. The pin is
Perfect because it lands on the hotel’s
rooftop.
m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

242
 Query Results m Ratings and Explanation
4 � fro ez
2 n
, �20 art�
Is there a 7Navigational Result for this Query? No
y �1 ar�M S
ar sc a
e bru �by�O e RelevanceIP turd Excellent
, � F . 9 q u �17 ay,
y 54 nr i 2 � F
u rda 1Hotel
6 .2 MKilkenny
a Name Accuracy.16.2 eCorrect
br
t
Sa [Link] Road, Kilkenny R95 5 4.9 uary�
�by 17,
IP� KP08
Address AccuracyMaCorrect
nri �Osc �2024
qu ar�M �fr
Ireland Pin Accuracy Perfect
e art om
�ne
Classification: Hotel z
There is no result that matches the exact
wording of the query, so this is more likely to
be a category query with a location modifier.
Any hotel result returned in the locality of
Kilkenny would be rated Excellent.

The address is correct without a street

number because it matches what appears on
the official website. The pin landing the hotel's
roof is Perfect.

Relevance Excellent
Name Accuracy Correct
[Kilkenny
hotel] Address Accuracy Correct
Pin Accuracy Perfect

Newpark Hotel
Castlecomer Road, Kilkenny R95
KP63, Ireland
Classification: Hotel

Any hotel result returned in the locality of

Kilkenny would be rated Excellent,
completely satisfying the ‘Category with
Location Modifier’ query

The address is correct without a street

number because it matches the address m
Sa o
IP� turda shown on the official website. The pin 2is4�fr �nez
17 Perfect because it lands on the hotel’s ,�20 Mart
2.1 y,�Fe 1 7 �
6.2 bru rooftop. ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

243
 Query Results m Ratings and Explanation
4 � fro ez
2 n
Is there a 7Navigational
, �20 art� Result for this Query? No
y �1 ar�M S
ar sc a
e bru �by�O e RelevanceIP turd Excellent
, � F . 9 q u �17 ay,
y 4 r i 2 � F
u rda 16.25 Man Name Accuracy.16.2 eCorrect
br
t
Sa 172. 5 4.9 uary�
�by 17,
IP� Address AccuracyMaCorrect
nri �Osc �2024
Berlin Tegel Airport qu ar�M �fr
Pin Accuracy Perfect
e art om
13405 Berlin, Germany �ne
z
Classification: Airport
There are two equally prominent airports in
Berlin. Since there is more than one possible
result for this query in the real world, it is likely
to be a category query with a location
modifier. All airports within the queried locality
should be rated as Excellent.

The address is correct without a street

number and street name because this is a POI
without an expected address so a locality and
postal code are appropriate. The pin is
Perfect because it lands on the airport’s
rooftop.

[airport
berlin] Relevance Excellent
Name Accuracy Correct
Address Accuracy Correct
Pin Accuracy Perfect
Berlin Schönefeld Airport
12521 Berlin, Germany
Classification: Airport
There are two equally prominent airports in
Berlin. Since there is more than one possible
result for this query in the real world, it is likely
to be a category query with a location
modifier. All airports within the queried locality
should be rated as Excellent.
m
Sa
The address is correct without a street �fro ez
IP� turda 2 4 �n
�20 is aartPOI
17
2.1 y,�Fe number and street name because this
7 ,
�1 ar�M
6.2 bru
54 without an expected addressruso aryaOlocality
sc and
.9� ary�1 postal code are appropriate. F e b �by� e
The pin is
Ma by�O 7,�2 y,� 54.9 nriqu
nri sc 024 rda 16on
Perfect because ittulands .2 the
Ma airport’s
qu ar�M �fr a 72.
e art om rooftop. S 1
�ne IP�
z

244
10.7.8. Clear Categories m
4 � fro ez
When a query is clearly for a straightforward 2 n category, results must also belong to that category
7 , �20 art�
�1 �M
ry ar Sa
ua �Osc t
Query Fe b r
�b y Resultse I P�1 urda and Explanation
Ratings
y,� 54.9 nriq u 72 y,�F
da
r 16. Ma2 .16 eb
u Is there a Navigational Result for this Query? .25 Nor
t
Sa 172. 4.9 uary�
IP� Ma �by�O 17,�2
Relevance Bad
nri (User
s 0Intent)
qu car�M 24�fr
e o
Name Accuracy Correct art�n m
ez
Sephora
2855 Stevens Creek Blvd, Address Accuracy Correct
Santa Clara, CA 95050 Pin Accuracy Approximate
Classification: Beauty Supplies
[mall] The query intent is for a mall. The result is a
store inside Westfield Valley Fair mall and is
User and fresh within the viewport. Since the query is a
viewport in category and the result is a specific store,
Santa Clara, CA which the user did not ask for, rate Bad due to
user intent. If the result had been the entire
mall, the result would be rated Excellent.

The name and address can be confirmed on

the official website. The pin is Approximate
because it does not land on Sephora's location
(shown in green) according to the mall’s official
map.
Is there a Navigational Result for this Query? No
Relevance Bad (User Intent)
Name Accuracy Correct
Terminal 8 Address Accuracy Correct
JFK International Airport
Queens, NY 11430 Pin Accuracy Perfect
Classification: Airport
[airports]
The result is a terminal that's part of JFK
User and fresh
International Airport. Since the query is a
viewport in
category and the result is a specific terminal
New York, NY
and not the airport itself, rate Bad due to user m
Sa �fro ez
IP� turda intent. 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
The name and address can be uconfirmed on
54
.9� ary�1 ebr 9�by�O ue
Ma by�O 7,�2 the official website. Theaypin,�F [Link] because
nri sc 024 d . 25 anriq
qu ar�M �fr it lands on one of theturooftops
r
.16 of Terminal 8
M
e art om Sa 172airport
according to the official map.
IP �
�ne
z

245
10.7.9. Soft Categories m
4 � fro ez
Some category queries are straightforward 2 n and may have results that satisfy an intent exactly, like
7 , �20 art�
[italian restaurant]. However, 1 M
ry scasometimes categories are very smallSa or have multiple interpretations,
� r �
so several different types ua of�O results could satisfy the user’s intent. tur
Fe b r
�b y e I P�1Theseda are called “soft categories.”
a , �
y 54 nr . 9 i q u 72.1 y,�Fe
d 2 a 6.2 bru
These category tur 2.16. M
Sa 17queries will produce a variety of results, each of which could 54 satisfy
.9� ary�1 the query intent
to a greater orIP lesser degree. How well a result satisfies a category queryMwill
�
an vary
by� depending
O 7,�20 on the
services typically offered by the result entities in that market and the customs riqof sthe
car specific
24 market.
ue �M �fro
art m
�n
It’s often difficult to define which businesses or chains belong in any one soft category, so eyou’ll z have
to research the individual results provided to make your rating decisions. For instance, the query [ski
shop] is very specific and is associated with the more general Sporting Goods category.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

246
 Query m User and Viewport
4 � fro ez
2
0 rt� n
[ski shop] 7,�2 r�Ma User and fresh viewport in Denver, Co
y �1 a Sa
r sc
User Intent: The user uisa looking for places that sell ski clothing t
Fe b r
�b y � O
e I P�1 urequipment.
and da Any store that
carries such items �
y is consider 9 u y
, 4 . r primary intent.
i q 7 2.1 Fe , �
t u rda 16.25 Man 6.2 bru
a 72. 5 a
Is there a Navigational
S
� 1 Result for this Query? No 4.9�b ry�17
IP Ma y�O ,�2
nri sc 024
qu ar�M �fr
e art om
�ne
z

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

247
 Results m Ratings and Explanation
4 � fro ez
2 n
, �20 art� Relevance Excellent
① Meier Skis a
1 7
ry� scar
�M Sa
970 Yuma St, Suite 190 u
ebr 9�by�O ue Name Accuracy IP� turCorrect
, � F . iq 17 day,�
Denver, CO 80204 day 6.254 anr
2.1 Fe
u r
t 2.1Equipment M Address Accuracy Correct
6.2 bru
Classification:
Sa 1Ski 54
� 7 .9� ary�1
IP Pin Accuracy Ma by�O 7,�2
Perfect
nri sc 024
qu ar�M �fr
e art om
�ne
z

Business is a shop dedicated to skiing, which would

satisfy the primary intent of this category.

Relevance Good (User Intent)

② Patagonia
1431 15th St Name Accuracy Correct
Denver, CO 80202
Address Accuracy Correct
Classification: Sports Wear
Pin Accuracy Perfect

Stores that sell ski clothing would be considered

secondary intent for the category query [ski shop].

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

248
 Query Results m Ratings and Explanation
4 � fro ez
2 n
Is there a Navigational
7 , �20 art� Result for this Query? No
y �1 ar�M S
ar sc a
e bru �by�O e RelevanceIP turd Excellent
, � F . 9 q u �17 ay,
y 4 r i 2 � F
u rda 16.25 Man Name Accuracy.16.2 eCorrect
br
t
Sa 172. 5 4.9 uary�
Riva's Italian Restaurant Ma �by�O 17,�2
IP� Address Accuracy Correct
1117 Missouri St nri sc 024
qu ar�M �fr
Houston, TX 77006 e art om
Pin Accuracy Perfect �ne
Classification: Italian z

The most likely user intent for this query is

Italian restaurants. This result satisfies the
user’s intent.

Cafe Dolce Gelato Relevance Good (User Intent)

5135 W Alabama St, Ste 7315
Houston, Texas 77056 Correct
Classification: Ice Cream Name Accuracy

Address Accuracy Correct

[italian] Pin Accuracy Approximate

User and fresh

viewport in
Houston, TX
An Italian ice cream café is mostly likely a
secondary intent for this query.
m
Sa �fro ez
IP� turda The official mall map shows the exact 2 4
�20locationrt�n
17 , a
2.1 y,�Fe of the cafe. The pin lands on another 7
1 r�M of
6.2 bru ary� scapart
the mall and is rated Approximate. u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

249
 Query Results m Ratings and Explanation
4 � fro ez
2 rt�n
Prada Houston , �20 Galleria
a
� 7
1 ar�M Relevance S Bad (User Intent)
5015 Westheimer,
y
ar Osc Ste 2285A atu
e bru �by�Texas
Houston, e 77057 IP� rda
17
a y,�F 54.9 nriqu Name Accuracy 2.1 y,�FeCorrect
d Classification:
6.2 Ma Accessories 6.2 bru
tur
Sa 172.1 54
.9� ary�1
IP� Address Accuracy MaIncorrect
by 7, – Postal Code
nri �Osc �2024
qu a
e r�M �fro
Pin Accuracy Perfect art�n m
ez

An Italian clothing store is an unlikely intent for

this query.

The name is Correct, but the postal code

should be 77056.

The official mall map shows the exact location

of the store. The pin lands on this location and
is rated Perfect.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

250
10.7.10. Category Query: Parking m
2 4 �fro ez
"Parking" generally refers to: ,�20 art�n
17 �M
a ry� scar Sa
• Parking lots ebru by�O e IP� turda
� 17
• Parking garages
da y,�F 54.9 nriqu 2.1 y,�Fe
2 6.2 bru
• Parking tur 2.16. Ma
Sa decks
17
54
.9� ary�1
IP� Ma by�O 7,�2
nri sc 024
qu ar�M �fr
e art om
Example �ne
Query Results Ratings and Explanation z
Type
Is there a Navigational Result for this Query? No

Parking Relevance Excellent

123 O’Farrell St, San Francisco, CA Name Accuracy Partially Correct
94102
[parking] Classification: Parking Address Accuracy Correct
Pin Accuracy Perfect
Specific User and
Parking viewport in
San Research reveals that the official name
Francisco, for this parking location is Ellis-
CA O'Farrell Garage. Since an official
name exists, the generic name
“Parking” is demoted to Partially
Correct.

Is there a Navigational Result for this Query? No

Parking Relevance Excellent
121 Spear St, San Francisco, CA
Name Accuracy Correct
[parking] 94105
Classification: Parking Address Accuracy Correct
User and
Generic fresh Pin Accuracy Perfect
Parking viewport in
San
Francisco, This result is the parking garage for
CA the Rincon Center, which does not
have a specific name according to
official resources. Accept the generic m
Sa �fro z
IP� turda name “Parking” as Correct. 2024 rt�ne
� a
17
2.1 y,�Fe y � 17, ar�M
6.2 bru a r s c
54
.9� ary�1 e bru �by�O e
Ma by�O 7,�2 � F 9 u
nri sc 024 r d ay, .254. anriq
qu ar�M �fr tu 6 M
e art om Sa 172.1
IP �
�ne
z

251
Example m
Query � fro Results
ez Ratings and Explanation
Type 0 2 4
t �n
�2 ar
�17, ar�M
Isr there a Navigational Result for thisSQuery?
y No
b r ua �Osc I
atu
r
e �b y e P �17 da
da y,�F 54.9 nriqu Relevance2.1 y,�Fe Excellent
u r 6 . 2 a 6.2 bru
t MRincon Center Garage
Sa 172.1 Name Accuracy
54
.9� ary�1Correct
IP � 121 Spear St, San Francisco, CA Ma by�O 7,�2
nri sc 024
94105 Address Accuracy qu Correct
a
e r�Ma �from
[parking] Classification: Parking rt�n
Pin Accuracy Perfect ez
User and
Paid vs. fresh
free viewport in This result is the parking garage for
San the Rincon Center. It’s a parking
Francisco, garage accessible to the public for a
CA fee. Free and paid parking are equally
relevant. There should be no relevance
demotion if the parking lot/garage
requires payment and the query does
not specifically ask for free parking.

Is there a Navigational Result for this Query? No

Relevance Excellent
Name Accuracy Correct
Parking
3705 El Camino Real, Santa Clara, Address Accuracy Correct
[parking CA 95051 Pin Accuracy Perfect
free] Classification: Parking

User and
The query specifically requests free
Paid vs. fresh
parking, so the results should reflect
free viewport in
Santa the user’s request. This parking lot is
Clara, CA free and should be rated as Excellent.

If the result were a parking lot that

requires payment, then the correct
relevance rating would be Bad, as it
does not satisfy the user’s intent. om
Sa r
IP� turda 0 2 4�f �nez
17 ,�2 Mart
2.1 y,�Fe 1 7 �
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

252
Example m
Query � fro Results
ez Ratings and Explanation
Type 0 2 4
t �n
�2 ar
�17, ar�M
Isr there a Navigational Result for thisSQuery?
y No
b r ua �Osc I
atu
r
e �b y e P �17 da
da y,�F 54.9 nriqu Relevance2.1 y,�Fe Excellent
u r 6 . 2 a 6.2 bru
t MStevens Creek Parking
Sa 172.1 Name Accuracy
54
.9� ary�1Correct
IP � 2899 Stevens Creek Blvd, San Ma by�O 7,�2
nri sc 024
Jose, CA 95050 Address Accuracy qu Correct
a
e r�Ma �from
Affiliate [parking] Classification: Parking rt�n
Pin Accuracy Perfect ez
parking
that does User and
Fresh
not have a
Viewport
specific
in San
name Jose, CA This parking lot has no specific name,
but it is associated with a nearby
business, therefore the name is
Correct.

Is there a Navigational Result for this Query? No

Relevance Excellent
Parking Name Accuracy Correct
552 Waverley St, Palo Alto, CA
94301 Address Accuracy Correct
[parking] Classification: Parking
Pin Accuracy Perfect
Generic User and
fresh
Parking
viewport in
Palo Alto,
CA
This result is a generic parking lot and
there is no need for a specific name.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

253
Example m
Query � fro Results
ez Ratings and Explanation
Type 0 2 4
t �n
�2 ar
�17, ar�M
Isr there a Navigational Result for thisSQuery?
y No
b r ua �Osc I
atu
r
e y
�b qu e P �17 da
da y,�F 54.9 Parking
n ri Relevance2.1 y,�Fe Excellent
r . 2 a 6 b
t u 6 MSan Francisco, CA United States . 25 r
4.9 uary� Correct
Sa 172.1 Name Accuracy
IP � Classification: Parking Ma �by�O 17,�2
nri sc 024
Address Accuracy qu Correct
a
e r�Ma �from
[parking] rt�n
Pin Accuracy Perfect ez
User and
fresh
Airport This result refers to the parking lot of
viewport in
Parking San Francisco International Airport.
San
Francisco, The generic name “Parking” is
CA considered Correct. Pin must be
dropped on the SFO parking lot. This is
a POI without an expected address so
just a locality is appropriate and rated
Correct without a street number and
street name.

Is there a Navigational Result for this Query? No

Parking Relevance Bad (User Intent)
3600 Flora Vista Ave, Santa Clara,
CA 95051 Name Accuracy Correct
[parking] Classification: Parking Address Accuracy Correct
Private vs. Pin Accuracy Perfect
User and
public
viewport in
parking
Santa
Clara, CA The result in this example is a
residents-only parking lot. This should
be rated Bad because the lot is not
useful for the general public.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

254
 m
4 � fro ez
2 n
10.8. Rating Results with PERMANENT_CLOSURE7 , �20 art� Status
y �1 ar�M Sa
r sc
ua status t
When rating results whose
Fe b r
�b y � O
e is PERMANENT_CLOSURE, beI P�1 urdtoa understand whether the
sure
results are expected y,� or54unexpected.
.9 riq u 72 y,�F between expected and
For more information on the differences
da
r 16. Ma2 n .16 eb
unexpectedSresults,
t u see section 5.19. Rating Relevance When Result .25 isrua
Status
a 72. 4.9 ry�
PERMANENT_CLOSURE.
� 1 M �b 17
I P an y�Os ,�202
riq car
ue �M 4�fro
10.8.1. Expected PERMANENT_CLOSURE Status art m
�ne
z
When a result with PERMANENT_CLOSURE status is expected, choose the Business/POI is closed
or does not exist checkbox and rate as if the location were open.

Query Results Ratings and Explanation

Is there a Navigational Result for this Query? Yes
Relevance Navigational
Business Closed/does not
Yes
Gaslight Grill exist
PERMANENT_CLOSURE Name Accuracy no ratings needed
[gaslight
5020 W 137th St, Overland
grill]
Park, KS 66224 Address Accuracy no ratings needed
Fresh Pin Accuracy no ratings needed
viewport in
Kansas City, Research shows that the result for this navigational
KS query is permanently closed, and it displays the
status PERMANENT_CLOSURE. Showing this closed
result is expected since no other result can be
returned in the area of location intent.

Select Business is closed or does not exist and

rate the business as if it did exist. No further POI
data rating will be needed.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z
10.8.2. Unexpected PERMANENT_CLOSURE m Status
f ro
When many branches of a chain 2 24� ravailable
0are t�n
ez
in the area of intent, we would not expect to see any
, �
7 r�M a
�1
locations with a status of PERMANENT_CLOSURE, whether that status is correct or not.
ry a Sa
b r ua �Osc I tur
e y P�1 da
a y ,�F 4.9�b rique 72 y,�F
.16andeViewport
u d
r 16. Ma 2Query
5 n User .25 brua
t
Sa 172. 4.9 ry�
�b 1
�
I P [mcdonalds] User and fresh viewport M �Os 7,�20 CA
anin ySunnyvale,
riq car 24�
ue �M fro
art m
�ne
z

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

256
 Suggestion m Rating and Explanation
4 � fro ez
2 rt�n
7 , �20 Relevance
a Acceptable
y �1 ar�M Sa
r
ua �Osc Business/POI closed/ t
F e b r
�b y e Yes I P�1 urda
① McDonald's ay,� 54.9 riq u does not exist 72 y,�F
d 2
r 16. Ma n .16 eb
PERMANENT_CLOSURE
t u .25 rua
Sa 172. This permanently closed restaurant (confirmed
4.9 ryby
�b �17,research) has
615 N Mathilda � Ave, M
I P its status set to PERMANENT_CLOSURE.aItnrisy�considered
Os �20
Sunnyvale, CA 94085 i q ca 24
unexpected because there are many other locations u e r�Maof�frthis
om chain
in the area. This means the highest rating it can get isrt�ne
z
Acceptable. Name, address, and pin will not be rated.
Relevance Excellent
Business/POI closed/
No
does not exist
② McDonald's Name Accuracy Correct
550 Lawrence Expy,
Sunnyvale, CA 94086 Address Accuracy Correct
Pin Accuracy Perfect
This open chain location is among the closest to the user and
rated Excellent.
Relevance Acceptable
Business/POI closed/
No
does not exist
Name Accuracy Correct
Address Accuracy Correct
Pin Accuracy Perfect

⓷ McDonald's
PERMANENT_CLOSURE
556 E El Camino Real, This chain location is showing a status of
Sunnyvale, CA 94086 PERMANENT_CLOSURE. Research shows that it is, in fact, open.
Its relevance is rated independent of whether it is really open or
closed in the real world. The result is considered unexpected and
rated Acceptable.
m
Sa �fro ez
IP� turda Do not mark this result as Business/POI closed/does not 2 4
�20 exist,rt�n
17 , a
2.1 y,�Fe and continue rating the result for relevance plus name,
7
1 ar�M
6.2 bru ary� address,
sc
54 and pin details. u
br �by�O e
.9� ary�1 e
Ma by�O 7,�2
d ay,�F 54.9 nriqu
nri sc 024
qu ar�M �fr tur 6.2 Ma
e art om Sa 172.1
�ne IP�
z
257
 Suggestion m Rating and Explanation
4 � fro ez
2 rt�n
7 , �20 Relevance
a Good (Distance)
y �1 ar�M Sa
r
ua �Osc Business/POI closed/ t
Fe b r
�b y e Yes I P�1 urda
y,� u
.9 iq does not exist 72 y,�F
④ McDonald'srda 6.254 anr .16 eb
.25 rua
t u 1 M
Sa [Link],
1082 E El Camino The chain location does not exist according
4.9 torofficial
�by y�17, resources
P � M
Sunnyvale, CA
I 94087 and should be rated as Business is closed an or
riq does
�Os �20not exist.
ca 24
The result does not show the status as PERMANENT_CLOSURE,
u e r�Ma �from
so it should be rated as if it were open, which is Good rgivent�n
ez the
distance.

[Link] Query Types

Queries can sometimes be less obvious or even ambiguous.

10.9.1. Routing Queries

When a query mentions two distinct locations that are not near each other, the user was likely looking
for driving directions, so returning either of the two distinct locations used for the route is the best
experience Search can offer. Each location should be rated Excellent for Relevance.

Query Results Ratings and Explanation

Is there a Navigational Result for this Query? No
Relevance Excellent
Name Accuracy n/a
Oxford Address
Oxford, United Kingdom Correct
Accuracy
Classification: n/a
Pin Accuracy Perfect

The query includes two separate locations,

which are very far away from each other, so
Sa the user was likely looking for routing rom
f
IP� turda directions. Returning either of the individual
2 0 24� rt�nez
17 �
, Ma
2.1 y,�Fe locations is expected and should y �17bearrated
�
6.2 bru r c
Excellent. u a s
[66 Chandos
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 y , 4. nriq
Pl, London nri sc 024 rda 16.25 within
The pin should betudropped Ma the
qu ar�M �fr S a 72.
WC2N 4HG e art om boundaries of thePresult
1 locality.
Oxford] �ne I �
z

258
 Query Results m Ratings and Explanation
4 � fro ez
2 n
7 , �20 art� Relevance Excellent
66 Chandos 1 �M
a ry� scarPl Sa
u
r y�O Pl
66ebChandos IP� turda n/a
Name Accuracy
, � F . 9�b WC2N q ue 17
2.1 y,�Fe
a y London4 r i 4HG
u rd 16.25 Man Address 6.2 bru
t
Sa 172. Classification: n/a 5Correct
4.9 ary�
Accuracy
IP� Ma �by�O 17,�2
nri sc 024
Pin Accuracy Perfect
qu ar�M �fr
e art om
The query includes two separate �locations,
nez
so the user was likely looking for routing
directions. Returning either of the individual
locations is expected and should be rated
Excellent.

The pin should be dropped on the address

provided in the result.

Is there a Navigational Result for this Query? Yes

Oxford Relevance Navigational

Oxford, United Kingdom
Name Accuracy n/a
Classification: n/a
Address
Correct
Accuracy
[route to
Oxford] Pin Accuracy Perfect

This routing query contains only one

location.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z
259
 m
[Link] and “My Location” 4 � fro ez Queries
2 n
7 , �20 art�
1 �M
a ry� scar Sa
t
u
Note: Results for coordinateFe b r
�b � O
y and e ‘’my location” queries (or any
I P�1 urda of these, like “current
variation
y,� 54.9 nriq u 72 y,�F
location,” “where a I am,” and so on) are rated differently from the .16results
other
t u d
r 16. Ma
.
2 .25 ebrudescribed
a
in these
a
guidelines. Please 4
17 read this section carefully.
S 2 .9 r y
IP� Ma �by�O �17,�2
nri sc 024
qu ar�M �fr
e art oorm
Pin and Relevance are rated separately using a 50m radius around the queried coordinates �ne the
user location (for “my location” queries): z
• Relevance:
• A result that exists and is within the 50m radius is rated Excellent.
• A result that does not exist or is outside of the 50m radius is rated Bad.
• There will be no Navigational results.
• Pin Accuracy:
• A pin that falls within 50m radius is rated Perfect.
• A pin that falls outside the 50m radius is rated Wrong.
• Name and Address Accuracy:
• Rate the name and address accuracy according the regular guidelines.

The graphic below gives an overview. These concepts are explained further on the following pages.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

260
 m
4 � fro ez
2 n
, �20 art�
If no result can be found 1 within
7 �M 50m, then the closest address Sa or street up to 100m away
ry� scar
will be [Link] address
y�O e or street can be found within
IP� turd100m, depending on the
e �b 1 a
,� market,
F .9 iqa locality or sub-locality will also be
u 72accepted.
y
.16 ,�Feb
u r day 6.254 anr .25 rua
t M
Sa 172.1 4.9 ry�
�b 17
� M
I P an y�Os ,�202
riq car
ue �M 4�fro
Query Pin Rating and Explanation art m
�ne
z

Draw an imaginary circle with a 50m radius around the

user’s location. Rate any pin inside the circle Perfect and
any pin outside the circle Wrong.

Draw an imaginary circle with a 50m radius around the

queried coordinates. Rate any pin inside the circle Perfect
and any pin outside the circle Wrong.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z
261
 Results m Relevance Rating and Explanation
4 � fro ez
2 n
7 , �20 art�
1 �M
a ry� scar Sa
t
u
Fe b r
�b y � O
e I P�1 urda
y,� 54.9 nriq u 7250m y,�F
da
r 16. Ma2 Use an imaginary circle with a . 16 radius
ebr around the queried
u . 2
t
Sa 172. location to rate relevance. A result that 5 4.9 uhasary any part of its
�
IP � Perfect area within the circle is rated � b y�O 17,�2 If a result
Ma Excellent.
n i sc 024
does not have any Perfect area inside rthe qu circle,
a rate Bad.
e r�Ma �from
rt�n
The Perfect area usually refers to the rooftop or section ez of the
rooftop, but can include the parcel for parks and other
features rated perfect for the parcel.

Result Relevance Rating and Explanation

1: 3495 El Camino Real Part of the POI is inside the

Excellent
Santa Clara, CA 95051 50m radius

2: 3530 El Camino Real

Part of the POI is inside the
Santa Clara, CA 95051 Excellent
50m radius

The street is inside the 50m

3: El Camino Real (street name) Excellent
radius
4: United Furniture Club
No part of the POI is within
3503 El Camino Real Bad
the 50m radius
Santa Clara, CA 95051
5: 3482 El Camino Real Unit B Research shows this address
Bad
Santa Clara, CA 95051 does not exist

Note that the pin and result title do not need to match. For example, if a result for United Furniture
Club is returned, but the pin is placed at the queried coordinates or user location, the Relevance
Rating will still be Bad, but the pin rating will be Perfect even though it is far from United Furniture’s
location.

10.10. Unclear Results

m
Sa
There t umay be times when it is difficult to determine exactly what the result is because the �fro ez
business
2 4
IP� rda
1 , � 20 art�n
name72can’t.16 ,�Fbe
y identified with certainty or the business does not correspond with the given 1 alocation
7 �M
and it cannot .25 ebbe
ruaconfirmed as closed. When this happens, use all provided information ary�(including
s c r
u
4.9 ry� y�O e
ebr 9�bto
information that
� b is not
1 rated, such as URL and phone number – never call a business)
, � F . reach
u a
M y� 7 ,� ay .254 anriq
conclusion. anriq Osca 2024 tu r d 6 M
ue r�M �fro
art m Sa 172.1
�
IP Business/POI is closed/
If there is a tie in the evidence �ne or you are rating Search Relevance only, rate
z
does not exist, then rate relevance as if the entity did exist.

262
 m
4 � fro ez
2 n
7 , �20 art�
1 �M
a ry� scar Sa
Query b r u
y � O Results IRatings
P�1 urda and Explanation
t
Fe �b e
,� 4.9 riq
yIs u 72 y,�F
da
r 16. Ma there
2 5 na Navigational Result for this Query? .16 No
.25 ebrua
t u
Sa 172. 4.9 ry�
I P � dressbarn Relevance M aExcellent
�by 17,
�O �2
5762 Hollister St n riq scar 024�
Name Accuracy u
Correct e �M fro
Houston, TX 77040 art m
�ne
Classification: Women’s Clothing Incorrect – Street z
Address Accuracy Number and Street
Additional info: Name
URL: [Link]
Phone: 1-713-331-0007 Pin Accuracy Approximate
[dressbarn] The result name and URL are pointing to a
dressbarn location. The address listed is
User and fresh associated with a business called Dots,
viewport in located in the same shopping center, that has
Houston, TX now closed. After researching the nearby
area, a dressbarn with the same phone
number as our result is found located within
the same shopping center as our result
address at 13256 Northwest Freeway,
Houston, TX 77040. The pin is located
within the shared parking lot of the shopping
mall. Because a business with the same name
and phone number is found in the immediate
surrounding area, we will consider the
address incorrect for this result.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z
263
 Query Results m Ratings and Explanation
4 � fro ez
2
0 rt� n
Is there a Navigational
7,�2 r�Ma Result for this Query? No
y �1 a S
ar sc a
e bru �by�O e Relevance IP� turda Excellent
17
a y,�F 54.9 nriqu 2.1 y,�Fe
d 2
tur 16. Ma Barn Name Accuracy 6.2 Correct b
Sa [Link] 54 ruar
.9� y�1
IP� 1350 Fashion Valley Rd, San n
by� 7,� – Street
MaIncorrect
O 20
Diego, CA 92108 Address Accuracy Number riq scarand 2
ue �M 4�Street
fro
Classification: Furniture Store Name a rt�n m
ez
[furniture Additional info: Pin Accuracy Approximate
store] URL: [Link]
The result name and URL point to a Pottery
Phone: 1-619-296-8014
User and Fresh
Barn location. The address listed is
San Diego, CA associated with a nearby business, Wells
Fargo Bank. After researching the nearby
area, a Pottery Barn with the same phone
number as our result is found at 7007 Friars
Road, San Diego, CA 92108, within the
Fashion Valley Mall. The pin lands on the
Fashion Valley Mall. Because a business with
the same name and phone number is found in
the immediate surrounding area, consider the
address incorrect for this result.
Is there a Navigational Result for this Query? No
The Lot Bar Relevance Excellent
2333 S St
Sacramento, CA 95816 Name Accuracy Incorrect
Classification: Dive Bar Address Accuracy Correct

[bar] Additional info: Pin Accuracy Perfect

Phone: 1-916-451-4682
User and Fresh Research on the result information shows that
Viewport in the address belongs to Round Corner Tavern.
Sacramento, CA The result phone number also belongs to the
Round Corner Tavern and the pin is located at
the result address. Finally, there is no ‘Lot Bar’
located in the immediate area. Because all
result information except for the name listed
points to the Round Corner Tavern, we will m
Sa consider the name incorrect for this result. �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

264
 Query Results m Ratings and Explanation
4 � fro ez
2
0 rt� n
Is there a Navigational
7,�2 r�Ma Result for this Query? No
y �1 a S
ar Osc a
Holiday bru �byInn� e IP� tuis
Business/POI r closed/does not !
300
, � Fe
N . 9Harbori q u Drive exist 17 day,�
a y 4 r 2 . F
d 6.25 an 16 ebr
tur Redondo M Beach, CA 90277 .25 u
Sa 172.1 Relevance .9� ary�1
4Excellent
IP � Classification: Hotels and Events b
Ma y�O 7,�2
n sc 02
Use all the informationriqprovided
ue ar�M ,4even
�fro
Additional Info: information that's not rated, likeaURL rt�n m and
URL: [Link] phone number, to research the result. e z
holidayinn
Phone: 1-310-750-1149 In this case, research shows that the address
belongs to a Crowne Plaza Hotel, not a
Holiday Inn. Street imagery also shows that
[holiday inn] this building is a Crowne Plaza.

User and fresh The result phone number does not belong to
viewport in Santa any business and the given URL does not
Ana, CA point to any particular Holiday Inn.

Investigation of the surrounding area shows

that there is no Holiday Inn in Redondo Beach,
so this is not a case where the business has
been misplaced and the result contains an
incorrect street name or number.

Because the result information does not

overwhelmingly point to a Holiday Inn at this
location, rate the result Closed/Does not
exist.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z
265
 Query Results m Ratings and Explanation
4 � fro ez
2
0 rt� n
7,�2 r�Ma
Is thererya�1Navigational Result for this Query? No
a s ca Sa
u t u
Febr 9�by�O ue IP� rda
17
a , �
ySanta’s 5 4 nProfessional
. r i q Dog 2.1 y,�Fe
d
tur 16. Ma
2 Relevance 6.2 Excellent
b
Sa [Link] 54 ruar
.9 y
IP� 603 Manley St, North Pole Ma �by�O �17,�2
AK, 99705 nri sc 024
Name Accuracy Incorrect
qu ar�M �fr
Classification: Pet Services e art om
�ne
z
Additional info: Address Accuracy Correct
Phone: (907) 480-9701
URL: http:// Pin Accuracy Perfect
[Link]
[Link]/
Use all the information provided , even
information that's not rated, like URL and
phone number, to research the result.
[santa's dog
Here, research shows that the address, url,
grooming]
and phone number belong to Paula’s
Professional Dog Grooming. Since the
User and fresh
viewport in North evidence points to Paula’s business actually
Pole, AK existing at this location, the name Santa’s
Professional Dog Grooming is considered
Incorrect.

When rating relevance, ignore all data issues

and rate the result as if the name and
classification were correct. Because of the
match between the query and the incorrect
name, and how near the user is to the result in
the fresh viewport, this result is rated
Excellent.

When rating other results, treat this one as

closed/does not exist and don’t demote the
relevance of other, more distant, results. This
is so that a valid result that’s farther away
won’t be demoted solely due to this naming
error.
m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

266
 Query Results m Ratings and Explanation
4 � fro ez
2 �n
Is there a 7Navigational
1 ,�20 Mart Result for this Query? No
y � a r � S
ar sc a
bru �by�O e IP� tuis
Business/POI r closed/does not !
, � Fe
. 9 i q u exist 17 day,�
a y 4 r 2 . F
d 25 n 16 ebr
tur 16. Ma .25 u
Sa [Link]
� Relevance .9� ary�1
4Excellent
IP b
Ma y�O 7,�2
1221 S Main St, Wildwood, FL nri sc 024
qu ar�M �fr
34785 e art om
Classification: Gas Station �ne
z
Additional info:
URL: [Link]
Phone: 1-352-748-6199 There are two gas stations in the immediate
area:

Mobil (purple pin)

1221 S Main St
Wildwood, FL 34785
Phone: 1-352-748-6199

Shell (red pin)

1001 S Main St
[gas station] Wildwood, FL 34785
User and fresh Phone: 1-352-748-8903
viewport in
Wildwood, FL
The result contains conflicting information
from two nearby businesses. The result name
and URL point to a Shell gas station a little
north of the result address listed, while the
result address and phone number point to a
Mobil gas station. If, after researching all of
the given information for a result no clear
consensus of what the result is pointing to
can be made, the result should be rated as
Closed/Does not exist.

You will still need to rate relevance as if the

business were open. The result matches the
query intent and is within the fresh viewport.
The result should receive a rating of
m
Sa Excellent. �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z
267
 m
4 � fro ez
Query Results 2 n Ratings and Explanation
7 , �20 art�
1 ar�M
Is there a rya� Navigational
sc Result for this Query? Sa
tur No
b r u � O I
e y
�b qu e P �17 d a
y,�F 54.9 nrInc
Dinosaur i Business/POI [Link] y,�F
closed/does not
da
r 16. Ma2 16 . ebr !
t u
Sa 172. 8655 Jones Rd exist 25 u
4.9 ry�a
IP� Houston,TX77065 Relevance
Ma �by�O 17,�2
nExcellent
riq scar 024�
ue �M fro
Additional info: Research on the result information m
art shows
�ne
Phone: 1-281-531-6500 that the address belongs to Trails atz
Classification: n/a Corinthian Creek Apartments. The result
[dinosaur]
phone number belongs to a different
User and large apartment complex, Domain West
fresh viewport in Apartments. Finally, there is no evidence that
Texas the business Dinosaur Inc exists. Based on
the information listed, rate the result as
Closed/Does not exist.

You will still need to rate relevance as if the

business did exist. The result matches the
query intent and is within the large, fresh
viewport. The result should receive a rating
of Excellent.
Is there a Navigational Result for this Query? No
Business/POI is closed/does not
Lowongan Guru Kimia SMA SMU !
exist
Di Jakarta
[Salon di jalan Jalan Danau Sunter Utara No. 1 Relevance Bad (User Intent)
tebet timur Tanjung Priok
dalam raya DKI Jakarta 14350 The query is for a category with a specific
jakarta Indonesia location modifier. The result is for a job
selatan] Classification: Education opening which does not satisfy the intent and
is not indicative of a POI. There is a
Translation: Result Title Translation: possibility the result is for a particular high
[Salons in [Job Opening for High School school, however, the result address is not
Jalan Tebet Chemistry Teacher in Jakarta] tied to any high school and no specific
Timur Dalam Additional info: school is named in the result title. Since the
Raya, Jakarta Lat/long: -6.13799,106.86598 result data is ambiguous and does not
Selatan] or represent a single POI this entity should be
[Category, rated Closed/Does not exist. m
Sa �fro ez
IP� turdaName,
Street 2 4
rt�n
20 if athe
City
17 Name] You will still need to rate relevance , �as
2.1 y,�Fe 7
1 ar�M
6.2 bru business were open. The user's ary� intent
c is for a
54 r y�Os
u
.9� ary�1 Salon on a specific street. e b
The result e does
Ma by�O 7,�2 4 .9�b riqu
y,�F should
nri sc 024 not match this intent d and
a 25 n be rated as
qu ar�M �fr tur 2.16. Ma
e art om Bad. a
S 17
�ne IP�
z

268
11. Top Rating Tips m
4 � fro ez
02 art�n
�2rating
Solutions to the most common 1 7 ,
�M dilemmas.
a ry� scar Sa
t
u �O
F e b r
�b y e I P�1 urda
11.1. What’s thearelevance
y,� 54.9 nriwhen u query is business/POI name and y,�F
72 address
ebr and the result is
q .
r d . 2 a 16
only the address?
t u 6 M . 25
4.9 uary�
Sa 172.1
IP � Ma �by�O 17,�2
When a user types in the name of a business or a POI along with its address, nrthey
iqu scexpect
ar� 24�fto see the
0
business mentioned in the query as part of the result. If the result is the address alone aand e M
rt�n does
rom not
mention the business, the user cannot be certain that the query and the result refer to the same ez thing.
This is why the result’s relevance is Bad.

Address and pin accuracy can be rated as usual.

Query Results Ratings and Explanation

800 North Point Relevance Bad (User Intent)
800 North Point St, San Francisco,
California 94109 Name Accuracy n/a
[Gary Danko Classification: American (New) Address Accuracy Correct
800 North
Point St, San Pin Accuracy Perfect
Francisco, Result is for the address and not the
California business stated in the query, so the user
94109] cannot know whether or not the query and
result refer to the same thing. This is why the
result’s relevance is Bad.

11.2. What’s the relevance when the query is a street name and the result is a single
business on that street?

A query for an entire street is very broad. When the result is just one business or one address on that
street, it is too specific to satisfy the broad intent of the query.

Name, address, and pin accuracy can be rated as usual.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z
269
 Query Results m Ratings and Explanation
4 � fro ez
2 t�n
Happy Lamb 7 , �20HotarPot Relevance Bad (User Intent)
1 �M
ry� scar Creek Blvd
19062uaStevens Sa
ebr 9�by�OCA,
Cupertino, IP� turda
Name Accuracy Correct
y , � F
4 . i q ue 95014 17 y
2.1 Fe, �
a
d 6.25 an r
tur Classification: Chinese Address Accuracy 6.2 bCorrect
Sa 172.1
M 54 ruar
.9� y�1
IP� Pin Accuracy by
Ma Perfect 7,
nri �Osc �2024
[Stevens qu a
Creek Blvd] e r�Ma �from
r
The result is for a business on thet�nstreet.
ez
When the query is for a street, returning a
single business is too specific a result for the
broad query.

11.3. How do I know what the location intent is when user is outside/inside a fresh viewport?

When a viewport is fresh, the location intent for results depends on whether the user is inside or
outside the viewport:

• When a user is inside the viewport, that user’s location is the location intent

• When a user is outside the viewport, results are expected in or near the viewport, no matter
how near or far the user is from that viewport.

Viewport User Location Intent

When the user is within a fresh viewport, take the user
location as location intent. Results are generally expected in
Inside Viewport
or near the viewport, and results inside the area cannot be
rated Bad because of distance alone.

Fresh Results are expected in or near the viewport area. If no results

Outside
can be found in or near the viewport, use the user location as
Viewport
a secondary location intent.

When the user is missing, the viewport remains the location

Missing m
Sa intent. �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

270
11.4. How do I know what the location m intent is when user is outside/inside a stale viewport?
� f ro
ez
, �2 024 art�n
7 r�M
When a viewport is stale,arthe y�1 user’s
a location is considered the location
Sa intent for the results whether
r u �Osc tur
the user is inside or Foutsidee b y the viewport I P�1 da
a y ,� 4.9�b rique 72 y,�F
.16 eb
d
r 16. Ma 2 5 n
t u .25 rua
Viewport Sa 172. User Location 4.9 ry�
Intent�b 17
� M
I P an y�Os ,�202
Inside Viewport riq car
ue �M 4�fro
When the viewport is stale, consider only the user art location
�ne
m as
Outside location intent. z
Stale Viewport
Use the stale viewport as location intent when the user
Missing
location is missing.

11.5. This full address result does not exist. How do I rate it?

An address type result needs to be associated with a building or officially assigned to a plot of land in
order to be useful to a user. Sometimes your research will show that a queried address simply does
not exist. In cases like, this you’ll see one of three types of results:

• The closest verified address (on the same street, in the same city and state): Rate
relevance as Excellent.
• The same address as the query address: Rate relevance as Excellent and address as
Incorrect – Address does not exist. The pin will be rated Can’t Verify.
• The queried street without a street number: Rate relevance as Acceptable.

When a queried address does not exist, the answer to the question “Is there a navigational result for
this query” will always be No.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z
271
 Query Results m Ratings and Explanation
4 � fro ez
2 n
Is there a 7Navigational
, �20 art� Result for this Query? No
y �1 ar�M S
ar Osc a
[2001 Duncan 1099 e bruDuncan
y � St Relevance IP turd Excellent
� F e
�b qu St., San �17 ay,
1099
,
St, San rday .254 anr Duncan
. 9 i 2 � Fe
u Francisco,
6 94131, CA Name Accuracy .16.2 n/a br
Francisco]t
Sa 172. 1 M 5 4.9 uary�
�b 17
IP� Classification: n/a Address Accuracy MCorrect an y�Os ,�202
riq car
Pin Accuracy Perfectue �M 4�fro
art m
�ne
z
If 2001 does not actually exist then selecting
1099, the closest number that does exist, is
considered correct. For a locale that uses the
rule of even numbers on one side of the street
and the odd numbers on the other, we need to
return the closest existing address on the same
side of the street as the query. If the rule of
odds and evens does not apply then the
closest numeric number will be considered
correct.
The pin has to be correctly dropped on the
address presented in the result.

2001 Duncan St Relevance Excellent

2001 Duncan St., San Name Accuracy n/a
Francisco, 94131, CA
Classification: n/a Incorrect – Address
Address Accuracy
does not exist
Pin Accuracy Can’t Verify
Duncan Street only goes up to number 1099,
but the query requests a non-existent number.
The result returned is the same as the queried
address and should be rated as Excellent.
The pin rating for addresses that do not exist is
Can’t Verify.

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

272
 Query Results m Ratings and Explanation
4 � fro ez
2 n
Duncan St7,�20 art� Relevance Acceptable (User Intent)
Duncan y�1 San �M
a rSt, s car Francisco, Sa
94131,
u
ebr 9�CA O
by� ue
Name AccuracyIP� turda n/a
F 17
, � . iq 2.1 y,�Fe
r dayClassification:
. 254 anr n/a Address Accuracy 6.2 Correctb
t u
Sa 172.1
6 M 54 ruar
.9� y�1
IP� Pin Accuracy b
MPerfect 7
an y�Os ,�202
riq car
ue �M 4�fro
The result returns only the street withart a m pin
�ne
dropped within the boundaries of the street. z
This result technically satisfies the user intent,
but this intent is unlikely, so relevance should
be rated Acceptable.

Appendix: Release Survey

You may occasionally be unable to rate a survey. To skip it, click Release Survey at the top right of
the tool.

A pop-up window with a list of reasons for release will appear. You must choose one before you can
release the survey.

Note: If you change your mind and decide to rate the survey, click Cancel at the bottom left of the
pop-up window.

Reasons to Release

1. Adult Content

You are not comfortable rating queries and/or results that include businesses offering adult services
or entertainment, like strip clubs.

2. Technical Issue

Technical issues that prevent rating include:

• Map or map features not loading.

• Query field is empty.
• Tool is not interactive. You cannot zoom in and out or move the map at all.
m
S•a Cannot submit ratings.
t u 2 4 �fro ez
n
IP•� rMore
17 day,� than 5 pins in a row are missing or pins do not stay in place. 7 , �20 art�
• 2Receiving
.16 Feb 5 consecutive surveys with all results in China, if China, or Hong Kong, 1 arnot �M the
.25 rua ary� are
s c
u
markets
4.9 you
�
ry� are rating.
1 � F ebr 9�by�O ue
b ,
Ma y�O ,�2
nri sc 024
7
r d ay .254. anriq
If you choose this a
qu option,
e r�Ma leave atu 72.16 theMsurvey.
�fro a comment describing the issue before Sreleasing
m 1
rt�n
ez IP�

273
 om
3. Not Enough Time Allocated 24�fr nez
0 rt�
�1 7,�2 r�Ma
Select this option if the Estimated
ua �Osc Rating Time is not sufficient toI complete
ry a Sa
tur the task. Remember, the
r
Estimated Rating Time e b is the
�b y average
e time over multiple tasks. P �17 da
da y,�F 54.9 nriqu 2.1 y,�Fe
ur 2
6. Ma 6.2 bru
4. Other Sat 172.1 54
.9� ary�1
IP � Ma by�O 7,�2
nri sc 024
Issues not mentioned above that prevent you from rating. qu ar�M �fr
e art om
�ne
If you choose this option, you must leave a comment before you can release the z
survey.

Do Not Release

These issues will not prevent rating and are not reasons to release surveys:

• Poor satellite image, including clouds over target area or lack of image detail
• You can zoom in and out on map, but not as much as you'd prefer
• Rating is too difficult
• Query does not appear to be related to maps
• Query or results are from outside your market
• A query has no results
• If you see a query with no results, answer the query-level “Navigational Result”
Question and submit.
• Query or results in unexpected languages and scripts:
• If you see a query in an unexpected language or script, research it or use an online
translation tool to find out what it means, then rate it as usual.
• For results in an unexpected language or script see Result Name/Title in Unexpected
Language or Script and Language/Script Issues in Address

m
Sa �fro ez
IP� turda 2 4
�20 art�
n
17 ,
2.1 y,�Fe 1 7 �M
6.2 bru ary� scar
u
54
.9� ary�1 � F ebr 9�by�O ue
Ma by�O 7,�2 ,
ay .254. anriq
nri sc 024 r d 6
qu ar�M �fr tu M
e art om Sa 172.1
IP �
�ne
z

274