Maps Search Evaluation Guidelines 2020
Maps Search Evaluation Guidelines 2020
f ro m m Evaluation Guidelines
IP
la
, 2 021 Ghu DECEMBER 2020
8 i s h Mo
1. Introduc+on ..............................................................................................................................................
2
ne Kaw aza nd 5
u 7 8 a
[Link] Rating Tool ....................................................................................................................................................................................................
J y R . y 5
[Link] Work4low ay, .51 b ain 95
.17 , Jun
ond ...............................................................................................................................................................................................
7 6 s n 6.5 e 2 11
.1 Ha
M 95................................................................................................................................................................................................
[Link] Interface 1 8 12
Ha by K , 20
78.‘Navigational Result’ Question ...............................................................................................................................................
[Link]-Level sna aw 21 13
in ish from
[Link]-Level Rating Checkboxes ................................................................................................................................................................... 13
Ra
za Ghu IP
[Link] Relevance Rating.................................................................................................................................................................................. 14
lam
[Link] Relevance Demotion Checkboxes ................................................................................................................................................... 15
[Link] Accuracy ...................................................................................................................................................................................................15
[Link] ..........................................................................................................................................................................................................15
2. Understanding User Intent .......................................................................................................................16
[Link] Types .......................................................................................................................................................................................................16
[Link] Expectation .......................................................................................................................................................................................19
[Link] Types .......................................................................................................................................................................................................20
[Link] Intent ..................................................................................................................................................................................................21
[Link] Location ................................................................................................................................................................................................21
[Link] Location ..............................................................................................................................................................................................22
3. Ra+ng the Query-Level Naviga+onal Result Ques+on ...............................................................................22
4. Ra+ng Result-Level Issues ........................................................................................................................23
[Link] Name/Title in Unexpected Language or Script .....................................................................................................................23
[Link] of Business/POI Results........................................................................................................................................................................24
[Link] of Address Results ....................................................................................................................................................................................27
[Link]/POI is Closed or Does not Exist .............................................................................................................................................27
[Link]/Does Not Exist vs. Inaccurate Name and Address .....................................................................................................................28
[Link] Relevance of Closed/Non-existing Business/POI .......................................................................................................................28
5. Relevance ................................................................................................................................................28
[Link]-Result Connection ..............................................................................................................................................................................29
5.1.1. General Connection .........................................................................................................................................................................................30
5.1.2. Abbreviation/Alternate Name Connection ..............................................................................................................................................30
5.1.3. Category Connection ....................................................................................................................................................................................30
5.1.4. Spell Correction Connection..........................................................................................................................................................................31
5.1.5. Transit Intent Connection ..............................................................................................................................................................................31
5.1.6. Special Character Connection ......................................................................................................................................................................31
5.1.7. Address-Result Connection ............................................................................................................................................................................32
5.1.8. Lack of Connection .........................................................................................................................................................................................32
5.2. Satisfying User Intent ....................................................................................................................................................................................34
[Link] .........................................................................................................................................................................................................35
[Link] ................................................................................................................................................................................................................36
[Link] vs. Prominence ...............................................................................................................................................................................38
[Link] Possible Results ....................................................................................................................................................................................39
[Link] Possible Results .......................................................................................................................................................................................41
[Link] Possible Results and Greater Distance
Mo ..........................................................................................................................................
IP 42
[Link] Areas m
.........................................................................................................................................................................................................
78 nda 1 fr ulam 43
o
[Link] – User Intent Deviation
.95 y, J ............................................................................................................................................................
2
20 sh Gh 44
.17 un
[Link] for User Inside and Outside Viewport ,
...................................................................................................................................
8 i 45
6.5 e 2 2
1 b 8,
[Link] Address Does Not Exist ne Kaw aza
................................................................................................................................................................
u 47
Ha y K 20
[Link] vs. Municipality d a y, J 51 by in R
sna aw 21..................................................................................................................................................................................... 48
in
[Link] Results
fro n 176. asna
ish ......................................................................................................................................................................................
o 48
Ra m M 95. H
za Ghu IP
5.15. Multiple Transit POIs with the Same Name .
......................................................................................................................................
7 8 50
lam
[Link] and Transit Intent ............................................................................................................................................................................... 51
[Link] Queries .................................................................................................................................................................................................52
[Link] vs. Stations ............................................................................................................................................................................................55
[Link] Intent .................................................................................................................................................................................................57
[Link]: Service-Level Mismatch IP
m......................................................................................................................................................57
ro m
0 2 1 f hula
6. Name Accuracy ........................................................................................................................................ 59
2 sh G
8, .........................................................................................................................................................................
[Link] Not Applicable (n/a) 2 i M 60
ne Kaw aza 78 nda
o
[Link] Names .....................................................................................................................................................................................................
u 60
y J
, 1 b in R y . 95 y, J
6.2.1. Correct Name a....................................................................................................................................................................................................
. 61
6.2.2. Partially ond 17Name
Correct 6.5 as..................................................................................................................................................................................
na 17 un
6 . e 64
M 95. 5 1 2
78.
H
[Link]. Minor and Moderate Misspellings and Missing or Extra Words Ha by K 8, 20
..................................................................................................... 64
sna aw 21
[Link]. Service-Level Mismatch ....................................................................................................................................................................................
in i f r 67
Ra sh G om I
[Link]. Holding Name and Corporate Structure .................................................................................................................................................... 67
za hu P
6.2.3. Incorrect Name................................................................................................................................................................................................
lam 68
6.3 Result Classi4ication ........................................................................................................................................................................................70
6.3.1. Correct Classification ......................................................................................................................................................................................70
6.3.2. Incorrect Classification ..................................................................................................................................................................................71
6.4. Can’t Verify .........................................................................................................................................................................................................73
6.5 Transit Names ...................................................................................................................................................................................................73
6.6. Parking Names .................................................................................................................................................................................................74
6.7 Final Name Accuracy Rating (Summary Table) ..................................................................................................................................75
7. Address Accuracy: Components and Issues ..............................................................................................76
[Link] Components .....................................................................................................................................................................................76
[Link] Number .....................................................................................................................................................................................................76
[Link]/Apt ...............................................................................................................................................................................................................78
[Link] Name ........................................................................................................................................................................................................79
[Link] and Administrative Divisions .........................................................................................................................................................80
[Link] or State ...................................................................................................................................................................................................81
[Link] Code .........................................................................................................................................................................................................82
[Link].................................................................................................................................................................................................................82
[Link] Does Not Exist .................................................................................................................................................................................83
[Link]/Script Issue in Address ............................................................................................................................................................83
[Link]-Speci4ic Issue ...................................................................................................................................................................................84
[Link]-Specific Issue vs. Correct with Formatting Issue.......................................................................................................................84
[Link] Issue ..........................................................................................................................................................................................................84
[Link] with Formatting Issue ...................................................................................................................................................................85
[Link]’t Verify ..........................................................................................................................................................................................................85
[Link]’t Verify for Street Number .......................................................................................................................................................................86
[Link]’t Verify for Street Name...........................................................................................................................................................................86
8. Address Accuracy: Result Expecta+ons .....................................................................................................87
[Link]/POI Result .......................................................................................................................................................................................87
[Link]/POI Address Research and Resources .........................................................................................................................................87
[Link] Official Addresses........................................................................................................................................................................88
[Link].Department Addresses .......................................................................................................................................................................................88
[Link].Result Missing the Street Address .................................................................................................................................................................90
[Link].P.O. Box, Mailing Addresses, and Management Of4ices .........................................................................................................................91
[Link]/POI with Moving Locations ......................................................................................................................................................92
[Link] ...................................................................................................................................................................................................................92
[Link] Type Results .....................................................................................................................................................................................93
8.2.
[Link] IP 93
Result....................................................................................................................................................................................................
o o m
[Link]
78 nda fr ulam 93
Formats ..............................................................................................................................................................................................
1
. 9
[Link] y
5.1 , Result 2
20 sh Gh
Ju ......................................................................................................................................................................................................
8 , 94
7
[Link] n
6.5 Result i
e 2 ...................................................................................................................................................................................................
2 w 94
[Link] 1 b Result ne Ka aza
8, ...........................................................................................................................................................................................
u
Ha Code y 2 J
y, 51 b in R y 95
sna Kaw 021 Result .......................................................................................................................................................................
[Link]/Region/Territory d a . a 95
in
[Link] Result
ish from on .176 asn
Ra ..................................................................................................................................................................................................
M 95 H 95
za Ghu IP
[Link] Without an Expected Address 78.
................................................................................................................................................. 95
lam
[Link] Features ...............................................................................................................................................................................................95
[Link] Without an Expected Address .............................................................................................................................................................97
2
[Link].Minimum Address Component .......................................................................................................................................................................97
IP
[Link].Of4icial Address Present ..................................................................................................................................................................................... 98
ro m m
[Link].No Of4icial Address ............................................................................................................................................................................................
1 f u l a 100
02 Gh
2 8, 2 wish
9. Pin Accuracy ..........................................................................................................................................
Mo 102
[Link] Considerations u ne ..............................................................................................................................................................................
K a za 7 n d 102
J y Ra 8.9 ay,
ay, .51 b ain 5.1 Ju
[Link] Resourcesd....................................................................................................................................................................................................
76 ne
103
[Link] o n
Imagery 1 7 6
vs. Vector
a s n Map ................................................................................................................................................................
. 103
. H 5 1 b 8, 2
[Link] 8.
of95the Feature H 2
............................................................................................................................................................................
y 0 104
7 asn Ka 21
[Link].Half ’n Half and Tennis Rules .........................................................................................................................................................................
ain wis fro 105
Ra h G m I
[Link].Boundaries in Shared Spaces ........................................................................................................................................................................ 107
za hu P
[Link] Door ..........................................................................................................................................................................................................
lam 109
[Link]’t Verify (Smallest Identified Area)........................................................................................................................................................110
[Link] Rooftop .................................................................................................................................................................................................111
[Link] Buildings ...........................................................................................................................................................................................125
[Link] Property with Multiple Buildings .........................................................................................................................................127
[Link] Rooftops ..........................................................................................................................................................................................128
[Link]-Rooftop Rating ...............................................................................................................................................................................129
[Link] Rating ...............................................................................................................................................................................................135
[Link].Single-Complex Campus ..................................................................................................................................................................................137
[Link].Dispersed Campus .............................................................................................................................................................................................140
[Link] Without a Rooftop ......................................................................................................................................................................143
[Link] Features..............................................................................................................................................................................................143
[Link] Divisions ..............................................................................................................................................................................146
[Link] ................................................................................................................................................................................................................147
[Link] Lots and Structures .....................................................................................................................................................................149
[Link] POIs .....................................................................................................................................................................................................150
[Link], Tram, and Streetcar Stops ....................................................................................................................................................................152
[Link] POI with Multiple Rooftops/Platforms .......................................................................................................................................153
[Link] POIs with a Single Rooftop ............................................................................................................................................................156
[Link] Transit Stations ....................................................................................................................................................................156
[Link].How to Establish an Entrance Polygon .....................................................................................................................................................157
[Link].Examples ................................................................................................................................................................................................................158
[Link] to Rate Results ..............................................................................................................................162
10.1.Speci4ic Address ..........................................................................................................................................................................................162
[Link]-Speci4ic Address ................................................................................................................................................................................176
[Link] Address Does Not Exist ..............................................................................................................................................................184
[Link] of Interest ...........................................................................................................................................................................................186
[Link] Multiple Query Interpretations: Beyond Viewport and User Location ...............................................190
[Link] Queries .........................................................................................................................................................................................193
[Link]-Chain Businesses .................................................................................................................................................................................194
[Link] Businesses ..........................................................................................................................................................................................197
[Link] Business with Location Modifier .................................................................................................................................................201
[Link].General Location Modi4ier ...........................................................................................................................................................................201
[Link].Speci4ic Location Modi4ier ...........................................................................................................................................................................209
[Link] Offices and Businesses with no Physical Location ....................................................................................................................213
[Link]/POI does not Exist .......................................................................................................................................................................215
[Link] Queries ........................................................................................................................................................................................ 216
10.7.
[Link] Query with Location Modifier ................................................................................................................................................. IP 216
m
78 nda
[Link] Results for Category Queries ........................................................................................................................................... 1 fro ulam218
.95 y, J 2
20 sh Gh
[Link]
.17 Categories
un ...........................................................................................................................................................................................
8 , 222
[Link] 2 awi
51 e 28 ..............................................................................................................................................................................................
e 223
un by K Raz a
, 2 Parking ...........................................................................................................................................................................
Ha byQuery:
[Link] 0 , J 228
sna Kaw 21 ay 1 in
[Link] Query Types
in fro o nd 176.5 asna
ish..................................................................................................................................................................................... 232
[Link] Queries G m M 95.
Ra ............................................................................................................................................................................................
H 232
hu P I
za
[Link] and “My Location” 78.
lam Queries ................................................................................................................................................. 234
[Link] Results ............................................................................................................................................................................................236
3
[Link] Ra+ng Tips ......................................................................................................................................243
IP
[Link]’s the relevance when query is business/POI name and address and the result is only the address? .......243
ro m m
f l a
[Link]’s the relevance when the query is a street name and the result is a single business on that street? ........243
0 21 Ghu
[Link] do I know what the location intent is when user is outside/inside a fresh viewport?
2
8, wish ......................................244
2
[Link] do I know what the location intent is when user is outside/inside a stale viewport?
Mo ......................................245
u ne Ka aza 78 nda
[Link] full address result does not exist. How do I rate it?
J y R ...........................................................................................................
. y 245
d ay, .51 b ain 95
. 17
,J
u n
n 6 sn 6.5 e 2
Appendix: Release Survey
Mo 95.17 Ha..........................................................................................................................
1 b 8, 247
7 8. H asn Ka 21 y 2 0
ain wis fro
Ra h G m I
za hu P
lam
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
4
1. Introduction IP
ro m m
f la
Welcome to Maps Search Evaluation. 2 0 21 Ghu These guidelines will teach you how to use the evaluation tool
and rate Maps Search results. 8, sh Mo
n e 2 Kawi za 7 n
, u
J by R a 8.9 day,
y
a .5be 1 ain 5.17 thatJu
For each task,oyou
nd 1will 7 6 asnpresented with a search query and the results 6 . nare
e 2 provided to Maps
M . 5 1 8,
users. The goals. 9 of
5 thisH task are: H b
78 asn y Ka 2021
ain wis fro
h
• Search 2.0 and Search Relevance: To determine how well the resultsRsatisfy aza Ghthem user’s
ula IP
query (result relevance) m
• Search 2.0 only: To check the data accuracy (name, address, and pin location) of the results
The information produced from these tasks will be used for evaluation purposes only.
This is the web-based rating tool used to rate Search 2.0 and Search Relevance queries.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
5
Anatomy of the Tool
IP
ro m m
f la
2 0 21 Ghu
Name 28, awish
eScreenshot
Mo
Description
n
Ju by K Raz
a 78 nda
y , .9 y,
a 1
nd 176.5 asna
in The task bar shows: 5.176 June
o
M 95. .51 2
78.
H Ha by K 8, 20
• Task Type: The name ofsnthe aw 21 f
ain task.
i h rom
Ra sthe
• Task ID: A number that identifies
za Ghu IP
specific task item. Use this number lam
Task Bar
whenever you communicate about a
task or rating.
• Test Locale: The country and
language combination this task is for.
6
Name ScreenshotIP Description
m
1 fro ulam
02 Gh The query header shows:
2 8, 2 wish Mo
ne a a Query Locale: The 7countrynd and language
y , Ju by K Raz 8 ay,
combination this query95is. for.
.
a 1 in 17 Jun
o nd 176.5 asna Query: The term the user entered
6.5 e 2into the
M 95. H 1 b 8,
8. search bar. H asn y Ka 2021
Query 7
Viewport Age: How long ago the ain user
wi fr
Header Ra sh G om I
moved the viewport. za hu P
• A fresh viewport is indicated by the lam
word FRESH displayed in green text.
• A stale viewport is indicated by the
word STALE displayed in red text.
7
Name ScreenshotIP Description
m
1 fro ulam User viewport: A transparent purple box
02 Gh
2 8, 2 wish centered over a device Moicon shows the
ne a a user’s viewport at the n
78 time
y , Ju by K Raz .95 dathey, J query was
a 1 in issued (if known). The user. 17 viewport
ond 176.5 asna u
6.5 ne 2
M 95. H represents the map area the user
1 b was
Ha y K 8, 20
78. looking at when making the query. sna aw 21
in i fr
Ra sh G om I
za hu P
The shape of the box may vary depending lam
on the size and orientation of the device
User
being used.
Viewport
Note: In some cases, the user viewport
may be so small that it cannot be seen,
but (if the viewport information is
available) the device icon will always be
visible, regardless of the map scale.
8
Name ScreenshotIP Description
m
1 fro ulam A pin indicates a result’s location. The
02 Gh
2 8, 2 wish head of the pin is onlyMan indicator. The
ne a a on
Ju by K Raz tip marks the actual 7location.
8.9 day,
a y , 1 in 5.1 Ju
ond 176.5 asna 76 ne
.51 2color,
M 95. H Each pin on the map has aHunique by 8, 20
78. a
which matches the color of itsna Kaw 21 f
s
in i r
Result Pin corresponding result heading.(See Ra sh G om I
za hu P
Result, above) lam
Copy to
Click to copy information to a clipboard
Clipboard
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
9
Name ScreenshotIP Description
m
fro ulam
1
02 Gh Click the pin icon at the top right of the
2 8, 2 wish map to place a pin anywhere
Mo on the map.
ne a a 78 nda
y , Ju by K Raz .95 y, J
a 1 in .17 un
ond 176.5 asna 6.5 e 2
M 95. 1
78.
H Ha by K 8, 20
sna aw 21
Drop in i fr
Ra sh G om I
Location Pin za hu P
lam
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
10
[Link] Workflow
IP
r o m m
Complete each step of the following f la
2 0 21 Ghuworkflow before you assign a rating.
e 28, awish Mo
Evaluate and rate each u n
J by rating
K drop-down
a z a independently of the others.
7 8.9 dRate
n
ay, result Relevance based
y , R
on whether thenresult
a
d 6.5 sna fits
1 thei n query intent, even if the result is closed [Link]
17 doesJu not exist or has
ne
o 7 6 .
incorrect Name,
M 9Address,
5 . 1 H a or Pin data. If you are rating Search Relevance you 5 1 bywill8,stop
2 here. If you are
8 . H 2
rating Search 72.0, you will continue by rating Name Accuracy, AddressaAccuracy, sna Kaw 021and Pin
in i fr
Accuracy individually. Ra sh G om I
za hu P
lam
Rate each result on its own merits. Do not demote duplicate or very similar results.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
11
1.3. Rating Interface
IP
ro m m
Your ratings and comments will la
f collected
2 0 21 beG hu in the rating interface pictured below. You will first
answer one top-level question ,
28 awis about
h the query itself, then rate eachMoindividual result using the other
checkboxes and drop-downs. n e a 78 nda
y , Ju by K Raz .95 y, J
d a .51 ain .17 un
on 176 asn 6.5 e 2
M 95. H 1 b 8,
78 . H asn y Ka 2021
ain wis fro
Ra h G m I
za hu P
lam
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
12
1.3.1. Query-Level ‘Navigational IP
o mResult’ Question
1 f ulam
r
202 sh Gh for each query to indicate whether there are any results in the
You will answer a top-level8, question
2 i Mo
ne Kaw azasatisfy the user intent.
real world that would ucompletely 7 n
8.9 day,
y , J by R
a 1 in 5 .17 Jun
ond 176.5 asna 6.5 e 2
M 95. question
Query-level H Explanation 1 b 8, Notes
78 . H asn y Ka 2021
a wis fro
Is there a navigational result Are there any results in the real You willinonly Ra need
h G tom answer
for this query? world that can completely z
this questionaonce huforIPeach
lam
satisfy the user intent? query.
For each result, you will be presented with two high-level questions. These will allow you to highlight
any problems at the result level.
High-level
Explanation Notes
question
Result is not in the language of the If you check this box, your rating for this
Result name/
query, the test locale, or the result query will be complete (all other questions
title is in
region (the expected languages) or is will be unavailable).
unexpected
in a mix of expected and unexpected
language or
languages (unless it is an official
script
company, chain, or brand name).
If you check this box, you will rate only the
relevance of the result as if it did exist. All
other questions will become unavailable,
and your rating will be complete.
Business/POI Research shows that the business is
is closed or closed or that no such business exists
Use thorough research and your best
does not exist at the address listed in the result.
judgement to determine whether the
result is closed, has never existed, or the
result component(s) are [Link]
Unclear Results for further guidance.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
13
1.3.3. Result Relevance Rating
IP
ro m m
The relevance rating will take 2into 1 f consideration
la user intent as well as distance/prominence.
0 G hu
Relevance is always rated8independently
2
, ish of any data (name/classification,
Mo address, or pin)
inaccuracies. This means n e 2 that
a w when
a rating relevance we always assume n that the result exists (even if
, Ju by K Raz 78 da
. 9 y
research revealsdthe
a location
y 1 in is closed) and that the data presented is.1correct.
5 , J
o n 176.5 asna 76 une
.
M 95. H 5 1 b 28,
.
Always rate against H
the real world: If there is a better result available but aitsnis not 20
y K shown,
aw 21 f demote the
7 8
existing result(s) while considering the missing one(s). a in i r
Ra sh G om I
za hu P
lam
Relevance
Explanation Notes
Rating
The most likely result implied by the user’s
query, location, and/or viewport that
completely satisfies the user’s distinct
intent.
A distinct user intent is defined by a A rating of Navigational for one
combination of the following result does not prevent other
Navigational
characteristics: results from satisfying the query to
• Extreme prominence (e.g. Eiffel Tower) a lesser degree.
• Uniqueness (e.g. complete address)
• Proximity (e.g. incomplete address that
points to an unambiguous option that is
is extremely close)
Highest possible initial rating for
A high-quality result that clearly satisfies the
ambiguous queries as well as for
Excellent user’s intent. Multiple results can be
queries that are not eligible for a
considered high quality.
Navigational rating.
Only partially satisfies the user’s intent due
Good
to relevance, prominence, or distance.
Any relevance rating of Good or
Technically satisfies the user’s intent but below will require an indication of
Acceptable
does so poorly due to relevance or distance. the reason(s) for the demotion:
• User Intent Issue
Does not satisfy the user’s intent due to lack • Distance/Prominence Issue
Bad of relevance or great distance (when closer
satisfying results are available).
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
14
1.3.4. Result Relevance Demotion Checkboxes
IP
ro m m
If you give a result a Relevance 21rating
f ulaof Good or below, you will be presented with two checkboxes.
Use them to select the reason(s) 0 Gh
2 8, wish for your rating:
2
Mo
u ne Ka aza 7 n
8.9 day,
, J by R
• User Intent a issue1
y in 5.17 Jun
nd 176.5 asna 6.5 e 2
• Distance/Prominence
o
M 95. H issue 1 b 8,
78 . H asn y Ka 2021
ain wis fro
Checkbox Explanation h
RaNotes m
za Ghu IP
lam
User Intent Select when the demotion is due to a result only
issue partially fulfilling the query intent.
Select when the demotion is due to a distance
issue based on the user or viewport location or If both issues were reasons for
Distance/ when you demoted for a result that is less your relevance rating, select both
Prominence prominent based on the initial query intent. You checkboxes.
issue can also select this option when the query asks
for something at a specific location and the
result is not at or near the requested location.
If you are rating Search 2.0, once you've rated relevance, you will evaluate three result components
for data accuracy: Name, Address, and Pin.
1.3.6. Comments
Comments are mandatory for any result relevance rating of Good or below and for any data issues
not rated Correct/Perfect and should explain the reasons for all rating demotions. Be sure to:
• Include user intent: It’s useful to indicate what you think the user intent is.
• Refer to the guidelines: If the demotion is due to a guideline instruction, note the guideline
section you used to make your decision.
• Include sources: If you find incorrect information in a result, your comment should include
the correct information and its source. Be sure that any links you include lead directly to the
information you provide. If they don’t, include a link to the source you used and explain how to
get to the information from there.
• Use URL shorteners when inserting long links into your comments
• Be concise: Don’t write elaborate comments. Be short and specific.
•M Comment in English: Your comments will sometimes be reviewed or used by people who IPare
onnot familiar with your test locale or its language. Comments in English are understandable o m m
78 da 1 fr ulato
.95 y, J 0 2 h
the
.17 widest
u possible audience. 8, 2 wish
G
6.5 ne 2 e 2
1
Ha by K 8, 20 , Jun by Ka Raza
sna aw 21 ay 1 in
in ish from o nd 176.5 asna
Ra M 95. H
za Ghu IP 78.
lam
15
Issue Expectations
IP Example Rating and Comment
ro m m
The comment f ulaexplain the
0 21should h Relevance -> Good (Distance/
reasoning 2
2
8,behindi s h Gyour rating. A demotion Prominence)
Mo
nedue w a
Relevance mayJbe u y Kato adistance
z from the user’s 78 ndDemoted
Comment:
.95 ay, J -1 for a few closer
y , 1 b in R
Demotions nlocation
d 6.5 scompared
a
na to similar results/ real world1locations
. 76 une in the Middletown/
5 .17 Ha results, secondary intent, or
Mo 9potential AnchorageHarea.51 28
,
b
78. other reasons. asn y Ka 2021
ain wis fro
hG m
Address Accuracy R ->
azIncorrect
hu IP— Street
Include a comment when you rate a a lam
Number
Name, Address, or Pin something other
Comment: Correct street number is: 332
than Correct or Perfect or you give a
Data Issues W El Camino Real, Sunnyvale, CA 94087
rating of Closed/Does not Exist or
Pin Accuracy -> Wrong
Unexpected Language.
Comment: Wrong pin: correct location is:
52.368067, 4.895389
• User location
• User viewport
• Viewport age
User intent refers to the interaction between query, user location, user viewport, and viewport age.
The queries you are evaluating are real queries submitted by users. Because they are real, they can:
• Be misspelled
• Contain mistakes
• Be inconsistent
• Be ambiguous
• Be badly formatted
• Be, or contain, emojis
• Have no maps intent
TheM first IP
on step in the rating process is to make sure you understand the query. o m
fr ulam
78 da 2 1
.95 y, J 20 sh Gh
.17 un 8,
If you see 6.5a foreign-language
e query, do not release the survey. Research the query 2or usei an online
1 b 28, u ne Kaw aza
Ha y K 20translation tool to find out what it means, then rate it as usual.
y, J 51 by in R
sna aw 21 da
in i fr n 6. na
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
16
You will see several types of queries, IP
ro m including:
m
0 2 1 f hula
G
Address queries 2 8, 2 wish Mo
u ne Ka aza 7 n
8.9 day,
y , J by R
Address queries a .51 allaior 5
n part of a complete address, including street
.17 Jnumber,
ondcontain
1 7 6 asn u
6.5 ne 2 street name,
locality, state,
Mcountry,
9 5 . Hand postal code. 1 8
Ha by K , 20
78. sna aw 21
in i fr
Ra sh G om I
Query Explanation za hu P
lam
[717 E El Camino
This is an address query in the form of a full address. It contains a street
Real, Sunnyvale,
number, street name, locality, state and postal code.
CA 94087]
[Stevens Creek
This is an address query for a street. The user is looking for the location of
Blvd, Cupertino
this particular street.
CA]
This is an address query for a country. The user is looking for the location of
[Ireland]
the country of Ireland.
This ambiguous query could refer to New York city or New York state. You
[New York] will find more information on prominence, user location, and the viewport in
the following sections to help you determine the intent of this query.
A point of interest (POI) is a location that people find interesting or useful. POIs can be locally or
internationally known. These guidelines use a very broad definition of POI in which businesses are
also considered POIs.
Query Explanation
[London Bridge] This is a query for a famous POI in London.
[Danube River] This is a query for a river in Europe.
[Charing Cross
This is a query for a transit station in London.
Station]
[Union Square, SF] This is a query for a location in San Francisco.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
17
Business queries IP
ro m m
f la
2 0 21 Ghu
Business queries contain28the , namesh of a specific business. Mo
n e Kawi za 7 n
, u
J by R a 8.9 day,
a y 51 in 5.1 Ju
Queryond .176. asna Explanation 76.5 ne 2
M 95 1
78.
H Ha by K 8, 20
This is a business query with a location modifier n(Palo 2
s ain aAlto).
wis 1 fThe user is
[Zola Palo alto] h G rocan
looking for a specific restaurant (Zola) in Palo Alto, [Link] hu IPinclude
aza m
location modifiers, like city names, that make them more specific. lam
This is a business query with a request for a specific store in Sunnyvale, CA.
[Bookasaurus] The viewport and user location can help pinpoint the desired location for
such a query.
[Starbucks, 7 This is a query for a chain business followed by a specific address. Chain
Boulevard businesses are businesses that have more than one location, and include
Poissonnière, everything from national chains, like Starbucks, down to small local chains,
75002 Paris, like Burrito Boyz. Target, Auchan, Albert Heijn, and Boots are all chain
France] businesses.
This is a business query with a request for the chain business Target and
[Target sunnyvale]
location modifier of Sunnyvale, CA.
Category queries
Query Explanation
This query is for locations where fast food is served. Assume the user
[fast fod] wanted the correct version of the query when the actual query contains a
simple misspelling.
[bus stop] This query requests the locations of bus stops.
[coffee] This query requests the locations of businesses that sell coffee.
[gym] This query requests the locations of fitness centers.
[gas San This query requests the locations of gas stations with a location modifier
Francisco] of San Francisco.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
18
Coordinate and “My location” queries
IP
ro m m
Some queries are simply a set f ula
2 0 21of coordinates
Gh
or the words ”my location” (or something similar).
28 , is h Mo
Query ne Kaw aza Explanation n
u
J by 7 8.9 day,
y , 1 ain R 5
[36.082857, a
nd 176.5 aThe .17 Jun
o s n user has specified a location using lat/long 6coordinates.
.51 e 28
M 95.
-115.172916] H b ,
78 . H asn y Ka 2021
wi
ain where fro are.
[my location] The user has typed these (or similar) words to find out Ra sh Gthey
m
za hu IP
lam
Emoji Queries
Some queries are not made using words. Emojis represent the category they picture. Use the most
literal meaning.
Query Explanation
Research will help you understand the user’s query and intent:
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
19
IP
ro m m
2.2. Result Types f la
2 0 21 Ghu
e 28, awish Mo
A query can return one Ju of
n
ythree
K atypesza of results. 78 nda
y , 1 b n R .95 y, J
d a .5 a i .17 un
M on .176 asn 6.5 e 2
Result Type8.9 5 H Explanation 1 b 8,
Ha Example
y 2
7 sna Kaw 021
in i fr
Businesses and POI type results Ra sh G om I
za hu P
will show a name in the top field, lam
followed by an address and a
Business/POI
classification. The same rating
rules will apply to both Business
and POI results.
These results can be one of
multiple address types, including
residential address or locality.
Instead of a business or POI name,
this kind of result will show the first
line of the address in the top field,
followed by the entire address
Address below. This type of result will not
include a classification.
20
Result Type Explanation
IP Example
r o m m
This result02for ula
1 f a hlandmark square
2 G
might2be 8 mistaken
, is h for a result Mo
ne Kto
referring
u aw a zstreet
a with the same 78 nda
y , J 1 by in Ra .95 y, J
nd name. 5 Since it contains a
a .17 un
76. asna
Mo 95.1classification,
6.5 e 2
H in this case “Park,” 1
Ha by K 8, 20
78. you can see that it actually refers to sna aw 21
in i fr
a POI. Ra sh G om I
za hu P
lam
A result is considered most relevant when it is located in the user’s area of expected results. There
are two types of Location Intent:
• Explicit: The query is made clearly and indicates a specific location or area where results are
expected.
• Implicit: The location expectation is not as clear, so you must use context clues, in the form
of user location and viewport, to discover the area in which the user is expecting results.
When there is an explicit location mentioned in the query, you can ignore the user and viewport
locations. The user has told you exactly where they want to see results. If the query contains words
like “near me” or “nearest,” the user’s location, not the viewport location, should be considered the
explicit location intent.
21
2.3.2. Implicit Location
IP
ro m m
If the user’s location intent is not f expressly
21 G
la stated in the query, for example [chinese] or [479
0 hu
margarita ave], use the user 8, location,
2 sh viewport location, and viewport
Mo age to determine the area of
expected results. n e 2 Kawi za 78 nda
y , Ju by R a .95 y, J
Viewportonda 76.51 snUser ain Location .17Intent
u
6.5 ne 2
M 95. 1 a 1
78.
H Ha by K 8take
When the user is within a fresh viewport,
,2
sna aw 021the user
location as location intent. Results areingenerallyfro
Ra sh G expected in
i m
Inside Viewport z h I P
or near the viewport, and results inside theaarea cannot
ula be
m
rated Bad because of distance alone.
Fresh Results are expected in or near the viewport area. All relevant
Outside results inside the viewport are eligible for a rating of
Viewport Excellent. If no results can be found in or near the viewport,
consider the user location a secondary location intent.
Missing When the user is missing, the viewport is the location intent.
Inside Viewport
When the viewport is stale, consider only the user location as
Outside location intent.
Stale Viewport
Use the stale viewport as location intent when the user
Missing
location is missing.
Viewport Age Present or
Consider the viewport fresh when the viewport age is missing.
Missing Missing
The user location sets the location intent when the viewport is
Present
not present.
Missing entirely When the user location and viewport are missing, the test
Missing locale becomes the location intent with a strong focus on
prominent results.
You M
will answer this question before you rate any results, since you don’t need to know what theIP
m
o
results
78 nared a in order to learn if there’s a real-world result that could fully satisfy the user’s intent:1 fro ulam
.95 y, J
.17 un 8, 202 sh Gh
6.5 ise 2 i
• If there 1 b 2a8,real-world navigational result for the query, answer Yes u ne Kaw aza
• If H asn yare
there 20 possible real-world navigational results for the query, answer
Ka no 21 a by n R
y, J 51No
d . i
ain w ish from o n 176 asna
Ra Gh IP M 95. H
You will answer this za question
ula once for each query. 7 8.
m
22
4. Rating Result-Level Issues
IP
m
1 fro ulam
For each result, you must check 02 to Ghsee whether:
2 8, 2 wish Mo
ne Ka aza 7 n
8.9 day,
• There is an yissue
, J with
u b y the R language/script of the result name/title
5
a 1 ain .17 Jun
ond 176.5 asis
• The business/POI n closed or does not exist 6.5 e 2
M 95. H 1 b 8,
78 . H asn y Ka 2021
[Link] Name/Title in Unexpected Language or Script ain wis fro
Ra h G m I
za hu P
A result name or title is in an expected language or script when it is: lam
When all or part of a result name or title is in an unexpected language or script, users will not
understand it. In these cases, select the Result name/title is in unexpected language or script
checkbox. No further rating is required.
Note: When the address details, found below the name/title, are in an unexpected language or script,
the result can still be understood and rated for relevance and name accuracy. For more on what to do
when the address details (not the name or title) are in an unexpected language or script, see
Language/Script Issue in Address.
Below Left: Result name is Atlantic Casino Resort (in red box), address details are below (in blue box).
Below Right: Result is an address, so the first line of the address appears in the red box as the Address title. All the
address details appear below it in the blue box.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
23
P
Minor Differences in Spelling om I m
f r la
2 0 21 Ghu
Don’t consider minor spelling 8, issues,
sh such as missing or added diacritics
Mo (e instead of é), as
n e 2 Kawi za n
Unexpected Language/Script. u
, J 1 by in Ra This also applies to unnecessary
7 8.9 ay, relevant parts of a name or
or less
d
title. Use this checkbox y 5.1 Ju the name/title and
nd 176.5 aonly na to report issues that interfere with understanding
a 76 ne
o s .51 28
those listed in
M your
. 9 5 . Country
H Specific guidelines. H b ,
7 8 asn y Ka 2021
ain wis fro
4.1.1. Name of Business/POI Results Ra h G m I
za hu P
lam
Pay special attention to the language and script of brand and chain names. See your Country
Specific guidelines for more information.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
24
Expected Language Explanation
IP Example
ro m m
1 f hula of the test locale
The 0language
2
, 2 ish G considered an Expected language/script:
is
2 8generally • TestMlocale:
78 nda es_ES
w
ne expected
a za language and script. o
J u y K a
ay, .51 b ain
R • Result
. 95 in California,
.
y, J USA
d
n 176 asn 17
• Query: [college] un
o 6 .51 28e
M 95. H If the query is so short that the by , 20 Skyline
8. • Result name:
H asn Colegio
7 language cannot be identified, K 2
ain awis 1 fro
assume that the query language R hG mI
The result name is inaSpanish,
za hu which
P
is that of the test locale. l m
matches the language of the atest locale,
so this result title is expected and
Test Locale When the test locale and the
acceptable.
and query locale differ, consider the
Query Locale query locale an expected
Unexpected language/script:
language, as it provides more • Test locale: en_US
detailed information. • Result in California, USA
For example, here the Query • Query: [college]
Locale is set to English in • Result name: Colegio Skyline
Indonesia. Therefore English,
not Indonesian, is an expected
“Colegio” is in Spanish, but the test
language:
locale is in English, so the result title is in
• Query Locale: en_ID
an unexpected language.
• Test Locale: id_ID
Expected language/script:
• Test locale: en_US
• Result in Rio de Janeiro, BR
• Query: [beach]
• Result name: Praia de Copacabana
Result satisfies the category “beach” and
the result’s name is in Latin script and the
Portuguese language, which is the
language of Brazil.
The language/script of the
Result region result’s region is expected as
Unexpected language/script:
the result language. • Test locale: en_US
• Result in Rio, BR
• Query: [beach]
• Result name: Playa de Copacabana
Though the result name is in the same
script as the test locale and query
language, returning the name in Spanish IP
Mo is unexpected language becausefrthe om lam
78 nda
.95 y, J
.17 un
language of Brazil is Portuguese.
, 2 021 Ghu
6.5 e 2 e 28 awish
1
Ha by K 8, 20 , Jun by K Raza
sna aw 21 ay 1 in
in i fr o nd 176.5 asna
Ra sh G om I M 95. H
za hu P 78.
lam
25
Expected Language Explanation
IP Example
ro m m
f la Expected language/script:
2 0 21 Ghu
8, sh • TestMlocale: ar_SA
n e 2 Kawi za o
78 nda in Riyadh, SA
• Suggestion
y , Ju 1 by in Ra .95 y, J
a
nd 6.5 na • Query:.1[]ماكدونالدز
76 une
Mo 95.17 Has .51 28
• Result name:
78. Ha bMcDonald's
y ,2
sna Kaw 021
in i fr
Ra sh G oismin
The name of this restaurant
za hu IPthe
Any official brand, chain , or language of the official brandlaname.
m
business name in the language
of the suggestion’s region or Expected language/script:
the official brand name • Test locale: ar_SA
commonly used in the market, • Suggestion in Riyadh, SA
even if it is not in the language • Query: []ماكدونالدز
of the query, test locale, or • Result name: []ماكدونالدز
Brand, chain, and
result region, is expected.
business names
The name of this restaurant is in the
In bilingual areas, official
language of the region
names in any of the languages
of the area are expected,
Unexpected language/script:
unless otherwise specified in
• Test locale: ar_SA
the Country Specific
• Suggestion in Riyadh, SA
Guidelines.
• Query: []ماكدونالدز
• Result name: [マクドナルド]
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
26
4.1.2. Title of Address Results
IP
ro m m
Unlike business/POI results, address 21 Ghu results do not have an actual name. Instead, the first line of the
f la
address appears as the title. 0
Rate Result name/title is in unexpected Mo Language or Script when
2
28, awish
the title (first line of the n eaddress) ais in an unexpected language or script.
78 nda
y , Ju by K Raz .95 y, J
d a .51 ain .17 un
n 176 asn 6.5 e 2
Localized and o
M 95. Non-Localized
H Components 1 b 8,
78 . H asn y Ka 2021
Address results can often not be translated and are accepted in the originalaversion in wishoffthe
rom result
Ra G
location. Some features, however, are translated into the test locale’s language, especially za hu Ifor
P
lam
bilingual or English-speaking areas. Although the preferred language is the test locale’s language, the
query language and language of the result’s location are also accepted.
• City
• State
• Country
Appropriate localization depends on the result itself and the language it is translated into. Research
and local knowledge will help you decide if the translation has been done appropriately.
Use the Address Accuracy Incorrect – Language/Script Issue checkbox if you find issues of this
nature in any of the address components in the address details (not the address title) of any result.
Use this checkbox when, after careful research you determine that a result is:
• Closed/non-existent
• Randomly moving (like a food truck without a fixed schedule)
• A non-recurring past event with no further significance that does not carry any map intent
If you rate the result as Business/POI is closed or does not exist, you must still give a relevance
rating as if the place were open or did exist.
Remember, this rating can only be applied to business or POI results, not to address type [Link]
Mo m
78 nda 1 fro ulam
.95 y, J
.17 un 8, 202 sh Gh
6.5 e 2 2 i
1 b 8, u ne Kaw aza
Ha y K 20
sna aw 21 da y, J 51 by in R
in i fr n 6. na
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
27
Use this checkbox to indicate a POIIhas P closed only if there is evidence to prove the business
indicated in the result is no longer ro moperational.
m
0 2 1 f hula
When you can’t make a decision G
2 8, 2 wish about business closure due to lack Mo of resources, assume the
business could existuand ne rate a thea name, address, and pin accuracy
78 as ndCan’t Verify (unless there is
, J by K Raz . 9 ay,
an obvious datadaissue
y
. 5 1likeaainmissing mandatory address component .or 5 1 a pinJu in the ocean).
o n 176 asn 7 6 ne
M 95. . 5 1 2
8. H H by 8, 20
7 asn Ka 21
Note: Businesses and POIs can close for construction, remodeling, vacations, ain orwother
fro
Ra sh G reasons. Treat
i m
all temporarily closed businesses as if they were open when the closure is announced z a h I P
ula on the
m
business/POI webpage or managed social media page. There is no limit to how long the closure can
be.
If you select the Business/POI is closed or does not exist checkbox, you must still rate the result
Relevance as if the business/POI did exist. Never automatically demote to Bad. Use your best
judgement to determine how well the result satisfies user intent within the area of expected results.
5. Relevance
Relevance for each result is found by assessing the relationship between:
Complete each step of this workflow before assigning your relevance rating.
• Rate each result individually and demote based on relevance and distance.
• Always rate against the real world: If there is a better result available but it is not shown,
demote the existing result(s) considering the missing one(s). IP
Mo m
7•8 nIgnore the order of the results and evaluate each one individually. o
fr ulam
. da 2 1
• 5Ignore
9 y
.17 , Junduplicate results and rate them individually. Do not demote for repetition. 8 , 20 sh Gh
• If there
6.5 are 2 awi content
1 b 28,results that are extremely inappropriate or illegal, rate Bad. Identifyne such
e
u y K aza
byHdetermining
asn y Ka 2021if the result is likely to be embarrassing if seen by users. , J b R
ain wis fro n day 6.51 snain
Ra h G m I Mo 95.17 Ha
za hu P 78.
lam
28
Rate the relevance of each resultIPwithout considering the accuracy of the name/classification,
m
1 fro ulam address, or pin.
When judging 2 0 2 Gh
distance/prominence, ignore closed or non-existent results.
2 8, wish Mo
u ne Ka aza 7 n
8.9 day,
y , J by R
a 1 in 5.17 Jun
ond 176.5 asna 6.5 e 2
M 95. H 1 b 8,
78 . H asn y Ka 2021
ain wis fro
Ra h G m I
za hu P
lam
Adult Content
For a result to satisfy a query to any degree, there must be some kind of relationship between them. IP
Mo m
Your first
78 nda task is to understand what this connection is. o
fr ulam
.95 y, J 2 1
.17 un 8 , 20 sh Gh
[Link]
51 user e 2 Kawi za
e 2 intent is only the first step in the rating process and covers the minimum
8 n
Ha bfor
requirements y , 202 to be considered relevant. u Ra
sna Kaawresult
J y
1f day, .51 b ain
in i r n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
29
5.1.1. General Connection
IP
ro m m
A result can satisfy user intent21for f multiple
la reasons, but most often the result satisfies the most
0 G hu
specific part of the query’s 8, intent.
2 sh This kind of relationship between Moquery and result is called a
General Connection. n e 2 Kawi za 78 nda
y , Ju by R a .95 y, J
d a .51 ain .17 un
on 176 asn 6.5 e 2
M 95. H Type of 1 b 8,
User Query78 . Result H asn y Ka 2021
Description
Connection ain wis fro
Ra h G m I
za to
Satisfies Intent: Users are likely P
hu start
lam their
San Francisco search with the name of the brand “Marriott”.
[marriot] Marriott Union General Result satisfies user intent by providing a
Square Marriott close to a user/viewport located in the
San Francisco area.
Satisfies Intent: The user is looking for an
[Houston George Bush
General airport in the city of Houston. This is an airport
airport] Intercontinental
in Houston, which satisfies user intent.
Satisfies Intent: The query contains two
[london, different cities, so it’s likely a routing query.
London General
brighton] Returning either of the individual results is
expected and should be rated Excellent.
The query is an abbreviation or alternate name and the result provides the full and currently accurate
name.
Type of
User Query Result Description
Connection
Newark Liberty
Satisfies Intent: The international airport code
[ewr] International Abbreviation
for Newark Liberty International Airport is EWR.
Airport
Alternate Satisfies Intent: The result is the correct name
[sears tower] Willis Tower
Name of what was formerly known as the Sears Tower.
The query is a category and the result satisfies that specific category, which may or may not be
displayed
Mo within the information provided in the result. IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un Type of 8,
User Query
6.5 e 2 Result Descriptionne 2 Kawi za
1 b 8, Connection
Ha y K 20
sna aw 21 a y , Ju 1 by in Ra
fr nd 6.5 asna for "food"
Satisfies Intent: A category
Mo 95.17 search
in i
Ra sh G om I H
[food] P
za LahuCiccia Category .
in a viewport over San78Francisco returns an
lam
Italian restaurant there.
30
5.1.4. Spell Correction Connection
IP
ro m m
The query is misspelled and the 21 result
f ula corrects that issue. This kind of connection only applies to
obvious issues when no result 0 Gh
2 8, wifor
2 sh the actual query exists at the user’s
Mo location or when the user intent
is clearly satisfied by uthe ne spell-corrected
a a results. 78 nda
y , J by K Raz .95 y, J
d a .51 ain .17 un
n 176 asn 6.5 bute the
This kind of correction
o
M 95. Halso happens when a query address does not exist 1 b 28, result address
does, correcting .
7 the issue and creating a match.
8 H asn y Ka 2021
ain wis fro
Ra h G m I
za hu P
Type of lam
User Query Result Description
Connection
Spell Satisfies Intent: The result corrects the user's
[aple store] apple store
Correction spelling mistake.
Satisfies Intent: This query suggestion for the
Spell
Lodz Łódź Polish market adds the diacritics the user may
Correction
have missed when typing the query.
Satisfies Intent: When there is no "Clair St"
[23 Clair 23 Clair Spell within or around the viewport/user, consider a
street] Boulevard Correction “Clair Boulevard" that is close to the viewport/
user as the most likely intent.
The result satisfies the transit intent of the query. If the query indicates a specific transit system, the
result must match that system. There is also a transit intent connection when a station provides
access to more than one transit service and the queried one is included.
Type of
User Query Result Description
Connection
Satisfies Intent: Result satisfies user intent by
Richmond BART Transit providing a close station that runs the requested
[bart]
Station Intent transit service for a user/viewport located in the
Richmond area.
Always consider the specific language conventions. In general, user intent is satisfied when:
Mo IP
o m
7•8 nThe query contains a special character and the result is a valid variation (if applicable). fr ulam
.95 day, J 2 1
20 shaddsGh
• The.17 query
un does not include a special character but the result with special characters 8,
6.5 toethe 2 i
value 1 2 user and is therefore considered spell corrected. ne Kaw aza
Ha by K 8, 20 u
y, 51 by perceived
J R
• The scountry
na aw or21language does not have the special character and it isdgenerally
a . ain as
i i f r n 6 n
a form of n Rexpression
sh om or style (like “café” in English). o
M 95. 1 7
H a s
aza Gh IP 8.
ula 7
m
31
User Query Result IP Type of Description
m
ro laConnection
m
f
2 021 Ghu
8 , sh Satisfies Intent: "oe"
Mo is a valid variation for the
e 2 Kawi za Special n
[möllersdorf] Moellersdorf
u n special character
7 8.9 ay, the country/language of
"ö"
d in
y , J 1 by in Ra Characters 5.1 Ju
a
nd 176.5 asna the result (Germany/German).
76 ne
o
M 95. .51 28
. H H b ,
7 8 asn y Ka 2021
5.1.7. Address-Result Connection ain wis fro
Ra h G m I
za hu P
When a query address and a result address are not exactly the same, the kind of connection lam they
have depends on their relationship:
• Street number is the same in both query and result but the unit number is different or missing:
• If neither address is a street extension, rate result relevance Good when:
▪ The query contains a unit number and the result does not.
▪ The result contains a unit number and the query does not.
▪ The query contains one unit number and the result contains another.
• The query is full address including street number and name and the result is the street name
only:
• Since this result is an unlikely secondary intent, rate relevance as Acceptable.
• Query is for a street [Main Street, Pleasanton, CA] result is just the locality (Pleasanton, CA).
• Rate the result relevance Bad as it does not satisfy the user intent.
Type of
User Query Result Description
Connection
33
5.2. Satisfying User Intent
IP
ro m m
The user’s intent can be determined f la
2 0 21 Ghuby considering the query, the user’s location/viewport, and your
local knowledge. Sometimes 8, queries
sh are ambiguous or can have multiple
Mo interpretations.
n e 2 Kawi za 78 dan
y , Ju 1 by in Ra .95 y, J
In order to determine
d a
n 176 asn .a5 query’s
a primary and secondary intent, look at the
.17 relationship
un between the
o 6 . e
query and theM result.
95. Ask H yourself: 5 1 2
78. Ha by K 8, 20
sna aw 21
in i fr
• Is there a logical relationship between the query and the result? Ra sh G om I
• How likely is the user to be looking for this result given the query and the location za P
hu intent?
lam
For any Relevance Rating of Good or below, you must select the appropriate check box(es) to
indicate the reason(s)for demotion: User Intent and/or Distance/Prominence. If both reasons apply,
use both checkboxes.
34
Satisfying the user intent is only theIPfirst step in the rating process and covers the minimum
requirements for a result to be considered m relevant. The rating determined by deciding how well
1 fro ulam
intent is met is called the Initial 0 2 Rating.
Gh Distance and prominence will be considered next in order
to establish the final rating. 2 8, 2 wish Mo
u ne Ka aza 7 n
8.9 day,
y , J by R
a 1 in 5.17 Jun
ond 176.5 asna 6.5 e 2
M 95.
5.3. Prominence H 1 b 8,
78 . H asn y Ka 2021
ai wi fro
Once you’ve made an initial rating by establishing that there is a relationship nbetween Ra sh G the m query and
za hu IP
the result and determining the intent type, consider the result’s prominence. lam
The prominence of a feature refers to its popularity, including the number of people visiting and media
sources referencing it. Prominence can vary based on the test locale and even local knowledge.
Consider the following list to get a general idea how to establish prominence, ordered from the most
prominent to the least prominent:
A result that may not directly appear to be user intent can be promoted for being internationally
prominent.
35
Query ResultIP Rating and Explanation
ro m m
f la Relevance Navigational
0 21 Ghu
Agra 8, ish
2
Mo
2 aw Query is for a7small
Uttar
ne Pradesh, a India n locality in India and the result
J by K Raz
u 8.9 day,
satisfies the user
a y , 1 in [Link].
17 Jun
ond 176.5 asna 6.5 e 2
M 95. Relevance 1 b 8(User
78.
H HaGood y ,2 Intent)
sna Kaw 021
in i fr
[Agra] Ra sh G om I
za hu P
lam
Result is for a prominent site in the queried
Taj Mahal locality. The Taj Mahal does not satisfy the user’s
Agra, Uttar Pradesh, India primary intent. However, it is promoted to
secondary intent due to the international
prominence of the feature in the queried locality.
Relevance Navigational
Japan The country of Japan is clearly the user’s
primary intent.
[japan]
Relevance Bad (User Intent)
(User is in
Seattle) Sarku Japan
401 NE Northgate Way A chain restaurant with “Japan” in its name does
Seattle, WA 98125 not satisfy the query’s primary intent (the
country of Japan) or any secondary intent
(entities with international prominence).
[Link]
Generally, the farther away the result is from the area of expected results, the less desirable it
becomes. This is especially true for queries highly driven by distance to the user/viewport, such as
chain businesses, hospitals, pharmacies, or grocery stores.
Because the user can be offered many possible results that are all very similar, the closest entities
providing the expected service can be considered the best options. Results which are farther away
are less relevant and should be demoted according to their additional distance. Defining what is close
and what is far depends on the context of each individual query. Factors affecting distance include:
Mo IP
• Number of possible results in the real world o m
78 nda 1 fr ulam
• 5Distribution
. 9 y
.17 , Jun of all possible results ,
2
20 sh Gh
• Population
6.5 e 2 density (rural, urban, or suburban) 2 8 i
1 b 8, u ne Kaw aza
Ha y K 20
sna aw 21 da y, J 51 by in R
Distance refers in to the
i direct
fr distance from one point to another and is measured
n . anstraight
6via a line.
Ra sh G om I Mo 95.17 Has
There is no need tozaaccount hu for P the actual distance required to travel from 8one
7 . point to the other, such
lam
as driving distance.
36
Viewport IP Location Intent (see section 2.3.2)
ro m m
f la
2 0 21 Ghu
8, sh Mo
n e 2 Kawi za 78 nda
a y , Ju 1 by in Ra .95 y, J
nd 6.5 na .17 un
When the user is within 6.5 a fresh
e viewport, the
Mo 95.17 Has 1 28, as the location
user’s location should Ha bebyused
78. K 2021
intent. All ratings madesnshould
ain awibe based
f on the
h G rom
Ra sSuggestions
user’s location in this scenario. za hu P I
inside the fresh viewport cannot be rated lam Bad for
distance alone.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
37
Viewport IP Location Intent (see section 2.3.2)
ro m m
f la
2 0 21 Ghu
8, sh Mo
n e 2 Kawi za 78 nda
a y , Ju 1 by in Ra .95 y, J
nd 6.5 na .17 un
6.5 e 2
Mo 95.17 Has 1 b 8,
78. H
When the viewport isastale,
sna Kwhether
y 20
aw 21 f
the user is
inside or outside of the viewport,
in i consider
Ra sh G
r om only
the user as the location intent. za hu IP
lam
Note: Use the stale viewport as location intent
when the user is missing.
Once you’ve decided how relevant the result is based on user intent, consider the result in the
context of all possible results in the real world. Use the distance to the user or viewport and the
prominence of the result to decide if a demotion should be applied.
A result’s fit to user intent, prominence, and distance should all be relative to the query and the
context around the query. Before deciding whether to demote because of prominence or distance, it’s
important to look at:
38
5.6. Many Possible Results
IP
ro m m
Some queries, like [starbucks], f ulamany results that could satisfy the user. In cases like this,
2 0 21 haveGh
distance is more important 2 8, than i s hprominence, so results that are closer
Mo to the user’s location/viewport
e a w a
should be rated higher Ju than
n
y K results
az that are farther away. To illustrate
78 nthe high density of Starbucks,
y , b R .95 day, J
possible resultsndare
a shown 1
6.5 na as
i n purple dots. . 17 un
6.5 e 2
Mo 95.17 Has 1 b 8,
78 . H asn y Ka 2021
User Inside Fresh Viewport
ain wis fro
Ra h G m I
When the user is inside the viewport, consider all possible results, including real-world za P
huresults
lam not
returned for rating (purple dots), and demote by distance from the user.
Relevance Excellent
⑤ Starbucks
IP
Mo 140 Mason o m
78 nda Rate Excellent for Starbucks locations1that fr are lamin
.95 y, J Street 2 h u
.17 un
2 , 20 isare
close proximity to the user, even if8they hG
6.5 e 2 outside the viewport. e w
1
Ha by K 8, 20 , Jun by Ka Raza
sna aw 21 ay 1 in
in i fr o nd 176.5 asna
Ra sh G om I M 95. H
za hu P 78.
lam
39
User Outside Fresh Viewport
IP
ro m m
When a user is outside the viewport, f la
2 0 21 Ghu results are expected in or near the viewport. In cases where
there are a large number2of 8, possible
sh results inside the viewport, even
Mo if they are not returned for
n e Kawi za n
rating (purple dots),, Jrate
u bBad
y for
R a those outside it. 7 8.9 day,
a y 1 in 5.17 Jun
ond 176.5 asna 6.5 e 2
M 95. H 1 b 8,
78 . H asn y Ka 2021
Query and Screenshot Result Rating and Explanation
ain wis fro
Ra h G m I
z hu P
Relevance Excellent a lam
① Starbucks
865 Market Rate any Starbucks within the fresh viewport
Street Excellent when the user is outside the viewport.
[starbucks]
Relevance Excellent
User in Alameda with fresh ② Starbucks
viewport in San Francisco, CA 170 O’Farrell St Rate any Starbucks within the fresh viewport
Excellent when the user is outside the viewport.
Relevance Excellent
③ Starbucks
264 Kearny St Rate any Starbucks within the fresh viewport
Excellent when the user is outside the viewport.
40
IP
ro m m
f la
2 0 21 Ghu
8, sh Mo
n e 2 Kawi za n
5.7. Few Possible ,Results
u
J by R a 7 8.9 day,
a y 1 in 5.17 Jun
o nd 176.5 asna 6.5 e 2
When the query
M 9has5. onlyH a few results in the real world, be more lenientHwhen1 b considering
8, distance.
. 20
y K [zara]
Because there78are only a few Zara clothing stores in Miami, results for theasquery
na aw 1 fr 2 are demoted
more leniently for distance than the many Starbucks locations in the example above.i n i s o
Ra h G m I
za hu P
lam
Query and Screenshot Result Rating and Explanation
Acceptable (Distance/
Relevance
Prominence)
⑤ Zara IP
Mo 7535 N Kendall o m
78 nda 1 fr ulam
.95 y, J
.17 un Dr, Miami The Zara store is located significantly 2
20 furtherGh
8, i s h
6.5 e 2
1 away than the second closest storesne Kaand
2 w ais
Ha by K 8, 20 therefore rated Acceptable. y Ju
, 1 b in Ra
y z
sna aw 21 a
in i fr nd 6.5 na
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
41
IP
r o m m
5.8. Few Possible Results and f ula
2 0 21 Greater
Gh
Distance
,
28 awis h Mo
Leniency on distance u neacceptable
is K a z a when there are only a few possible
7 8.9 dresults
n
ay, for the query in the
y , J by R
requested [Link] a example,
d 6.5 sna 1 i n a user close to Berlin queries for [Wartestraße],
5. 17 un which is a street
J
o 7 6.5 e 2
name. ThereMare9only 5. four
1 H streets in Germany called “Wartestraße” thatHcan
a 1 bsatisfy
8, the user’s intent
78 . 20
yresults,
and all four streets are returned as results. Because of the limited numberasof na aw 21each
K result’s
i i fro
relevance remains fairly high even over longer distances. n s
Ra h G m I
za hu P
lam
Query and Screenshot Result Rating and Explanation
[Wartestraße] Relevance Excellent
User and
① Wartestraße, Wartestraße in Gransee is the closest to the
fresh viewport close to Berlin, Gransee user and viewport and is therefore the most
Germany relevant.
Relevance Good (Distance/Prominence)
② Wartestraße, Wartestraße in Siegen is far away from the
Siegen user, but is the second closest possible result.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
42
5.9. Rural Areas IP
ro m m
f la
2 0 21 Ghu
Results are often farther 2away8, wiin sh rural areas, but can still be considered Mo relevant if there are no
reasonable results close e a
Ju btoy Kor Rwithin the fresh viewport. In a rural 7area,
8.9 dgenerosity can be applied to
n az a n
, ay,
ratings with respect
a y to distance.
1 i n The criteria for rating are similar to the
5. [zara]
J example in the Few
ond 176.5 asna 17 un
6 . e
possible results
M 9section,
5. H but with an emphasis on distance. Here is an example 5 1 2for the query
78. Ha by K 8, 20
[american legion] in North Dakota. sna aw 21
in i fr
Ra sh G om I
za hu P
Query Result Rating and Explanation lam
Relevance Excellent
① American
Legion This result is closest to the user
based in Bismarck, ND.
[american legion]
Relevance Good
② American The second-closest result is
Legion significantly further north than the
closest result.
Relevance Acceptable
Relevance Acceptable
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
43
5.10. Location – User Intent Deviation
IP
ro m m
When the location intent and user f ula do not allow for a clear result (because either the user
2 0 21 Gintenth
viewport are in an atypical 2 8,location,
i s h like the middle of the ocean), rate Mo with a focus on high
e a w a
prominence. For example, Ju by the
n K query az [Hong Kong] in a test locale78setnto en_US with the viewport and
y , R .95 day, J
user location arounda Naples,
nd 176.5 asna
1 i n Italy. There is no real change in rating if the
. 17 user un is inside or outside of
o 6 . e
the viewport,Mor [Link] viewport
H is fresh or stale. 5 1 b 28,
78 . H asn y Ka 2021
ain wis fro
Query and Screenshot Relevance Rating Ra h G m I
Explanation
za hu P
lam
[Hong Kong] The most prominent result is the
Navigational
territory of Hong Kong in Asia.
User and
Fresh Viewport close to Naples, Italy Businesses/locations with the same
name that are within the viewport or
Excellent
close proximity to the user and
prominent.
Good/
Locations that are farther away from
Acceptable
the user and less prominent should
(Distance/
be rated more Good/Acceptable.
Prominence)
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
44
5.11. Rating for User Inside and Outside Viewport
IP
ro m m
The following two examples show f uladifferences in rating when a user is inside and outside a fresh
2 0 21 Gthe h
viewport. The query is for28a, chain i s h business called Great Wolf Lodge Mofound across the United States.
e a w a
The examples show Jall u possible
n
y K Razresults within and around the large 78 viewport.
nd
ay,
y , b . 9 5
d a .51 ain . 17
Ju
ne
o n 176 asn 6 .
When the user
M is95outside
. H the fresh viewport, no result within the viewport is 5 1 bdemoted
28
, for distance.
7 8. H asn Ka 2021
y
ain wis fro
h
Query and Screenshot Result Rating andRExplanationaza Gh m IP
ula
m
Relevance Excellent
① Great Wolf Lodge
Atlanta The result is within the viewport and
fulfills the primary user intent.
[great wolf lodge] Relevance Excellent
② Great Wolf Lodge
User in Savannah outside large, Charlotte The result is within the viewport and
fresh viewport fulfills the primary user intent.
Relevance Excellent
③ Great Wolf Lodge
Williamsburg The result is within the viewport and
fulfills the primary user intent.
Relevance Good/Acceptable
(Distance/Prominence)
45
When the user is inside the fresh oviewport,IP the user's location is used as location intent and results
r m m
a
are demoted for distance. 021 f hul
G
2 8, 2 wish Mo
u ne Ka aza 7 nd
[Link] ay, and Explanation
Query and Screenshot
y , J by
a .51 ain
R Result 9 5 Ju
d
n 176 asn . 17 ne
6
o
M 95.
. H ① Great Wolf Lodge Relevance H
. 5 1 28
byExcellent
,
7 8
Atlanta asn Ka 2021
This result is amongst ain withe fro
Ra sh Gclosest
m
possible to the user and ula IP the
za is hinside
viewport. m
46
5.12. Partial Address Does Not Exist
IP
ro m m
Relevance is always rated independently f la of any data (name, address, or pin accuracy) issues the
2 0 21 Ghu
result may have. This includes 8, results
sh for addresses that do not exist
Mo in real life.
n e 2 Kawi za 78 nda
y , Ju by R a .95 y, J
When judging distance
d a .51for aexisting
n 176 asn
i n addresses do not factor in any returned
.17 unon-existent
ne addresses.
o 6 .
Evaluate distance
M [Link] for existent and non-existent addresses. Do not 5 1 demote existing
2
H
[Link] closer, non-existent addresses are returned. Ha by K 8, 20
address results sna aw 21
in i fr
Ra sh G om I
For example, a user in Half Moon Bay, CA is looking for [2373 chestnut] and is presented za P
hu with three
lam
residential addresses. The address in San Francisco is the only one that actually exists. The results in
Oakland and Redwood City are not supported by the postal authorities and no evidence can be found
that the addresses in either city exist.
Note: For cases where the query is a unique full address that does not exist and the result matches
the query, see Query Address does not Exist.
Relevance Excellent
Relevance Good/Acceptable
(Distance/Prominence)
47
5.13. City vs. Municipality
IP
ro m m
f
In many cases, a city and a state/county/municipalityla (or other similar market-specific components)
2 0 21 Ghu
have the same name, but28the , city h is typically more prominent. In this
Mocase, the chances that a user is
e a wis a
looking for the state/county/municipality
n
Ju by K Raz and not the city, are very78small,nd but still a possibility.
ay,
y , . 9
Therefore, states, d acounties,
n 176 asn . 5 1 aiand
n municipalities will be treated as a secondary 5. 17
Ju intent and given an
ne
o 6 .
initial rating of
M Good.
9 5 . Consider
H the relationship between the city and the municipality
5 1 by 8, 20 in terms of their
2
8. H
locale and adjust
7 if necessary. On the other hand, if the query specificallyasrequests na Kaw the 21 state/county/
f
municipality, that result’s relevance should be rated as Navigational and the city i n i h G rombe rated
Ra should
s
Bad. za hu IP
lam
48
• Prominence of the feature
• Transit intent IP
ro m m
f la
2 0 21 Ghu
Promoting for prominence 8,should sh only occur for internationally prominent
Mo POIs.
n e 2 Kawi za 7 n d
u
J by a 8.9 ay,
ay, .51two
In the examplesndbelow, nR
ratings are provided for some results: Good5.1 and J
o 7 6 s n a i 76 unAcceptable.
e2 The
difference between 1 a
M 95. theHtwo ratings rests in how well the result satisfies user . 5 1 intent.
8 Choose Good if
7 8. Ha by K , 20
there is a strong likelihood that it will satisfy user intent and Acceptable ifnita is less s a likely
2 1 to satisfy.
in wish from
Ra
za Ghu IP
l
Query Result Rating and Explanationam
Relevance Navigational
Mission St & 14th
St
San Francisco, CA Query is for an intersection and the result
[mission & 14th satisfies the user intent.
street]
Relevance Good/Acceptable (User Intent)
User and fresh
viewport in San Mission St & 14th St Bus Result is for the bus stop at the queried
Francisco, CA Stop intersection. The bus stop carries the name of
San Francisco, CA the intersection and users tend to look for
intersections when seeking transit POIs.
Relevance Navigational
[soho]
Soho
User and viewport in London, UK Query is for a neighborhood in London and the
London, UK result satisfies the user intent.
Mildreds Restaurant
45 Lexington St, Carnaby, Result is for a specific restaurant in Soho. It is
London W1F 9AN, UK very unlikely to satisfy the user intent.
49
Query Result
IP Rating and Explanation
ro m m
[The Slanted f la Relevance Bad (User Intent)
2 0 21 Ghu
Door 8, wish Mo
e 2 KFerry
One a zaBuilding #3 nd
One Ferry u n 7
Result is for the8.9address
5.1 y, Ju and not the business
J y a a
Building #3 d ay, .5One
1 b aFerry
i n R Building #3 San
n 6 Francisco,
asn CA 94111 stated in the query, so7 6.5 it ndoes
e not satisfy the user
Mo 95.17 H
San Francisco, 1 2
78. intent. Ha by K 8, 20
California 94111] sna aw 21
fr
in i
Ra sh G om I
[One Ferry Relevance Navigational
za hu P
lam
The Slanted Door
Building #3 San The query is for an address and the result is the
One Ferry Building #3
Francisco, business at this address. Including the business
San Francisco, CA 94111
California 94111] name provides additional correct information.
Relevance Navigational
San Francisco
[san francisco] San Francisco, CA Query is for the city of San Francisco and the
result satisfies the user intent.
User and fresh
viewport in San Relevance Good (User Intent)
Francisco, CA San Francisco
International Airport The result represents the airport within the
San Francisco, CA queried locality, which satisfies the secondary
transit intent.
Mo IP
o m
n
78 large fr ulam
Many .95 day, Jtransit POIs include multiple means of transportation at the same location. For 2 example,
1
20 sh Gh
.17 uncan have metro or train service within the same location, or train stations
large airports 8, can be a hub
6.5 e 2
1 n e 2 Kawi za
for trains,Hmetros,
b 8 ,and buses. Other transit POIs at the queried transit POI should ube treated a as
a n y Ka 2021
secondary sintent with an initial rating of Good, but can also be considered y, J 51 by inif Rthe result is
Acceptable
da
ain w i h from n 176 asn. a
Ra sthe
less likely to satisfy user’s intent. Additional demotions can be Mobased
applied . on H the prominence
za Ghu P I
7 8 .95
of the returned feature. am l
50
IP
Query Result from lam Rating and Explanation
, 2 021 Ghu
8
Hamburg sh Relevance Mo Navigational
n e 2 Kawi zaAirport 78 nda
, Ju 22335 y
1 b ain R
a
Hamburg, Germany [Link], J queried airport.
d a y
. 5 17 the u
n 6 n 6.5 ne 2
Mo 95.17 Has Relevance 1 8
78. Ha bGood y , 2(User Intent)
sna Kaw 021
in i fr
[hamburg airport] Hamburg Airport Station Ra sh G om I
za
Result refers to the train station hat P
ulaHamburg
22335 Hamburg, Germany m
User and fresh Airport.
viewport in Germany
Relevance Bad (User Intent)
Lufthansa Basis The result is for a small bus stop that seems to
22335 Hamburg, Germany service the Lufthansa training center. The result
does not share the same name as the queried
transit. Therefore, the result is not relevant.
Relevance Navigational
The query is for a unique transit station. The
Embarcadero Station result (a unique BART station) fully satisfies the
San Francisco, CA user’s intent.
Acceptable (User Intent &
Relevance
Distance/Prominence)
[Embarcadero Ferry Building &
Station] The result (a historic streetcar) name includes
Embarcadero Station the queried station name, but has low
San Francisco, CA prominence, given that there is a unique
User and fresh
viewport in San Jose, Embarcadero Station. Therefore, the result
CA should be demoted based on user intent.
Washington St & Acceptable (User Intent &
Relevance
Embarcadero Station Distance/Prominence)
San Francisco, CA
The result (a historic streetcar) name includes
the queried station name, but has low
prominence, given that there is a unique
Embarcadero Station. Therefore, the result
should be demoted based on user intent.
Mo IP
5.16. m
78 POIs and Transit Intent
n o
fr ulam
.95 day, J 2 1
20 sh Gh
.17 un 8,
A non-transit
6.5 POI
1 b 28can
e be associated with a transit POI with the same name. You can n wi a the
e 2establish
a
relationship y ,2
Ha between u K az
sna Kaw 02the
1f
two entities by using local knowledge, researching prominence,
a y , J 1 by in Rand
understandinginhowiswell rthe result satisfies user intent. This way you will learn 6.5 nathe query has
nd whether
Ra h G om I Mo 95.17 Has
a distinct navigational
za intent
hu Por if the prominence of the two POIs that share 78. a similar name is so
la
strong that both can be themintent.
51
Query Result
IP Rating and Explanation
ro m m
[mall of America] 0 2 1 f hula Relevance Navigational
2 8Mall
, 2 isofh GAmerica Mo
w
ne 60a E Broadway,
User and fresh viewport
Ju by K Raz
a 78 nda
, 1 Bloomington, .95 y, J
in da y in MN Result is POI requested
.17 uin
o
Minnesota
n 176.5 asna
55425 United States 6.5 ne the query.
M 95.
. H 1 b 28,
7 8 Ha y K 20
sna aw 21
in ish fro
Mall of America RGood/Acceptable
aza Gh m IP
Station Relevance (UserulIntent
am &
8240 24th Ave S Distance/Prominence)
Minneapolis, MN Even though the station has the same name as
55425 the POI, it is not prominent and therefore
United States demoted.
Relevance Excellent
Result is for famous square in London. The
square and the train station are both equally
Piccadilly Circus prominent and local users would be looking for
[Piccadilly circus] London, UK the station while tourists would be looking for
User and viewport in
the square. As both features are equally
London, UK prominent, it is hard to establish a distinct user
intent.
5.16.1.
Mo Transit Queries IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Ghif it is
The criteria
.17 described
un above should be applied to understand the transit queries. Additionally, 8 ,
6.5 e 2 2 awi
determined 1that a8 query has a clear navigational intent, all other results will be Badu n e(see K [12thaza st
Ha by K , 20 , J b y R
oakland bart]sna example
aw 21 f below). If a result is promoted to Navigational, other ayresults1 that in could
i i r nd 176.5 asna
potentially satisfyn Rathe user
s h Gh intent
o m should be demoted further for [Link]
o
H (see
[BART daly city] zand ula IP
a [stockport station] examples below). In general, 8.9 fewer the results that
the
7
m
satisfy the user intent, the farther away the results can be and still be considered relevant. The more
available results that can satisfy the user intent, the closer they need to be.
52
IP
ro m m
f la
2 0 21 Ghu
8, sh Mo
n e 2 Kawi za 78 nda
u a
Query ay, J 1 by in RResult Rating.95 and
y Explanation
n d 6 . 5 a .17 , Jun
n 6.5 e 2
Mo 95.17 Has Relevance Ha bNavigational
1 8
78. y ,2
sna Kaw 021
in ish from
The query is for a specific BART Rastation
za Gh withIP a
12th St. Oakland unique name that is not the same as theulname am of
Station the locality where the station is found. (Compare
Oakland, CA this to the examples below). This result matches the
[12th st oakland query exactly and fully satisfies the user’s intent for
bart] this specific station.
Daly City Station The query intent is for a BART station in Daly City.
Daly City, CA Research shows that there is only one BART station
in Daly City and its name is Daly City Station, so this
result fully satisfies the user’s intent.
Relevance Good (Distance/Prominence)
53
Query Result IP Rating and Explanation
ro m m
f la Relevance Navigational
2 0 21 Ghu
8, sh Mo
n e 2 Kawi za 78 nda
, JuStockport
y a
The query intent is .for y
95 a station
n d a y
. 5
6 asn
1 b ain R Station .17 , Jun in Stockport.
Mo 95.17 Stockport,
H England Research shows that there 6.5 aree 2several stations in
1 b 8,
7 8. Stockport, but only one named
H asn y KStockport
20 Station,
a aw 21 f
so this result fully satisfies thein user’s
Ra sh Gintent.
i r om
za hu IP
lam
Davenport Station Relevance Excellent
Stockport, England
[stockport The query intent is for a station in Stockport. There is
station] one station with a name that matches the query
Heaton Chapel exactly, which receives the Navigational rating. All
User and viewport in Station other stations within the queried locality should
Stockport, England Stockport, England receive Excellent.
Relevance Excellent
San Jose Diridon
Station
[san jose station] San Jose, CA The query intent is for a station in San Jose. There
are several stations in San Jose, but no stations with
User and viewport in a name that matches the query exactly, so we should
California rate every station within the queried locality equally.
Tamien Station There are two stations that match the user’s intent,
San Jose, CA so both results should be rated Excellent.
Mo IP
o m
78 nda This station is just outside of the requested1 locality, fr ulam
.95 y, J Lawrence Caltrain in a neighboring locality. Even though 8the
2
20 station Gh is
.17 un , s h
6.5 e 2 Station i
e 2 Kaw zaa choice
outside of the requested locality, uitnprovides
1
Ha by K 8, 20 Sunnyvale, CA J
of stations in the area for the auser.
y, 5The y a
sna aw 21 d . 1 b afewer
i n R choices
fr n 76 athe
there are available, the farther sn results can
Mo 95.1away
in i
Ra sh G om I H
za hu P be and still be relevant. 78.
lam
54
Query Result IP Rating and Explanation
ro m m
f la Relevance Acceptable (Distance/Prominence)
2 0 21 Ghu
8, sh Mo
n e 2 Kawi za This station is just7 outside
n of the requested locality,
, JuSunnyvale
y a Caltrain 8.9 day,
a y 5 1 b ain R in a neighboring locality.
5.1 EvenJu though the station is
n d 6 Station
. sn 7 n
outside of the requested .locality,
Mo 95.17 Sunnyvale,
Ha
6 51 e 28 it provides a choice
. CA of stations in the area forHathebyuser.,2
78 sna Kaw The02 fewer choices
1f
there are available, the farther in away
Ra shthe
i roresults
m can
be and still be relevant. za Ghu IP
lam
Relevance Bad (Distance/Prominence)
Palo Alto Train Result is far from the queried station. The farther
Station away the result is from the queried station, the less
Palo Alto, CA likely it is that it will be considered relevant, so the
relevance rating should be lowered.
A transit stop is a location typically designated by a bench or covered waiting area, a posted sign, or
street markings. Transit stations, on the other hand, are typically larger areas associated with major
structures including, but not limited to, platforms, ticketing offices, enclosed waiting/seating areas, or
terminal buildings/structures encompassing the transit area. The term “station” is primarily used to
refer to transit locations that are larger and typically a terminal housing multiple routes. All stations
are stops, but not all stops are stations.
Since all stations are stops, but not all stops are stations, returning a station for a stop query is ok, but
returning a stop when the query is station should result in a rating of Bad with the User Intent
checkbox selected. Try to identify these corresponding terms in the test locale and understand the
relationship between them.
For the category [bus stops], relevance should be based mainly on distance from the user location
or fresh viewport and the physical size of the bus stop. If the result is a small bus stop in a rural area
and the bus stop is among the closest ones to the user’s location intent, it should be rated Excellent.
On the other hand, if the result is a large bus hub that is a bit farther away from the user, it should still
receive an Excellent because of its size, regardless of the fact that there are closer, smaller bus
stops. Results close to the user should not be demoted because there is a larger bus stop farther
away, instead, the large bus stop should be promoted because of its importance.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
55
Query Result
IP Rating and Explanation
ro m m
f la Relevance Excellent
0 21 Ghu
Greyhound
2
8, wish Lines
Mo
e 2 KFolsom
200 a za St n
n
Ju by Ra This is a major
78bus
.95 dstation
ay, in San Francisco
[bus station in d y , San
asan .51 ain Francisco, CA 94105 where a user can take
. J
17 Greyhound
u buses.
on 176 asn 6.5 ne 2
francisco]
M 95. H 1 b 8,
78. Main St & Folsom St
Ha y K 20
sna aw 21
User and viewport in San Francisco, CA 94105 in ish from
Relevance Bad (User Ra Intent)
za Ghu IP
San Francisco, CA lam
Relevance Excellent
[bus stop] W Harrison St & S The query intent is for a bus stop. This result is
Jefferson St a Greyhound station, which fully satisfies the
User and viewport in Chicago, IL 60607 user's intent. This result is close to the user.
Chicago, IL
Relevance Bad (Distance/Prominence)
The query intent is for a bus stop. This result is
Harlem Ave & W 115th for a bus stop and matches the user's intent, but
St there are many bus stops closer to the user in
Worth, IL 60482 real world we should be returning instead.
Mo Therefore, this result should be should be IP
m
78 nda demoted due to distance. 1 fro ulam
.95 y, J
.17 un 8, 202 sh Gh
6.5 e 2 2 i
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
56
5.17. Parking Intent
IP
ro m m
f la
2 0 21 Ghu
When evaluating [parking] 8, queries,
sh note that: Mo
n e 2 Kawi za 7 n
, u
J by R a 8.9 day,
• Free andnpaid y
da 6parking
7 .51 snainare equally relevant. 5.17 Jun
6.5 e 2
• Parking o
M time
. 9 5. limits
1 H do not affect relevance rating. Your rating should
a
H
1 not
by be
8, changed by the
78 a parking lot is long term, short term, or limited-time (likeaasntwo-hour
fact that Ka 2021limit) parking.
ain wis fro
• Parking for small cars, large cars, RVs, or motorcycles is equally relevant. Ra h G m I
• If you can find evidence that a result is for private parking that cannot be used za by hu theP general
lam
public, give it a rating of Bad.
• Parking that is a mix of residential/staff/permit and visitor parking and is not in a gated
community
• Parking that can be used only when visiting a certain business (limited-use parking)
If you cannot confirm whether parking is public or private, give the result the benefit of the doubt
and consider it public parking.
Sometimes a query specifically requests a certain level of service, which may or may not be reflected
in the result. Common requests include:
When the query requests a specific level of service which is not reflected in the result, give an initial
rating of Good and demote as necessary depending on how well the result would satisfy the user
intent.
Mo IP
When the query requests a type of business with a generic level of service, providing a result o m
that
78 nda 1 fr ulam
offers5more 2
.17 , Jservice than requested still satisfies user intent and should receive an initial 20rating Ghof
. 9 y
un 8, i s h
Excellent. 6.5 e 2
1
2
ne Kaw aza
Ha by K 8, 20 u
y, 51 by in R
J
sna aw 21 da
When the query in does
i not
fr specify the type of service, any relevant result can 6.
n be rated a
nExcellent.
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
57
Query Result IP Rating and Explanation
m
1 fro ulam Relevance Excellent
02 Gh
2 8, 2 wish Mo
Walmartne Supercenter
a a Query is for a generic
78 Walmart
nd and the result is a
Ju by K Raz Walmart Supercenter.9store
a
,
a34351EastinBroadway
y 5.1 y,that
Ju offers more
o nd 176.5 asna 7
.51 ne 28 store. User
services than the average Walmart
6
M 95Blvd,
. HTucson, AZ 85716
. Ha bis
intent has been met and there y , need
sna Kno to
7 8 20
aw 21 f
demote for service level. in i r
Ra sh G om I
[walmart] za hu P
Relevance Excellent lam
Walmart Neighborhood
Market The query does not specify the type of Walmart,
5500 E 22nd St, Tucson, and any Walmart can be rated Excellent. Demote
AZ 85711 further for distance.
58
Query Result IP Rating and Explanation
m
1 fro ulam Relevance Excellent
02 Gh
2 8, 2 wish Mo
ne a a The result is a bank7branch n location. Since many
Ju by K Raz branches contain ATMs,
8.9 day,
a y , 1 in 5.1andJwould be able to
nd 176.5 asna 7
provide the same level of service
un
.51 2as 8 an ATM, this
o 6 e
M 95. H
78. result usually fulfills the user’s y K , 202
Ha bintent.
sna aw 1
in i fr
Ra sh G om I
Note that if research indicates the result za hdoes
ula Pnot
offer cash services, rate it Bad. m
Citibank
3333 E Tropicana Ave
Las Vegas, NV 89121
[ATM]
Relevance Excellent
Citibank ATM 7-Eleven
3421 E Tropicana Ave This is an ATM located inside a 7-Eleven
Las Vegas, NV 89121 convenience store. It satisfies the primary intent of
the category.
Relevance Bad (User Intent)
A user has asked for a specific fast food restaurant
McDonald’s and the result is another fast food restaurant that
[burger king] 6875 Sand Lake Rd, offers similar food and service. Even though the
Orlando, FL 32819 service level in the two restaurants is similar, this
result does not match the user intent for the
named restaurant.
6. Name Accuracy
The Name Accuracy rating is used to evaluate the accuracy of a Business/POI name. Your final
rating will take into consideration both the accuracy of the Business/POI name and the classification
assigned
Mo to it. Inaccuracies in either or both of these elements will result in rating [Link] I
P
78 nda 1 fr ulam
. 9 y 2
20 sh Gh
Business/POI
5.1 , Ju Name Accuracy can be rated as:
8,
76 ne
.51 28 e 2 Kawi za
• n/a Ha by K , 20 u n a
• Correct sna aw 21 da y, J 51 by in R
in ish fro n 6 . n a
aza Gh m IP
• Partially RCorrect Mo 95.17 Has
• Incorrect ula
m 78.
• Can’t Verify
59
6.1. Name Not Applicable (n/a)
IP
ro m m
The n/a rating should be used21for a
f alluladdress type results, including residential addresses, streets,
2 0 G h
localities, and so on. 28 , is h Mo
u ne Kaw aza 7 n
8.9 day,
y , J by R
Unlike Business/POI
nd 176type
a .51 results,
na
in address type results do not actually.1have
5
76 uaneresult name. Instead, the
J
o
first line of address
M 95. type s .
. H results appears as the result title because this Hfield
a 5 1 bis meant
28
, to present the
8
most relevant7part of the address information. asn Ka 2021
y
ain wis fro
Ra h G m I
za hu P
lam
Since address results do not have a name, their Name Accuracy cannot be evaluated. This is why the
n/a rating should be selected.
60
6.2.1. Correct Name
IP
r o m m
A business/POI result name is2accurate 1 f hula when it is used on the POI’s official website or on other official
resources. Even if the official 0 G does not use the name, if it is used on other official sources, the
2 8, wwebsite
2
i sh Mo
name is correct. Noteuthat ne theK a name
a z a has to be used to refer to the
7 8.9 day, POI. The corporate name
particular
n
, J by R
by itself is not automatically
a y 1 inthe correct name. 5.17 Jun
ond 176.5 asna 6.5 e 2
M 95. H 1 b 8,
78 . H asn y Ka 2021
Business Name ain wis fro
Ra h G m I
za hu P
lam
Every name that a specific business location uses to refer to itself is considered correct. These
names can be listed in a variety of ways in different sections of the entity's official website or official
social media website(s):
If these resources are not available, other reliable sources that can be used for researching business
names include:
• Signs and storefronts seen on recent street or online imagery or crowdsourced review pages
• Recent articles in primary publications (newspapers or similar publications that do their own
reporting)
• Official restaurant menus (user photos or scanned images from restaurants)
If the name cannot be confirmed with these resources and there is nothing objectively wrong with it,
rate it Can’t Verify.
Corporate name
The corporate name (and sometimes brand or product name) is often used to refer to a particular
entity, but might be not the preferred name for a specific location. This depends on the particular
company and the specific result.
Some official websites have a local language and an international (English) version. Consider the
name given in the international version only if English is the language/script of the test locale, the
query, or the result region, or if the official company, chain, or brand name is commonly used and
understood
Mo in English in this market. If it is not, select the Result name/title is in unexpectedm IP
language
78 nda or script checkbox. No further rating is required. 1 fro ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 b 8, u ne Kaw aza
Ha y K 20
sna aw 21 da y, J 51 by in R
in i fr n 6. na
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
61
Result Name Official Business IP Name Rating and Explanation
ro m m
0 2 1 f hula Name Accuracy Correct
, 2 h G
28 is M
McDonald’s ne Kaw aza
McDonald’s The chain calls7all ostores
n McDonald’s and has the
u
J by 8.9 day,
a y , 1 in
R name in front of all
5 locations
.17 Jun as corporate
ond 176.5 asna branding. 6.5 e 2
M 95. H 1 b 8,
78 . H asn y Ka 2021
Name Accuracy Correct
ain wis fro
Ra h G m I
The name is considered Correct, hu P it is
za because
Peet’s Coffee & lam
Peet’s - Polk Street used on the sign on the storefront. The store is
Tea
officially called “Peet’s - Polk Street” on the
website as it refers to the Polk Street location.
Name Accuracy Correct
Businesses can include the name of the locality or the larger complex or organization they belong to
as additional information. These modifiers, even when not specifically used by the official resources,
can be considered correct. A name with missing modifier can also be considered correct as long as
the modifier isn’t crucial for understanding the particular result. If a modifier is present, it must be
spelled correctly. If it is misspelled, the name is partially correct.
See your Country Specific guidelines for cases where the location modifier is essential for
IP
understanding
Mo the result. o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 b 8, u ne Kaw aza
Ha y K 20
sna aw 21 da y, J 51 by in R
in i fr n 6. na
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
62
Result Name Official Business IP Name Rating and Explanation
ro m m
0 2 1 f hula Name Accuracy Correct
G
2 8, 2 wish Mo
ne a a 78 nda
Ju by K Raz The result name is.9missing
Apple a y , Apple
1 iValley
n Fair 5.1 y, Ju the location modifier
ond 176.5 asna 76 official
(Valley Fair) given on the.51 ne 28 website, but is still
M 95. H
78. considered Correct. Has by K , 202
na aw 1 fr
in i
Ra sh G om I
za hu P
Name Accuracy Correct lam
Peet’s Coffee Peet’s – Ferry Bldg SF The result name is Correct because it is used as
the name on the official website, while the specific
store has an optional location modifier.
A variation is still correct when a business uses stylized logos and letters (like the backwards “R” in
Toys ”R” Us) that are outside the regular set of letters.
Toys ‘R’ Us Toys Я Us This business uses a special character in its name,
P
Mo so the name is still considered Correct. om I m
78 nda fr la
.95 y, J 2 021 Ghu
.17 un
6.5 e 2 28, awish
“The” is missing
1 b 8,or added e
un by K Raza
H
• Missing: y 2 0 , J
a sna KThe aw 2use 1 f of definite articles depends on the individual result. aWhen
y 1 a company
in using
i n i ro o nd 176.5 asna
“the” is oftenRa referred
s h m to without it, the name is correct both with Mand 5without H the article.
za Ghu IP that does not officially include a definite article 9 .
• Added: A business/POI lam 78. in its name but has one
included in the result should be considered partially correct.
63
Result Name Official Business IP Name Rating and Explanation
ro m m
0 2 1 f hula Name Accuracy Correct
, 2 h G
28 awis Mo
Home Depot u ne Home
The K a z a
Depot The official name
7 8.9of dthis
n
ay, business is “The Home
, J by R
a y 1 in Depot,” but since it .is
5 17soJoftenun referred to as
o nd 176.5 asna 6 e2
M 95. H “Home Depot” the name . 5 1isb considered
8, Correct.
7 8. H asn Ka 21y 2 0
ain wis fro
6.2.2. Partially Correct Name Ra h G m I
za hu P
lam
A partially correct name differs from the official versions but can still be recognized by the user.
Partially correct names can includes minor and moderate misspellings, service level mismatches, and
missing or unnecessary name parts, including holding names/corporate structures. When the
business name on the storefront does not include the corporate status (Ltd., Inc., etc.) seen in the
result, it is partially correct.
Consider names partially correct when they contain issues that don’t prevent the user from
identifying the business:
HM H&M
Mo Missing the “&” in H&M is a misspelling but the IP
o m
78 nda name is still recognizable. 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Name Accuracy Partially yCorrect J u y R
sna aw 21 da , .51 b ain
in ish from n 6 n
uhaul uhaul Raza U-Haul
Gh IP Mo 95.17 Has
ula
m 78.
The result name is duplicated and in all lowercase
with no “-”.
64
Result Name Official Business IP Name Rating and Explanation
ro m m
0 2 1 f hula Name Accuracy Partially Correct
G
Seven Eleven 8, 2 wish
7-Eleven
2 Mo
ne a a The name is in an
78 unexpected
nd form not used by the
y , Ju by K Raz a
business itself. .95.1 y, Ju
a 1 in
ond 176.5 asna 76 ne
.51 28
M 95. Name Accuracy Partially
78.
H Ha by Correct
,2
sna Kaw 021
GAMESTOP GameStop The name written in ALL CAPS in isisnot fro
Ra h G expected
m for
this business and demoted. za hu IP
lam
Name Accuracy Partially Correct
Mosjaw Moosejaw The outdoor store has two misspellings but is still
identifiable.
65
Result Name Official Business IP Name Rating and Explanation
ro m m
0 2 1 f hula Name Accuracy Partially Correct
, 2 h G
28 is Mo
u ne Kaw aza 7 n
8.9 day,
y , J by R
a 1 in 5.17 Jun
ond 176.5 asna 6.5 e 2
M 95. H 1 b 8,
78 . H asn y Ka 2021
ain wis fro
Ra h G m I
z hu P
Aqua Spa 夢幻⽔ Aqua Spa - Ocean The query [aqua spa] was issueda in the lazh-Hant_HK
m
都 City (Hong Kong) test locale and the result locale is in
the US (English). Consider this Partially Correct
due to the mix of expected scripts.
University of University of California Irvine is more than a location modifier for this
California Irvine university. The city name differentiates the Irvine
location from other universities in the University of
California network.
Mo IP
Name Accuracy Partially Correct o m
fr ulam
78 nda 2 1
.95 y, J 20 sh Gh
.17 un 8 ,
6.5 e 2 Even though the Nike symbol appears 2
ne Kaon wi this
1
Ha by K 8, 20 J u y aza
Nike sna aw 2NIKELAB 21M NYC store’s official website, the apreferred
,
y 51 b store name
R
1
ish from ndnot . snain
6the
in
Ra for this specific location ois
M 95. 1 7
H ageneral brand
za Ghu IP .
name but the NIKELAB 7name seen on the store
8
lam
sign and website.
66
Result Name Official Business IP Name Rating and Explanation
ro m m
0 2 1 f hula Name Accuracy Partially Correct
, 2 h G
28 is M
The Sears ne Kaw aza
Sears Sears does not 7useon“The” in any of their official
u
J by 8.9 day,
a y , 1 in
R webpages. Adding 5it
.17 Juncompany name gives
to the
ond 176.5 asna the name a rating of Partially
6.5 e 2 Correct.
M 95. H 1 b 8,
78 . H asn y Ka 2021
ain wis fro
[Link]. Service-Level Mismatch Ra h G m I
za hu P
lam
Chain businesses often indicate the level of service provided at that location in their name. If the
result name does not reflect the correct type, it is considered a service-level mismatch and is
considered partially correct.
Patagonia Outlet Patagonia The result name suggests that the store is an outlet,
which it isn’t.
Best Buy Best Buy Express A Best Buy Express is a vending machine and not a
store. This is a service-level mismatch and
considered Partially Correct.
Name Accuracy Partially Correct
Best Buy Express Best Buy The user is expecting a vending machine where
there is a store. This is a service-level mismatch
and considered Partially Correct.
Mo IP
[Link]. Holding Name and Corporate Structure o m
fr ulam
78 nda 2 1
.95 y, J 20 sh Gh
.17 un 8 , i
6.5 e 2 2
Holding names ne Kaw used
1 b or8,corporate structures are not considered correct if they are notJuexplicitly aza by
Ha y K 20 , b y R
the individual a 21 f
sna stores. ay .51considered
n
in wishHolding
rom names or names that include corporate structure
o nd 17are
6 asnai
partially correct Rorazincorrect
Gh Idepending
P on how recognizable the name isMin.9context
5. H with the particular
a u 8
business. l am 7
67
Result Name Official Business IP Name Explanation
ro m m
0 2 1 f hula Name Accuracy Partially Correct
, 2 h G
28 is Mo
IT’SUGAR LLC ne Kaw aza
IT’SUGAR The addendum7“LLC” n refers to the corporate
u
J by 8.9 day,
a y , 1 in
R structure and should
5.17notJbeun used for the store,
ond 176.5 asna However, this name is still
6 .51 recognizable.
e2
M 95. H b 8,
78 . H asn y Ka 2021
Name Accuracy Partially ainCorrect
wi fr
Ra sh G om I
The addendum “Inc.” refers to the hu P
za company’s
lam
Nordstrom, Inc. Nordstrom corporate structure and should not be used for
the store. However, the store can still be
recognized.
• Severe misspellings that prevent the user from identifying the business because of:
• Change in meaning
• Misspelling that results in an entirely different word or gibberish
• Holding names that are completely different than the recognized name
• Unnecessary or missing parts in the name that prevent the user from recognizing the
business
• Slang and inappropriate language
• Using the previous name of the same entity that is not a variation of the current name and
therefore cannot be identified
Note: If a result name is incorrect, the final Name Accuracy rating will always be Incorrect, even if
the classification is correct.
68
Result name Official Business IP Name Rating and Explanation
ro m m
0 2 1 f hula Name Accuracy Incorrect
G
2 8, 2 wish Mo
Samsons Pizza ne
Seasons a Pizza a The misspelling7changes
n the meaning of the word
Ju by K Raz 8.9 day,
“Seasons” and makes
a y , 1 in 5.1 this Juseems like a totally
ond 176.5 asna different business. 7 6 .51 ne 28
M 95. H
78. Ha by K , 20
Name Accuracy sna aw 21
Incorrect
in i fr
Ra sh G om I
za hu P
lam
IEA IKEA In short business names, even small errors can
prevent the user from recognizing the business.
Zatas Tacos + Zacatecas Tacos + The misspelling is severe and does not allow the
Tequila Tequila user to identify the business with certainty. The
user is likely under the impression that it is a
different restaurant.
Cheesecake The Cheesecake Factory When missing the word “factory”, the result name
“Cheesecake” is not specific enough and the chain
business cannot be identified with certainty.
Mo IP
Name Accuracy Incorrect o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 b 8, u ne Kaw aza
UPS
Ha y K 20
sna aw 2USPS 1f y, J 51 by and
USPS (United States PostaldaService) R
in UPS
in ish rom n 6 . s n a
(United Parcel Service)Mareo both 17 in Hathe delivery
Ra
za Ghu IP . 95.
lam business, but are entirely7 different companies.
8
69
Result name Official Business IP Name Rating and Explanation
ro m m
0 2 1 f hula Name Accuracy Incorrect
, 2 h G
28 is Mo
Starbucks & u ne Kaw aza 7 n
8.9 day,
, J Marks
b y &RSpencer
Spencer a y 1 in By switching Marks with
5.17 Starbucks,
Ju the business
nd 176.5 asna 6 ne
o
M 95. can no longer be identified.
. 5 1 2
78.
H Ha by K 8, 20
sna aw 21
in i fr
Ra sh G om I
Name Accuracy Incorrect za hu P
lam
Mickey D’s McDonald’s Mickey D’s is British slang for McDonald’s brand.
However it is not an official variation of the brand
name.
Name Accuracy Incorrect
Once you have determined the correctness of a result’s name, you will have to evaluate the accuracy
of its classification in order to determine the final Name Accuracy rating. The classification of a result
refers to the category of the Business/POI.
Not every result will include a classification, but when one appears, you will find it below the address
details
If the classification is missing or listed as N/A, make your final Name Accuracy rating based on the
name alone.
When a business or POI is classified correctly, the classification accurately reflects the business,
service, or function of the entity. This includes broad or alternate classifications that are not the
preferred choice but are not misleading.
A correct
Mo name paired with a correct classification is rated Correct for Name Accuracy. IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 as Gh do
• Not
.17 every
un result will include a classification. If the classification is missing or listed
8, i s h N/A,
65 e2 2
not .demote.
1 ne Kaw aza
Ha by K 8, 20 Ju y R
• Some snaclassifications
aw 21 f y, 5as
may seem slightly too specific or too general. Asdalong . 1 btheain
i i r n 6 n
n R shis notommisleading, consider it correct.
classificationaza Gh IP Mo 95.17 Has
• Classifications canulavary 78.
m for similar POIs and vary per market. Localization of categories
should be taken into account when deciding if a classification is appropriate.
70
IP
ro m m
f la
2 0 21 Ghu
8, sh Mo
n e 2 Kawi za 78 nda
a y , Ju 1 by in Ra .95 y, J
nd 6.5 na .17 un
6.5 e 2
Mo 95.17 Has 1
Result Name
78. and Ha by K 8, 20
Rating and Explanation
sna aw 21
Classification in i fr
Ra sh G om I
za hu P
Name Accuracy Correct lam
Restaurant Toqué Restaurants are commonly classified by their respective cuisines.
French ‘French’ refers to French cuisine or a French restaurant and is an
appropriate classification for the result.
Name Accuracy Correct
Jocko’s World Famous
Chicken and Seafood This classification may seem a bit too specific but it is not misleading.
Seafood Although this restaurant sells more than just seafood, categorizing it as a
seafood restaurant still properly reflects the nature of this entity.
Name Accuracy Correct
Walmart As long as research shows that the particular Walmart location
Grocery represented by the result sells groceries, this would be an appropriate
classification. This is because grocery is a major department in this store
and represents a large part of what it sells.
Name Accuracy Correct
Walmart
Discount Store This classification accurately represents the POI. Walmart is known to
offer merchandise at low prices.
When the classification is wrong, the final Name Accuracy rating is always Incorrect. This is true
whether the result name is Correct, Partially Correct, or Incorrect.
• Wrong
• Misleading
IP
•MonMisspelled o m
7•8 Incomplete fr ulam
.95 day, J (missing parts or has uncommon/odd abbreviations) 2 1
20 sh Gh
• In .17an unexpected
un language/script. The classification must match the language/script ,
e 2 Kawi zof the
6.5 e 2 8
query,1 8 n a
Ha btesty locale,
,2 or result region u
y, J 51 by in R
a
sna Kaw 021 da . a
in i fr n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
71
Result Name and Expected IP
m m Rating and Explanation
Classification Classification
f ro la
2 0 21 Ghu
8, sh Name Accuracy Incorrect
Mo
n e 2 Kawi za 78 nda
u a
Denver Zoo day, J 51 by in R .95 y, J
Classification is wrong .1since
. Zooa 76 unthe result is a zoo. This
Active Life Mon 5.176 Hasn .51 e 28 the nature of the
classification does not represent
78.
9 Ha by K , 20
result. Final Name Accuracy snarating
a is21Incorrect.
in wish from
Ra
Name Accuracy Incorrect za Ghu IP
lam
Macy’s The result is a department store and should not be
Bar Department Store categorized as bar. Final Name Accuracy rating is
Incorrect.
Mo IP
o m
78 nda fr ulam
Macy’s
.95 y, J Classification is incomplete. The classification2 1 shown
.1 u Department Store , 20 sh Gh
Depart 7Store
6.5 ne 2 is not a common abbreviation for “Department
e 2 Kaw za Store”
8 i
1 n
Ha by K 8, 20 and appears incomplete. Final NameJu yAccuracy
Ra rating
sna aw 21
fr is Incorrect. day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
72
Result Name and ExpectedIP
m m Rating and Explanation
Classification Classification
f ro la
2 0 21 Ghu
8, sh Name Accuracy Incorrect
Mo
n e 2 Kawi za 78 nda
a y , Ju 1 by in Ra .95 y, J
nd 6.5 na .
Test Locale: Germany 176.5 une
Mo 95.17 Has 1 28,
Classification is in unexpected
78. Ha by Klanguage
20 or script.
s a 21
Aral The classification “Gas Station”
n ain iswiin English
fr instead
Tankstelle Ra sh G om I
of the expected German word “Tanskstelle.”
Gas Station za hu P
English should be considered an unexpected lam
language in this locale (even if it could be understood
by a user there). Final Name Accuracy rating is
Incorrect.
When, due to a lack of available data online, the business or POI name cannot be confirmed, rate
Can’t Verify. This can be because of a lack of official resources or street imagery or can be the case
for small businesses that don’t maintain their own webpage or social media profile.
Transit stations and other transit results (like airports and shipping ports), are often named after the
locality or street where they are located and can include a transit indication such as "Station" or
“Subway.” The transit indication in the result name/title is considered optional and can be missing
and still be considered correct. The user query for [san jose station] can therefore return the name
San Jose Diridon Station or simply San Jose to be Correct. The classification of the result will help
you correctly interpret the result because classifications for transit POIs should be a reference to
transit.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 that Gh
Keep in.1mind
76 uthat
n some transit POIs located on street intersections may have a result 8title
, i s h is the
.51 e 28 e 2 Kaw za
name of H the street
b , intersection (e.g. “Lincoln Way & 19 th Avenue”). This is also considered
u n Correct.
a
asn y Ka 2021
da y, J 51 by in R
ain w i h from n 176 asn . a
Ra stransit
If there are multiple G systems operating
I out of the same station, Moof95the
any . systems
H can be
za hu P 8 .
included in the name to beaCorrect.
l m If transit stations are close to each other, but users have to walk
7
outside to get from one building to another, consider the results for the two stations as two separate
POIs.
73
IP
ro m m
f la
Query 2 0 21 Ghu
Result Rating and Explanation
8, sh Mo
n e 2 Kawi za nd
Millbrae
, Ju 1 by in Ra Name Accuracy78.9 Correct
a
y 5.1 y, Ju
nd Millbrae, aCA
a .5
176 Hasn “Millbrae” has no transit
7 6.5 indication
ne in the result
Mo [Link]: Train Station 1 28
78. name, but the classification
Ha byindicates
,2 it is a train
sna Kaw 021
[Millbrae station. in i fr
station] Ra sh G om I
Millbrae BART Name Accuracy Correct za hu P
lam
Millbrae, CA “Millbrae BART” has a transit indication for the
User and Classification: Train Station
viewport BART system in the result name.
in Palo Alto, CA Millbrae Amtrak Name Accuracy Incorrect
Millbrae, CA “Millbrae Amtrak” has an incorrect Amtrak transit
Classification: Train Station indication. Only BART and Caltrain operate from
Millbrae station.
A parking lot may or may not have a name. Confirm this on the lot’s official webpage:
• The generic names “Parking,” “Garage,” or “Lot” (or any other words that indicate parking
can take place at the location) are considered Correct when no official name can be found.
• If an official name can be found, rate the generic names “Parking,” “Garage,” or “Lot” (or any
other words that indicate parking can take place at the location) as Partially Correct.
• If the parking lot is specialized (for instance, motorcycle-only parking), and the result’s name
doesn’t reflect that specialization, the result should be rated Incorrect for name accuracy.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
74
IP
Query Result
ro m m Rating and Explanation
f la
2 0 21 Ghu
e 28, awish Name Accuracy Mo Correct
JuUnion y K Square
aza Garage 78 nda
n
b R .95 website
This garage’s official y
.17 , Jun confirms its name.
a y , 1 i n
nd 6.5 na 6.5 e 2
Mo 95.17 Has Name Accuracy 1 8
78. Parking Ha bPartially
y , 2 Correct
sna Kaw 021
(Result is for the Union in
Research shows that the official ish frofor
Ra name
Square Garage) Gh m Ithis
parking location is Union SquarezaGarage ula P
m
Safeway Parking Name Accuracy Correct
(Result is for the parking
[Parking] lot attached to a This parking lot has no official website or name, but
Safeway store in San is associated with a Safeway store.
User and viewport Francisco)
in San Francisco, CA
Parking Name Accuracy Correct
(Result is for the parking
lot attached to a
Safeway store in San This parking lot has no official website or name.
Francisco)
Safeway Name Accuracy Incorrect
(Result is for the parking
lot attached to a Without the words “Parking,” “Garage,” or “Lot,”
Safeway store in San users will have no way to know they can park at this
Francisco) Safeway.
This summary table shows the final ratings produced by different combinations of name correctness
and classification accuracy.
Name/Title
Classification Accuracy Final Name Accuracy Rating
Correctness
Correct Correct or N/A Correct
Mo IP
Correct Incorrect Incorrect o m
fr ulam
78 nda 2 1
.95 y, J 20 sh Gh
.17 un ,
Partially [Link]
51 e 28 Correct or N/A Partially Correct 2 8 i
u ne Kaw aza
Ha by K , 20 J y R
sna aw 21 Incorrect
Partially Correct fr Incorrect day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
P
hu Correct
Incorrect za
lam or N/A Incorrect 78.
Incorrect Incorrect Incorrect
75
7. Address Accuracy: Components
IP and Issues
m
1 fro ulam
Address Accuracy is split into 2two main
h parts: Components and Issues and Result Expectation. This
, 20 ish G
section will discuss Components2 8 and Issues and the next section willMo discuss Result Expectations.
u ne Kaw aza 7 n
8.9 day,
y , J by R
a 1 in 5.17 Jun
nd 176.5 asna
7.1. Address oComponents 6.5 e 2
M 95. H 1 b 8,
78. H a y 20
Address components are the elements used s natoKform
aw 2the1 address
in ish from
details for each result. These components include R azastreet
Gh number,
IP unit/
apt, street name, locality, region/state, postal code, and ucountry.
lam The
components are defined in these guidelines with a global approach in
mind. There may be variations for specific markets that are not
addressed here. See your Country Specific guidelines for more
information on the address component requirements for each type of
result.
This section covers the issues that can be associated with the address
components as well as the possible issues that can be associated with
the address itself. It refers to the checkboxes presented in the rating
interface when Incorrect is selected. Checkboxes should be selected for incorrect or missing
information. Issues can occur within parts of the address or the entire address.
Choose all identified incorrect or missing components. If the issue is not tied to individual
components but to an issue pattern, choose the appropriate issue instead.
Never select issues and components at the same time to report the same problem. That is, do not
rate Incorrect —Language/Script issue for the entire address and also Incorrect—Street Name
because street name is in an incorrect language.
When a Language/Script issue is present, make sure to check the address components for
accuracy and to select the appropriate checkbox. For instance, if you select language issue for the
entire address, you can also mark street number as incorrect, since this is an error that's not
language related.
If the result address has an incorrect or missing street number rate Address Accuracy as Incorrect –
Street Number.
Mo IP
o m
78 nda 1 fr ulam
.95 Result
y Official Address Rating and Explanation 20 2 Gh
.17 , Jun 8 , i s h
6.5 e 2 2 aw
1 Address Accuracy Incorrect n–e Street
K aNumber
za
H b 8, Ju y
7-Elevenasn y Ka 2021 834 E Fremont Ave, , b
day .51 snain
R
ain wis fro on .176 abecause
Select the Street numberMcheckbox the
836 E Fremont RAve,h Sunnyvale, CA
aza Gh m IP .95 H
Sunnyvale, CA 94087 u94087,
lam USA street number in the result78address is incorrect.
76
Result Official AddressIP Rating and Explanation
ro m m
Defour 1 f hula 47,
Potgieterstraat
0 2 Address Accuracy Incorrect – Street Number
, 2 h G
Potgieterstraat, 1053 e 21053
8 wiXS s Mo
Select the Street number
n Ka za 7 nd checkbox because the
XS Amsterdam, y, J bAmsterdam,
u y a street number is missing
8 . 95 ayin, Jthe result address.
1 ain R
Netherlands onda 76.5 sNetherlands
n
.17 un
6.5 e 2
M 95. 1 H a 1 b 8,
78. H asn y Ka 2021
ain wis fro
The way street numbers are assigned varies by country and area. Some patterns Ra you
h may m see:
za Ghu IP
lam
Street Number Extensions
Some markets use a street number extension system. Street number extensions are part of the street
number, not a further breakdown of it like building or unit numbers. If a street number extension is
incorrect or missing from a POI address it should be treated as an incorrect/missing street number.
Refer to Country Specific Guidelines for more details.
Address Range
Address ranges are used to assign numbers to a stretch of road. Given the nature of these ranges,
not all numbers will have a building assigned to them.
When an address range is given by the query or returned as a result, consider it Correct when:
77
Suggestion OfficialIPAddress Rating and Explanation
m
1 fro ulam Address Accuracy Correct
The Crutched Friar 02 Gh
8, 2 wish No need to selectMothe Incorrect – Street Number
39 Crutched Friars, ne 2
Ka aza
Ju by39-41 7
checkbox [Link]
nd
London a y , 1 ain R Crutched Friars, 95 street
ay,
Ju
number in the
nd 176.5 asnLondon . 1
suggestion is within the
o EC3N 2AE, 7 6.5 official
n e address range.
M 95. H 1 b 28,
8. United Kingdom Address Accuracy asIncorrect
H y 20 – Street Number
7
The Crutched Friar na Kaw 21 fr
in Number
i
45 Crutched Friars, Select the Incorrect – Street Ra sh G omcheckbox
because the street number in the z hu IP
a suggestion is
London lam
outside of the official address range.
Address Accuracy Incorrect – Street Number
26 Winchester
25-27 Winchester
Avenue Select the Incorrect – Street Number checkbox
Avenue, Burpengary
Burpengary East Qld
East Qld 4505 Australia because the number 26 is even while the official
4505 Australia address range is odd.
7.1.2. Unit/Apt
A street number can be divided into unit, apartment, or building numbers. Commonly seen forms
include the use of letters: A, B, C as well as the character # in front of a number: #420. Less common
are forms like ½.
A unit number should be correct and present when the official address of a business/POI contains a
unit number.
When a business does not list a unit number and the unit number cannot be confirmed, no unit
number should be given in the result. Rate Incorrect – Unit/Apt when unit number is present in the
rating tool in these cases.
78
Free People IP Address Accuracy Incorrect – Unit Number
333 Santana Row o m m
f r la This result address has a different unit number than
Suite #2490 0 21 Ghu
, 2 h the one listed on theMofficial website. Unit number
San Jose, CA 95128 ne 28 awis a checkbox should be 78 selected.
z on
K .95 day, J
a y , Ju 1 by in Ra
nd 6.5 na .17 un
6.5 e 2
Mo 95.17 Has 1
78. Ha by K 8, 20
sna aw 21
7.1.3. Street Name in i fr
Ra sh G om I
za hu P
lam
If the result address has an incorrect or missing street name rate Address Accuracy as Incorrect –
Street Name.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 Street
Misspelled un Names 8, i
6.5 e 2 2
1 b 8, u ne Kaw aza
Ha y K 20 y
y, J 51 bof R
Misspellings snain the 21 name, including missing diacritics (e instead of é, ldinstead
awstreet a . ain may be
ł)
in ish from n
o .17 as 6 n
rated Incorrect R–aStreet
za GhuName.
IP See your Country Specific guidelines forMmore 95 information.
H
lam 78.
79
Result Official Address
IP Rating and Explanation
ro m m
f la Address Accuracy Incorrect – Street Name
Van Gogh Museum 0 21 Ghu
Museumplein
, 2 h 6,
Musuemplein 6, 1071 e 28 awis Mo
The result street 7name n is misspelled (“ue” instead of
n 1071 DJ a Amsterdam,
DJ Amsterdam, y, Ju by K Raz 8 day,
“eu”), so the street.9name
5.1 checkbox should be
a 1 Netherlands
n Ju
Netherlands ond 76.5 asnai selected 7 6 .51 2n e
M 95. 1
78.
H Ha by K 8, 20
Address Accuracy sna aw –21Street Name
Incorrect
in i fr
Ra sh G om I
Bozego Ciala The result street name is missingzadiacritics hu Pin two
Bożego Ciała, lam
Bozego Ciala, letters (ż and ł) which should be treated as a
Wrocław, Poland
Wrocław, Poland misspelling in the Polish market. The street name
checkbox should be selected.
Street directions (North (N), East (E), South (S), West (W)) as well as street types (Street (St),
Boulevard (Blvd), Avenue (Ave), etc.) are part of the street name. If they are incorrect or missing, the
street name is wrong and rated Incorrect – Street Name. Exceptions are when such elements of a
street name are used interchangeably for the same street.
118 El Camino Real 118 E El Camino Address Accuracy Incorrect – Street Name
118 El Camino Real, Real, Sunnyvale, CA This address is missing the direction. Therefore, the
Sunnyvale, CA 94087 94087 street name checkbox should be selected.
Blue Stones Address Accuracy Incorrect – Street Name
3530 El Camino
3530 E El Camino
Real, Santa Clara, This result address has additional direction, which is
Real, Santa Clara, CA
CA 95051 wrong and does not exist in real life.
95051
80
Every result requires the correct locality component within its address details. In cases of local
government reforms or other changes IP in naming, the result has to reflect the official name.
ro m m
Exceptions are made when alternate f la
2 0 21 Ghu names are accepted.
8, sh Mo
n e 2 Kawi za 7 n
u Ra
Result ay, J 1 by inOfficial Address 8.9 dand
Rating ay, Explanation
d . 5 a 5. 1 Ju
on 176 asn 7 6 ne
M 95. . 5 2
Van Gogh Museum . H Address Accuracy HIncorrect
1 by 8, 20– Locality
8 asn Ka 21
Museumplein7 6, 1071 Museumplein 6, 1071 ain wis fro
DJ Utrecht, DJ Amsterdam, This address has the wrong locality.
Ra h G Locality
m
checkbox should be selected. za hu IP
Netherlands Netherlands lam
Address Accuracy Incorrect – Locality
Van Gogh Museum Museumplein 6, 1071
Museumplein 6, 1071 DJ Amsterdam, This address has a missing locality therefore
DJ Netherlands Netherlands locality checkbox should be selected.
Each country has its own understanding of what is expected (correct) or unusual (incorrect) for
region or state components. See your Country Specific guidelines for more information.
81
Result OfficialIPAddress Rating and Explanation
m
1 fro ulam Incorrect – Region/
02 Gh Address Accuracy
2 8, 2 wish Mo State
Van Gogh Museumune Ka aza 78 nda
y, J 51 by Museumplein
Museumplein 6,da1071 i nR
6, 1071 Region is not a .mandatory
95 y, J
.17 un component in the
n 176 asnDJ Amsterdam,
. a
Netherlands, but if present
6.5 e 2has to be correct.
Mo 9North-
DJ Amsterdam, 5. H Netherlands 1 b 8,
78.
Brabant, Netherlands The correct region for
H asnthey K
city2of
0 Amsterdam is
aw 21 f
a
North-Holland, thereforeinthe Ra region/state
ish rom
checkbox will be selected. za Ghul IP
am
The postal code accompanies the locality name and provides further detail about where a feature is
located. See your Country Specific guidelines for more information on when postal codes are a
mandatory address component.
If a postal code is not mandatory but is present in the result address, rate Correct as long as the
postal code applies to at least part of the feature (street, locality, large POI without an expected
address, etc.).
For many localities, more than one postal code may apply. As long as the returned postal code is
correct for at least a part of the feature (street, locality, large POI) rate Correct. Columbus, OH, for
example, contains 45 postal codes.
Postal code standards differ between locales so be sure to consult your Country Specific guidelines
for details.
Consider any country specific conventions when it comes to the use and correctness of shortened
postal codes. For example, the US postal code does not need the four-digit extension that follows the
five digit main code. Ignore it if it appears.
An address-type result needs to be associated with a building or with a plot of land that has been
officially assigned that address. If you find strong evidence that there is no building at the address or
that no plot of land has been officially assigned the address, rate Incorrect – Address does not exist
and leave a detailed comment including links. If there are not enough resources available to make an
informed decision, rate Can’t Verify.
Within markets that use street number extensions, if the result offers an address with a generic street
number, but the street number alone does not exist without an extension (e.g. result returns “163
Main St.”, but only “163A Main St.” and “163B Main St.” exist), rate the address as Incorrect –
Address does not exist, since the street number without the extension is not a valid, real-life address.
Note that street number extensions differ from the building numbers referred to in Unit/Apt section.
In rare cases, an existing street address can be found in a different locality. Always mark such cases
as Incorrect – Address does not exist and not as Incorrect – Locality.
Use the Incorrect – Address does not exist checkbox for any address result that doesn’t
exist, like a street or sub-locality result. This rating should not be applied to POI addresses.
Mo IP
o m
7.3. n
78 Language/Script Issue in Address fr ulam
.95 day, J 2 1
20 sh Gh
.17 un 8 ,
The address
6.5 e 2
1 details must be in a language and script that matches the test language e 2 (like
a wien_US), the
8
Ha by K , 20 , Ju n
b y K
R aza
user query,sor the result
na aw 1 fr 2 region. a y 1 i n
in i nd 6.5 na
Ra sh G om I Mo 95.17 Has
za hu P [Link] you find issues of this
Use the Address Accuracy Incorrect – Language/Script Issue checkbox
lam
nature in any of the address components in the address details of any result. (For business/POI
names and address titles in unexpected languages, see Result title/name in unexpected language.)
83
These examples show incorrect language IP
ro m m and script for the result “Cafe Timber, 1066 Hippy Hollow
Rd, Red Boiling Springs, TN 37150” f la
2 0 21 Ghuwith a user in the US using English.
8, sh Mo
n e 2 Kawi za 7 n
, u
J by R a 8.9 day,
a y 1 in 5.17 Jun
ond 176.5 asna 6.5 e 2
M 95. H 1 b 8,
78 . H asn y Ka 2021
ain wis fro
Ra h G m I
za hu P
lam
Results located in a market with different scripts are hard to verify. Use the normal research steps to
confirm the address. It is not expected that you understand markets and address formats outside
your local knowledge expertise, so do the best you can without doing more research than normal.
Rate mixed languages and scripts found in any address details as Language/script Issue when
they use a different language or script than the one used in the query, test, or result location.
The variety of address formats and distinctive country specific issues is broad. In general, use the
checkbox for Country Specific Issue when there is an address problem that is not covered by the
available checkboxes. This includes things like instances when an address also requires a sub-
locality or municipality in addition to locality and state, but those components are either missing or
incorrect. See your Country Specific guidelines for more information.
Any additional components beyond the regular address format for a country are rated:
Issues not mentioned in these guidelines are reported using the Incorrect – Other Issue checkbox. If
you choose this option, be sure to leave a comment as well as links to the resources you used to P
I
identify
Mo the issue. The checkbox is also used for:
n r om lam
78 da f
.95 y, J
.17 un , 2 021 Ghu
• Duplicate
6.5 e 2address components e 28 awish
• Name 1 8, reappears in the address details
Ha bofy KPOI 20 , Jun by K Raza
• Natural a 21
sna features ay 1 in
in wish fthat
rom contain street address elements (see Natural Features)
o nd 176.5 asna
Ra
• P.O. Box addresses M 95. H
za Ghu IP 78.
lam
84
You may also use this checkbox if you notice formatting issues along with any Incorrect
components you’ve already selected. IP
o m This is because once you mark a component Incorrect, you
can no longer choose Correct with
1
r
u lam
f Formatting issue.
2 02 Gh
28 , is h Mo
u ne Kaw aIssue
7.6. Correct with ,Formatting z a 7 n
8.9 day,
y J by R
a 1 in 5.17 Jun
ond 176.5 asna 65 e2
When all theMresult 5. address
H information is correct and present, but not in .the
1 b format
8 expected, mark it
. 9
78 Formatting issue. Formatting issues include the order aof
as Correct with
H y K , 202components and
snaaddress
a 1f
other minor issues that are not necessarily considered wrong. They do not include in wishmisspellings
rom
Ra G
which are addressed under the relevant individual components. Some reasons tozarate hCorrect ula IP with
m
formatting issue:
If optional components already discussed in this chapter appear in the address, use the guidance
provided in the section that applies to those components, not the Correct with formatting issue
rating. If your market has additional address components, consult your Country Specific guidelines
before demoting.
An address is rated Can’t Verify when it cannot be confirmed as Correct or Incorrect. This is
usually the case when there is a lack of resources or an unexpected address format is given on the
official website.
• Lack of resources:
• No official webpage found
• No official address listed
• General lack of official resources
• Lack of street imagery
• Unexpected address formats used by official resources can include:
• Intersection address (Main St and 2nd St)
• Exit address (Exit 5, Hwy 101)
• Descriptive address (Main St between 6th and 7th Streets)
Ask yourself: Is the location given by the result address at least not wrong given all informationIPI
Mo m
have
78 found?
nd Use the following examples to learn how reach a conclusion. fro ulam
a 1
.95 y, J
.17 un 8 , 202 sh Gh
Note: If an6.5address 2 awi
1 b 28, contains missing or incorrect components, it can be confirmed neas Incorrect.
e
u K aza
Mark theHindividual
asn y Ka 2incorrect
02 components. See your Country Specific guidelines, Jfor more
b y Rinformation
w
on missing oraiincorrect
i
1f
components.
r n day 6.51 snain
n R sh om
aza Gh IP Mo 95.17 Ha
ula
m 78.
85
7.7.1. Can’t Verify for Street Number
IP
ro m m
The following example shows2address 1 f hula details for a business called “Utopia.” No information online
confirms the address and8only 0
, isahfew
2 G street numbers can be confirmed with official resources.
2 w Mo
u ne Ka aza 7 n
8.9 day,
y , J by R
n
a .51 Explanation 5 Ju
Rule
o 6 asnai
nd 17and .17 Example
6 . ne
M 95. 5 1 2
8. H H by 8, 20
7 asn Ka 21
The street number has to fall within the possible ain wis fro
Ra h G m I
range of addresses. za hu P
lam
The following examples give different address details for a business called Aztec. The official address
is “Granite Ave & W Babcock St, Bozeman, MT” and is in a different format than the result addresses.
86
8. Address Accuracy: Result
IP Expectations
m
1 fro ulam
2 h
, 20 ish G
You will see three kindseof results:
2 8 w Mo
J u n
y Ka aza 78 nda
.95 y, J
R
• Business/POI ay, .51 b ain .17 un
o nd 176resultss n 6.5 e 2
• Address M type
. Ha
95. results 1
Ha by K 8, 20
7 8 sna aw 21
• Features without an expected address in i fr
Ra sh G om I
za hu P
Different address details are expected for each result type. For example, the Amazon river lamhas no
street address but its name is accompanied by the country, while the fast food place Wienerschnitzel
shows a complete address. You will need the appropriate expectations in order to rate addresses
accuracy.
The address details of a business or POI generally consist of: street number, street name, locality,
region, postal code, and country.
The address given is confirmed Correct when it points to the same physical location listed on the
official webpage or other official resources and all mandatory components for your market are
present. See your Country Specific guidelines for details on mandatory address components.
Use official resources to confirm an address when a business or POI’s official website does not
provide a full address or if there is a conflict with the address in the result. These resources can
include:
Mo IP
o m
7•8 nSocial media sites claimed by the business/POI and updated within the last 6 months fr ulam
.95 day, J 2 1
20 sh Gh
• Street
.17 uimagery
n (any recent online imagery showing streets and buildings) 8,
• Postal
6.5 e 2
1 bauthorities
8 (for postal codes and locality names) n e 2 Kawi za
Ha y K , 20 u a
• Government
sna aw property
21 registries da y, J 51 by in R
in i fr n 6 . n a
Ra sh G om I Mo 95.17 Has
za hu P 78. accept any of them
If a business or POI has more lam than one official address for the same location,
as Correct.
87
If no official resources can be found, IP according to consensus from multiple reliable sources.
o m rate
r am
Reliable resources include: 021 f hul
G
2 8, 2 wish Mo
• Articles in primary u ne publications
K a za
a (newspapers or similar n
publications
7 8.9 day, that do their own
y , J by R
reporting) a 1 in 5.17 Jun
ond 176.5 asna 6.5 e 2
• Crowdsourced
M 95.
. user
H review sites H
1 b 8,
78 asn y Ka 2021
ain wis fro
When no official resources are available and address components are missing Rora clearly
h mincorrect,
za Ghu IP
check to see if those components are required in the market or region of the result and select lam the
appropriate checkboxes under Incorrect. See your Country Specific guidelines for more information.
Some resources, like data aggregators, spammy directory sources, and so on, are unreliable, and
consensus between unreliable resources should be disregarded.
• Valid alternate street and locality names When valid alternate names for streets or
localities are used interchangeably, consider all versions Correct.
• Valid alternate street addresses: When valid alternate addresses are returned, consider all
versions found on the official website or confirmed by official sources as Correct.
When the address listed by the official website or resources is in a different format than the one seen
in the result, confirm if the address given is Incorrect or Can’t Verify. See Can't Verify for more
information.
If there is any obvious error in an official source, like a misspelled country or city name, and the
error appears in the result, rate the erroneous component Incorrect.
Some official addresses may contain a vanity street name or have no official street number. In rare
cases they may even lack a complete street address. Refer to the official webpage as well as to
common address formats in your country to determine the accuracy of each business or POI address.
When the official webpage does not give a complete address with street number and name for a
large entity (mall, university, etc.):
• Rate the result address Correct when it matches the address of any department or entity at
the same location complex or campus.
• Rate the result address Correct when it lists the correct locality for the entity. If the exact
Mo locality is unclear because the entity borders multiple localities, rate Can’t Verify. m
IP
7•8 nThe
da locality is always expected, even when no complete address is provided. If missing, fr rate
o lam
.95Incorrect
y, J 2 1 h u
.17 un – Locality. 0
8, 2 wish
G
• Region6 .51 and
e 2 postal code must also appear in countries where they are mandatory e 2
Ha by K 8, 20See your Country Specific guidelines for more information. Jun by Ka Raza
components.
sna aw 21 ay , 1 in
in ish from o nd 176.5 asna
Ra M 95. H
za Ghu IP 78.
lam
88
IP
Result Address Official
ro m m Address Rating and Explanation
0 2 1 f hula
G
2 8, 2 wish Address Accuracy
Mo Correct
ne a a 78 nda
, Ju by K Raz .95 y, has
Dartmouth Collegea y 1 in Dartmouth College.17 Jun no official street
nd 176.5 asna 6.5 website.
e
10 N Main St,
o
M 95. H address listed on their1 b 28, The address
8. H
in the result belongs y
asnto the 2
Ka Office
0 of
Hanover, NH 03755
7 2
wis 1 fro
Admissions, which is apartin of the larger
Ra h G m I
za
university, therefore the address his P
ulaCorrect.
m
Dartmouth College Address Accuracy Correct
Dartmouth College Hanover, NH The college lists only the locality as its
Hanover, NH 03755 official address and the result matches that
03755 USA address and is therefore Correct (even
though it is missing a street number and
name).
Address Accuracy Incorrect – Locality
Dartmouth College
NH A locality is expected in the address details
03755 for most POIs. Rate Incorrect – Locality
when the locality is given by the official
webpage but missing in the result.
In addition to a street address, a store or department can have the name of the complex or campus
that contains it and be rated Correct.
Stanford School of 559 Nathan Abbott This result is a department within Stanford
Law Way, Stanford, CA University. The address is Correct because the
Stanford University, 94305 larger entity name and correct locality is listed
Stanford, CA 94305 as the address.
89
IP
ro m m
If the entity has an official address f ula the result address belongs another entity in the same
2 0 21 Ghand
complex or on the same 2campus, 8, sh rate Incorrect. Mo
n e Kawi za 7 n
, u
J by R a 8.9 day,
a y 1 in 5.17 Jun
ond 176.5 asna 6.5 e 2
M 95. H 1 b 8,
Result Address
78 . Official Address Rating andH asn Explanation
y K 202
ain awis 1 fro
Incorrect
Ra h–GStreet
m Number
Address Accuracy za hu IP
& Street Name lam
Stanford School of
559 Nathan Abbott The result address belongs to the larger entity
Law
Way, Stanford, CA (Stanford University). The department has an
450 Serra Mall,
94305 official address that is different from the
Stanford, CA 94305
university’s address, so the result address is
rated Incorrect.
Incorrect – Street Number
Address Accuracy
Stanford University & Street Name
559 Nathan Abbott 450 Serra Mall, The result address belongs to a smaller entity
Way, Stanford, CA Stanford, CA 94305 within the university (Stanford School of Law).
94305 The university has an official address that is
different, so this address is rated Incorrect.
Address Accuracy Incorrect – Street Number
The Cheesecake
3041 Stevens Creek The result address belongs to the larger entity
Factory
Blvd (Westfield Valley Fair mall) that contains the
2855 Stevens Creek
Santa Clara, restaurant. The Cheesecake Factory’s official
Blvd
CA 95050 website lists a different address, so the
Santa Clara, CA 95050
address Incorrect.
Address Accuracy Incorrect – Street Number
Westfield Valley Fair 2855 Stevens Creek
3041 Stevens Creek Blvd The result address belongs a business (The
Blvd Santa Clara, Cheesecake Factory) within the mall. the
Santa Clara, CA 95050 CA 95050 shopping mall has an official address that is
different, so the address is rated Incorrect.
When both the result and the official webpage show identical but incomplete street addresses
(missing P
Mo street name, street number, or both) and the locality is correct, consider the addressom I
Correct.
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 b 8, u ne Kaw aza
Ha y K 20
sna aw 21 da y, J 51 by in R
in i fr n 6. na
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
90
Result Address Official IP Address Rating and Explanation
ro m m
0 2 1 f hula Address Accuracy Correct
G
Pilot Thomas 2 8, 2 wish M
ne a za This result is 7for oandself-serve gas station for
Cardlock , Ju by K StateRa Hwy 115 & 8.9 ay,
y
a .51 ain commercial vehicles.5.1 WhileJ we would normally
d
State Hwy 115on& 176 asn Mustang Drive, 7 une
M 95. H expect a full address6.5for 1 b 8,type of result, the
this
2
Mustang Drive,
78. Andrews, TX 79714 H
official website lists onlyasn yan 20
Kaintersection.
21 The
Andrews, TX 79714 a
result listing matches theinofficial w fro
ish website, so
Ra Gh m IP
the result is rated Correct. a z ula
m
Address Accuracy Can't Verify
When the street address is missing from the result but the official webpage has a street address,
consider the address Incorrect.
91
Result Address OfficialIP Address Rating and Explanation
ro m m
0 2 1 f hula Address Accuracy Incorrect – Other Issue
G
2 8, 2 wish M
John F. Kennedy June y Ka aza The address7on othe n official airport site is for
b 4 RWorld Trade 8.9 day,
,
day 6.51 snainCenter, 150
International nAirport The Port Authority 5.1 of NY
J & NJ corporate
76 une
Mo Center,
4 World Trade 7
5.1 Ha Greenwich St., office, which is not the.51 location
28 of the actual
. 9 ,2
Hathebyresult
78 St.,
150 Greenwich airport. Even though sna Kaw 21 0address
New York, NY 10007 matches the address listed in onishthefrofficial site,
New York, NY 10007 R om
za Gnot
it is a different location and adoes IP to
hu refer
lam
the location of the result POI.
Moving entities can either be on a fixed schedule or move at random. In some cases, entities appear
to be moving because they are located in a truck or similar vehicle, but are actually permanently
based at the same location.
Random location
The location of randomly moving entities cannot be predicted and should not be shown on the map.
Rate such businesses as Result is closed or does not exist.
Fixed schedule
Some entities, such as food trucks, move on fixed schedules. Their stops and schedule are usually
posted on their official webpage. The most accurate location for these entities is the address of their
longest stay over a full cycle of the given schedule (i.e. if a business has a weekly cycle and stays in
one spot for four days, that spot will be the only acceptable address for it). Mark any other address as
Incorrect – Other Issue. In cases of a tie, consider any of those locations Correct.
Fixed location
Businesses that operate out of a truck or bus that is stationary are evaluated like a standard business.
The vehicle does not need to be parked at the location after closing hours to be considered at a fixed
location.
8.1.4. Events
Some events can be very prominent but happen only a few days a year, others are regularly recurring.
92
If the query and location intent are clear, assign an appropriate relevance rating, otherwise rate Bad.
Treat seasonal stores (like Spirit Halloween IP store) and seasonally open POIs (like California’s Great
r o m m
America theme park), the same 1 fwayuas la annual events.
02 Gh
2 8, 2 wish Mo
Depending on its location, u ne K an a event
a z a may not have an official address.
7 nd kind of event should be
8.9 Thisay,
y , J by R
d a .51or natural
treated like a landmark a i n feature. 5. 1 Ju
o n 176 asn 7 6 ne
M 95. . 5 1 2
8. H H by 8, 20
7
Singular or Non-Established Events asn Ka 21
ain wis fro
Ra h G m I
za hu P
Non-recurring events from the past don’t carry any map significance and are rated Business/POI
lam
closed or does not exist, unless the location of the event became a POI (due to its historical
importance) that carries the name of the event further.
An address usually includes a street number, street name, locality, postal code and state/region. It
can be the same as the mailing address or other addresses provided by the official resources. Use
the chapter Address Formats, below, as well as your local knowledge, to identify the necessary
components and format.
• The address given has to be associated with a building or a plot of land officially assigned
that address.
• P.O. boxes are not valid addresses in the map context. Rate such addresses as Incorrect –
Other Issue.
If your research shows that the address does not exist, see Address Does Not Exist.
93
It might be impossible to confirm an address on official resources when another format is used. Rate
P
Can’t Verify if the address pointsom toIthe same location using an alternate format and there are no
missing or incorrect components. 1 f ulam
r
02 Gh
2 8, 2 wish Mo
u ne Ka aza 7 n
8.9 day,
y , J by R
8.2.3. Street Result
a 1 in 5.17 Jun
o nd 176.5 asna 6.5 e 2
M 95. H 1 b 8,
.
Depending on78the length of the street, different address components areaexpected.H y 2
sna Kaw 021
in i fr
Ra sh G om I
Mandatory components may vary per country. See your Country Specific guidelines za for P
hua complete
lam
list.
• Local roads: Local roads that stay within a certain locality or county should carry the
appropriate locality and state name.
• Highways/Interstates: Longer roads that travel between cities or even states don’t require a
locality or state component. If such components are present, they must be accurate.
U.S. Route 395 covers almost the entire distance from Canada to Mexico. It passes through four
states and connects countless towns, such as Big Pine, CA. Within that locality, it carries for a short
distance the name N Main St. The two results have different expectations regarding components.
There are several forms that are appropriate for the result
U.S. Route 395 because of its length:
For the result N Main St, there is only one expected form
because the road is short and stays within the locality:
A locality result can be a city, village, municipality or neighborhood. In the U.S. the result usually
includes the state it is part of.
Mandatory
Address Explanation
components IP
Mo o m
n
78Sunnyvale, fr ulam
.95 day, J CA Locality, State Mandatory components may vary per 2 1
Gh
20 country.
.17 un 8 , i s h
2
Check your country specific guidelines
ne Kaw afor za a
6.5 e 2
Amsterdam,
1
Ha by K 8, 20 Locality complete list. , Ju b y R
Netherlands
sna aw 21 ay 1 in
in i fr o nd 176.5 asna
Ra sh G om I M 95. H
za hu P 78.
lam
94
IP
ro m m
f la
2 0 21 Ghu
8, sh Mo
8.2.5. Postal Code Result n e 2 Kawi za 7 n
, u
J by R a 8.9 day,
y
a .51 when n 5.17 Jun or letters.
Postal codes are
o 1 7 6 asnai
ndreturned the user query matches the specific numbers 6.5 e 2
M 95. H 1 b 8,
78 . H asn y Ka 2021
Mandatory ain wis fro
Query Address h
RExplanation
components aza Gh m IP
ula
m
Sunnyvale, CA Locality, State, Postal
[94087] Mandatory components may
94087 code
vary per country. Check your
Museumplein, 1071 Country Specific guidelines for
[1071 DJ] DJ Amsterdam, Postal code, Locality a complete list.
Netherlands
8.2.6. State/Region/Territory Result
If the user makes the query from a country outside the state or region result, that result must be
accompanied by the country name.
Mandatory
Address Explanation
components
California State name
If the result is outside of the test locale, country
North-Holland Region name
name is a mandatory component.
Puerto Rico Territory name
The country is the highest administrative level and has no other address component.
Mandatory
Address Explanation
components
Netherlands Country The country is the highest administrative level
Romania Country and has no other address components.
Parks and other protected areas are artificial boundaries created to help protect the natural feature.
Those POIs are often named after the natural feature they contain. In cases where a feature can be
considered a POI, such as Mount Rushmore or a state park beach, the official address can be
returned. There might be other natural features within a park that reference the park name as part of
their address details.
Treat landmasses like islands and continents as natural features with no expectation of a street
address. If one is returned, rate it Incorrect – Other Issue.
96
8.3.2. POIs Without an Expected IP
ro m Address
m
0 2 1 f hula
POIs without an expected8address
2 , 2 ish G differ from regular POIs and businesses
Mo in that the user would not
expect a street nameuand w a to be shown.
ne number
a n
K z 78 da
a y , J 1 by in Ra .95 y, J
d
n 176 asn . 5 a .17 un
These typesM ofo POIs include, but are not limited to: 6.5 e 2
. 9 5. H H
1 b 8,
78 asn y Ka 2021
• Parks (Golf courses and theme parks not included) ain wis fro
Ra h G m I
• Monuments za hu P
lam
• National Landmarks
• Park-like heritage sites
• Bridges
• Squares
• Parking lots
• Transit POIs - these can include airports (including airport terminals), ferry ports, subways,
bike share stations, train and bus stops
The rating criteria described in the sections below apply to all features without an expected address.
See Official Address Present if this kind of POI has an official address
Whether there is an official street address or not, POIs without an expected address do not need to
show it. The locality must be returned whenever a POI is small enough to fit entirely within it. A POI
that covers an area overlapping several localities does not require a locality component.
See your Country Specific guidelines for more information on mandatory address components.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
97
Result Official Address
IP Rating and Explanation
ro m m
f la Address Accuracy Correct
2 0 21 Ghu
8, sh Mo
n e 2 Kawi za 78 nda
a y , Ju 1 by in Ra .95 y, J
nd 6.5 na .17 un
6.5 e 2
Mo 95.17 Has 1 b 8address
Quincy Station
78. 220 S. Wells St, This is a transit POI so no
Ha street
y ,2 is expected.
sna Kaw 021
Chicago, IL Chicago, IL 60606 The result address is just theinlocality.
i h The
fro POI is
Ra slocality
physically located within the given
m
za Ghu and IP it
l a
matches the one listed within the official address.
m
Some of these features have an official street address listed on their website or found on other official IP
Mo but users wouldn’t necessarily expect the address to be shown. Since a full addressois
sources, m not
78 nda 1 fr ulam
expected,
. 9 5.1 the
y , J result does not need to contain a full address even if there is one found via 20 official
2 Gh
7 un 8 , s h
sources. Do 6.5 note 2automatically consider any missing street address components as eincorrect. 2 aw i
1
Ha by K 8, 20 Ju n
y K aza
, b R
Full Address:
sna aw 21
When
in isthe fresult
r contains a full address it should be rated day 6if:
Correct
n . 51 nain
• The result aand
R h G om I Mo 95.17 Has
za official
hu Paddresses are identical 78.
lam
Street: When the result address is just a street it should be rated Correct if:
• The result address street is the same as the street within the official address
98
Consider the following examples for IP
o m Embarcadero Station in San Francisco:
1 f ulam
r
02 Gh
2 8, 2 wish Mo
u ne Ka aza 7 nd
8.9 and ay, Explanation
Result ay, J 1 by Official
i n R Address Rating 5 Ju
d . 5
n 176 asn a . 17 ne
o 6 . 5 2
M 95. H Address Accuracy Correct1 by 8, 20
Embarcadero 7 8. H asn Ka 21
Station ain wis fro
The result has a full address that Ra is hthe m
298 Market St, San za Ghsameula IP as the
Francisco, CA 94111 address listed on the official website. m
When the result address is more specific than the official address it can be rated as Can’t Verify or
Incorrect, unless another official source can be found to confirm the returned address.
Mo IP
o m
n
78Address: fr ulam
Full .95 day, J When the result contains a full address it should be rated Can’t Verify if2all 02 1 of Gthe
h
following.17 apply:
un 8, i s h
6.5 e 2 2
• It Hdoes1 bnot8belong
, to another POI/entity u ne Kaw aza
2
a n y Ka 021 y, 51 by in R
J
• The sstreet
ain within
w i the
fr result address matches the street listed as the a
official
n d 6. address
na
Ra sh G om I Mo 95.17 Has
za hu P 8.
If the full address belongslato m another building not associated with the POI7 it should be rated
Incorrect.
99
Consider St Nicholas’ Church in Berlin, Germany:
IP
ro m m
f la
2 0 21 Ghu
Result 8, wish Address Mo and Explanation
n e 2 Official
K a za Rating
7 n
, u
J by R a 8.9 day,
a y 1 in Address Accuracy 5.17 Jun Can’t Verify
ond 176.5 asna 6.5 e 2
M 95. H 1 b 8,
.
78Church H
The result POI is a landmark y K 202and museum.
asn church
St. Nicholas’ a 1
Nikolaikirchplatz 3,
a n R wstreet
The result has a full [Link] ish fronumber is
a Gh m IP
10178 Berlin, not associated with any other POI aor entity
z ula and the
street within the address matches the m street
official
Germany
address.
Address Accuracy Incorrect – Street Number
St. Nicholas’ Church Nikolaikirchplatz The result has a full address. The street number
Nikolaikirchplatz 5, 10178 Berlin, belongs to a building not associated with the POI and
10178 Berlin, Germany should be considered incorrect. The street within the
Germany address matches the official street address.
Incorrect – Street Number,
Address Accuracy
St. Nicholas’ Church Street Name
Poststraße 1, The result has a full address. The street name does
10178 Berlin, not match the official street name, so both address
Germany components should be considered incorrect.
If no official street address is found, the result street address can be rated as Can’t Verify or
Incorrect unless another official source, like street imagery, can be found to confirm the returned
address. When there is no official address the returned street address cannot be confirmed and
therefore cannot be considered correct. (Please see your Country-Specific guideline for more
details.)
Full Address: If the full address belongs to another building not associated with the POI (even if they
are on the same street) it should be rated Incorrect. When the result contains a full address it should
be rated Can’t Verify if all of the following apply:
Mo IP
Street: When the result address is just a street it should be rated Can’t Verify if: o m
78 nda 1 fr ulam
.
• 5The 2
20 sh Gh
.17 , street provides access to the intended POI
9 y Ju
n 2 8, i
6.5 e 2
1 b 8, u ne Kaw aza
DeterminingHa Access:
y 2
sna Kaw 021 a y, J 51 by in R
in i fr n d 6. na
Ra sh G om I Mo 95.17 Has
A person must be able za tohureach
lam the POI directly from the given street by walking
P
78. or driving. This
includes:
• Streets providing access by following the boundaries of the feature or leading into it.
100
• T-intersections:
• A street ending at anomintersection IP does not provide access to the feature on the other
side of it. 1 f ulam
r
02 Gh
• A street provides 2 8, 2 wisaccess
h to a feature when it continues Mo through the feature (even as a
n e Ka za n it keeps its original name on
different ,road u
J by type with
R a or without a different name) as 7long
8.9 das ay,
the otherd y
a side 5 1 ofathe
i n feature, and by doing so provides physical 5. 1 Ju
access.
n 176 asn . 7 6 ne
o . 5 28
• IgnoreMaccess
. 9 5 . restrictions
H when considering whether a street provides
H
1 by access
, or not.
7 8 asn Ka 2021
ain wis fro
Ra h G m I
za hu P
lam
Grosvenor Square Garden The result address is the street in front of the result POI. Like the
Grosvenor Square, example illustrated above, this street provides direct access to the
London result POI.
Mo IP
o m
78 nda fr ulam
.95 y, J Address Accuracy Incorrect – Street Name 2 1
.17 un 8 , 20 sh Gh
Grosvenor6.5 Square
e Garden The street ends in a T-intersection with the parkunone 2the aw
i
other side.
1 b 28, K aza
N AudleyaSt. y K 02
H 2 The street does not continue on the other side
J b y R
s a 1 ay as1it becomes
, in S
London nain wish from Audley St. and is therefore rated Incorrect.
o nd 176.5 asna
Ra M 95. H
za Ghu IP 78.
lam
101
Result IP Rating and Explanation
m
ro lam
2 1 f Address
u Accuracy Incorrect – Street Name
, 2 0
h Gh
8 s Mo
n e 2 Kawi zaThe result address is just a street. The
n street does not provide
Charles de Gaulle, JAirport
u y a 7 8.9 day,
a y 1 b
in
R direct access to the result POI and should
5.17 Jube considered Incorrect.
Rue A. Parreux,
o nd 176.5 asna 6 n e
.51 28
Mauregard M .95. H H b ,
7 8 asn y Ka 2021
ain wis fro
Ra h G m I
za hu P
lam
Address Accuracy Incorrect – Street Number
Charles de Gaulle Airport The result has a full address. The street provides direct access
4 Rue de la Fossette, however, the street number belongs to a building not associated
Mauregard with the result POI and should be considered Incorrect.
Zurich Airport Since the airport is associated with a distinct locality “Kloten” it
requires at least a locality name and is rated Incorrect – Locality if
this is missing.
9. Pin Accuracy
For each result returned, you will find a pin on the map. Rate the accuracy of each pin’s placement
using this scale:
• Perfect
• Approximate
• Next Door
• Wrong
• Can’t Verify
The pin should be a reflection of the result: The location represented by the pin should reflect the
result.
Mo Pin ratings should be evaluated individually and not influenced by address or other data. IPpin
A
o m
78bencorrect
can fr ulam
.95 day, J when other rating components are rated wrong. 2 1
20 sh Gh
.17 un 8,
6.5 e 2
9.1. General 1 bConsiderations
8 n e 2 Kawi za
Ha y K , 20 u a
sna aw 21 da y, J 51 by in R
. a
n R ish fwill
The following ichapters n
ro provide more detail on how to evaluate pin placement 6 asn on the
Mo 95.17 based
aza Gh m IP 8.
H
feature presented. They udescribe
lam issues to consider when evaluating the 7pin.
102
9.1.1. Pin Resources
IP
ro m m
Rate pin placement according21tof consensus la from multiple reliable online resources. These resources
0 G hu
should include both aerial8and , 2 street-level
sh views whenever possible. MoReliable resources include:
n e 2 Kawi za 78 nda
, Ju by R a .95 y, J
• Reliable online
d a .5map
y 1 aresources,
i n including vector and hybrid views.17 un
on .176views
• MHybrid a sn may provide additional points of reference including 6.5 e 2 the locations of
. 9 5 H 1 b 8,
streets
78 H asn y Ka 2021
• Street imagery ain wis fro
Ra h G m I
• Accurate street-level imagery can also be found on claimed social media za ula P
hsites,
m
crowdsourced user review sites, and articles in primary publications (newspapers or similar
publications that do their own reporting)
• Official venue maps and directories, which can contain information not available in street
imagery
• Government property registries
Note: After consulting these research resources, always verify pin placement using the layers
provided in the TryRating tool. This means that even if you have gathered coordinates elsewhere, you
must rate pin placement based on what you can actually see in the TryRating layers.
Leave comments including coordinates and links to resources if the pin rating was difficult to
determine or if you could not verify the pin’s placement.
When there is a difference between where the pin drops in satellite imagery and the vector map,
always use the map layer in the TryRating tool that is more generous towards the pin. For example, if
the pin drops on the rooftop in satellite imagery, but in the parking lot in vector map, rate using
satellite imagery because a pin on a rooftop will get a better rating than a pin placed in a parking lot.
Even if there is a major shift between satellite imagery and the vector map in a larger area, such as a
complete city or region, rate according to the most generous layer.
Note: When deciding between the generosity of the vector and satellite views for pin rating, use only
the vector/satellite views provided in the TryRating tool.
In cases where the vector map is more generous toward towards the pin but does not show any
building contours, use satellite imagery as a reference to locate buildings on the vector map to allow
for rooftop ratings. If satellite imagery is unavailable, use your best judgment to determine the
correct location of the pin.
IP
In the
Moscreenshot below, the vector map does not provide any contours, so it is difficult to determine
o m
78 neach fr ulam
where.95 day, Jbuilding is. Satellite imagery should be used instead. 2 1
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 b 8, u ne Kaw aza
Ha y K 20
sna aw 21 da y, J 51 by in R
in i fr n 6. na
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
103
IP
Vector Imagefrom lam Satellite Image
, 2 021 Ghu
8 sh Mo
n e 2 Kawi za 78 nda
a y , Ju 1 by in Ra .95 y, J
nd 6.5 na .17 un
6.5 e 2
Mo 95.17 Has 1
78. Ha by K 8, 20
sna aw 21
in i fr
Ra sh G om I
za hu P
lam
To rate a pin for a feature, you must first understand where the feature begins and ends. Some
features have rooftops (houses, businesses, malls, and so on) and sit on a parcel of land that belongs
to or is associated with them. Other features do not have rooftops (mountains, parks, waterfalls), but
there is still a place where they begin and where they end.
A boundary is a real or imaginary line that separates one feature, or the parcel it sits on, from another.
The boundaries of a feature always include half of the road when a road is present (see the Half 'n
Half rule below).
If there is no divider, draw an imaginary 90-degree line to the road or use the Half 'n Half rule below.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
104
Example IP Explanation
ro m m
f la
EXAMPLE TYPE: SINGLE RESIDENTIAL 0 21 Ghu PROPERTY
8, 2 sh Mo
1556 Tobias Dr n e 2 Kawi za 78 nda
San Jose, CA 95118
a y , Ju 1 by in Ra .95 y, J
nd 6.5 na .17 un
6.5 e 2
Mo 95.17 Has 1
78. Ha by K 8, 20
sna aw 21
in i fr
Ra sh G om I
The property boundary is defined
za hby
ulahalf
P of the
road on one side and physical dividers mlike brick,
concrete, and wooden fences on the others.
105
Example IP Explanation
ro m m
f ula
EXAMPLE TYPE: HALF ’N HALF 0 21TOGhSTREET
8, 2 sh Mo
n e 2 Kawi za 78 nda
a y , Ju 1 by in Ra .95 y, J
nd 6.5 na .17 un
6.5 e 2
Mo 95.17 Has 1
78. Ha by K 8, 20
sna aw 21
in i fr
Ra sh G om I
za hu P
lam
Extend the feature boundaries to the middle of
the road(s). The example shows how Will Rogers
Dr and Saratoga Ave is divided in half to define
the outer limits.
Use natural boundaries as much as possible to draw the line between a Perfect, Approximate,
Next Door, and Wrong pin locations.
•If the tip of the pin is still touching the line, the pin is considered inside the
Mo boundary. IP
•If the tip of the pin points outside, it is outside of the boundary. fr o m
78 nda 1 u lam
.95 y, J 0 2 G h
.17 un
6.5 e 2 2 8, 2 wish
e
1
Ha by K 8, 20 , Jun by Ka Raza
sna aw 21 ay 1 in
in ish from o nd 176.5 asna
Ra M 95. H
za Ghu IP 78.
lam
106
[Link]. Boundaries in Shared Spaces
IP
ro m m
f ula
When a feature shares a parcel 2 0 21 orGparking
h lot with other entities and the same space is used to
access many entities, itecan 28, abe i
w a s h
difficult to determine a feature’s boundaries.
Mo In cases like this:
u n K a z 7 n d
J y 8.9 ay,
• Use theoguidance
d ay, .51 bprovided
a i nR in Boundaries of the Feature
5.1 Ju
n 176 asn 76 ne
. .51 28
• If the shared
M
. 9 parcel contains any through roads, apply the Half ’nHHalf
5 H byrule, to
2 them:
8 sna Ktoawgo02to
7
• Through roads are part of the public road network that can be aused 1 places other
in ish from
than the specific parcel R aza Gh IP
• The Half n‘ Half Rule may also be applied to the parcel’s internal access roads ula if they
m
meet all three of these conditions:
• They must continue all the way through the parcel and
• They must have an exit and entrance to public roads at both ends and
• They must be continuously and clearly separated from the shared parking areas by
curbs, barriers, road markings, do not cross lines, or similar features
Example Explanation
EXAMPLE TYPE: BOUNDARIES OF AN ENTIRE CAMPUS
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
107
Example IP Explanation
r o m m
EXAMPLE TYPE: BOUNDARIES
f la
2 0 21OFGAhuPOI IN A SHARED SPACE WITH THROUGH ROADS
e 28, awish Mo
Nordstrom @ Stanford n Shopping
K z Center
a 7 n
, u
J by R a 8.9 day,
a y 1 in 5.17 Jun
ond 176.5 asna 6.5 e 2
M 95. H 1 b 8,
78 . H asn y Ka 2021
ain wis fro
Ra h G m I
za hu P
lam
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
108
Example IP Explanation
ro m m
EXAMPLE TYPE: BOUNDARIES
f la
2 0 21OFGAhuPOI IN A SHARED SPACE WITH NO THROUGH ROADS
8, sh Mo
Pho 2 Love n e 2 Kawi za 7 n
, u
J by R a 8.9 day,
6593 W Colfax Ave y 5
da 6.51 snain
n80214 .17 Jun
Lakewood, CO o
M 95. 1 7 a 6.5 e 2
. H 1 b 8,
78 H asn y Ka 2021
ain wis fro
Ra h G m I
za hu P
lam
A pin is considered Next Door if it drops on the immediate property next to the intended one. A Next
Door pin must be:
• On the same street as the intended property
• The Next Door property must share the same street name as the intended property
• On the same side of the street as the intended property
•M The first property to any side of the intended property m
IP
o o
fr ulam
7•8 nOn the same block as the intended property
.95 day, J 2 1
20 sh Gh
.17 un 8 ,
"Immediate
6.5 e 2
1property"
8 refers to the boundaries of the property as a whole, even if e 2 Kaiswinozarooftop.
there
n
H by K , 20 J u y Ra
Determineasthe na boundaries
aw 21 f as explained in Boundaries of the Feature. day, .51 b ain
in i r n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
109
No Next Door for Shared Spaces IP
m
1 fro ulam
A feature cannot be Next, 2Door 02 G toh another feature within the same property boundaries. This
8 s h
means that two buildings 2
ne K inawthe asame shared parking lot or parcelMcan
i o never be rated as Next
u a z 78 nda
Door to one another. J y R . 95 y, J
d ay, .51 b ain .17 un
on 176 asn 6.5 e 2
M 95. H 1 b 8,
There will also
78 be no Next Door ratings made outside the parcel or shared
. H asn space.
y K 20Any pin falling
2
outside of the Approximate area will be marked Wrong. ain awis 1 fro
Ra h G m I
za hu P
lam
When a specific rooftop or boundary cannot be identified, Perfect cannot be given. In these cases,
Can’t Verify can be used if the pin is within the smallest area that can be identified as a potentially
correct location. A pin outside of this area is considered Wrong.
The Can’t Verify rating will also be used when an address is rated Incorrect (Address does not
exist).
Example Explanation
920 Remour Ln
Mount Shasta, CA 96067
110
Example IP Explanation
ro m m
350 352 Bukit Batok Street 34 f la
2 0 21 Ghu
Singapore, 650352 8, sh Mo
n e 2 Kawi za 78 nda
, Ju 1 by in Ra There is satellite
.95 imagery
.17 , Jun for this area, but
y y
a
nd 6.5 na clouds cover the the 6.5exact
1 b 28location of the
e
Mo 95.17 Has , 2 other reliable
78. address. Using evidence
H y
asn Ka 21from 0
resources, a perimeter afor wi
in where the
fr pin should
Ra sh G om I
be dropped can be established za (teal
hu area).
P
lam
Can’t Verify -> All pins dropped within the teal
area
Wrong -> All pins dropped outside the teal area
Rating Explanation
Perfect Pin falls on the rooftop of the intended property.
Approximate Pin falls within the boundaries of the property, including on any rooftop that’s not
the intended one.
Next Door Pin falls on the next door property.
Pin falls outside of the property boundaries or next door property. Any pin falling
Wrong
outside of the Approximate area in a shared space will be rated Wrong.
Can't
Mo Verify See Can’t Verify IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
111
IP
o m m
Best Available Evidence f r la
2 0 21 Ghu
8, wish Mo
Pin rating for most features n e 2 Kafound z a under rooftops is based on the7 best
nd available evidence for that
u
J bis, y theRamore evidence that can be found to8.9verify ay,
feature's location. y ,That
a .51 ain 5 . 1 aJufeature’s location, the
d 7
more precise o n
M the .pin’s
7 6
1 Hlocation
a s n must be in order to be rated Perfect. (This 6 .51 isnetrue
2 whether or not the
feature's address. 5
9 includes a unit number because the goal is to find the H by 8, 2of
7 8 asn Ka 02the
location feature.)
ain wis 1 fro
Ra h G m I
If street imagery or other strong evidence can be found to confirm a feature’s specific za hulocation
lam
P
under a shared rooftop, only that location will be considered Perfect.
If a shared rooftop can be identified but there’s no strong evidence to confirm the feature’s specific
location under it, the entire rooftop will be considered Perfect.
If several rooftops share an address and there’s no strong evidence to confirm which rooftop the
feature is under, all rooftops will be considered Can’t Verify.
Note: This general pin rating rule does not apply to transit POIs, which have their own pin rating
rules.
Example Explanation
112
Example IP Explanation
ro m m
2 1 f hula
EXAMPLE TYPE: MULTIPLE 0
2 sh G NUMBERS UNDER ONE ROOFTOP WITHOUT SHARED PARKING
8, STREET
2 i Mo
u ne Kaw aza 7 n
8.9 day,
y , J by R
a .518037 in 5.17 Jun
Breitensteinstrasse
nd 17677, s na Zurich 6.5 e 2
o
M 95. a
. H 1 b 8,
78 H asn y Ka 2021
Available resources can have a big impact on rating when a pin is dropped aon in a w
rooftop
i fr with multiple
Ra sh G om I
street numbers under it. za hu P
lam
This result is a residential townhouse without shared parking.
Note that the same rating principles apply to buildings with patchwork rooftops.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
113
Example IP Explanation
ro m m
f la
2 0 21 Ghu
8, sh Mo
e 2 Kawi za 78 nda or other strong evidence,
n Without street imagery
y , Ju 1 by in Ra .95 y, J
a
nd 6.5 na research may indicate .17 thatunthe address range under
6.5 e 2
Mo 95.17 Has the rooftop is 75 to 81,Hbut 1 bthe8locations where the
78. a y K , 202
middle numbers 77 and 79 s na start
a and 1 end cannot be
in wish from
determined. In this case, a pin Rafalling anywhere on
Without evidence za Ghu IP
the correct rooftop will be rated as Perfect, lam even if
the precise location on the rooftop for #77 cannot
be determined. A pin falling within the property
boundaries will be considered Approximate and
the buildings to the right and to the left will be
considered Next Door.
Perfect -> The pin is on the rooftop (green area)
Approximate -> The pin is within the boundaries
of the feature (yellow area)
Next Door -> The pin is on the immediate property
next to the intended feature (purple area)
Wrong -> The pin falls outside of the property
boundaries or Next Door property (everything
else)
Can’t Verify -> See Can’t Verify
EXAMPLE TYPE: ONE BUILDING WITH MULTIPLE STREET NUMBERS IN A SHARED PARKING LOT
Supercuts
1054 E El Camino Real
Sunnyvale, CA 94087
The result is a business (or an address) under a connected rooftop with multiple street numbers
under it. This result shares a parking lot with other features.
Note: If there are any other buildings within the shared parking lot that are not connected to the
Perfect location, they will also be rated Approximate.
This guidance also applies to residential buildings with shared rooftops, like townhouses.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
114
Example IP Explanation
ro m m
With evidence f la
0 21 Ghu
8, 2 sh With street imageryMo or other strong evidence, the
n e 2 Kawi za exact location of78the nbusiness (or address) can be
, Ju 1 by in Ra .95 day, J
a y confirmed. Draw imaginary
.17 unlines on that part of the
nd 6.5 na 6.5the earea
Mo 95.17 Has shared rooftop to create 1 b 28, for Perfect. The
78. H asn y Kand
rest of the connected rooftop 20the shared
2
ain awis 1 fro
parking lot are rated Approximate. Ra h G m I
za hu P
lam
Remember: Make no Next Door ratings outside
the parcel or shared space. Any pin falling outside of
the Approximate area in a shared space will be
rated Wrong.
Without evidence
EXAMPLE TYPE: ONE BUILDING WITH A SINGLE STREET NUMBER AND MULTIPLE UNIT NUMBERS IN A
SHARED PARKING LOT
Subway
1923 59th Ave #155
Greeley, CO 80634
The result is a business (or an address) under a rooftop that has a single street number, multiple
unit numbers, and shares a parking lot with other features. It will be rated exactly the same way as a
result whose address does not include a unit number. Whether a result contains a unit number or
not, the goal is to use the best available evidence to find the result’s location.
Mo IP
o m
78 nIfdathere are any other buildings within the shared parking lot that are not connected
Note: 1 fr the
to u lam
.95 y, J 02 G h
Perfect.17 location,
6.5 ne 2 they will also be rated Approximate.
u 2 8, 2 wish
e
1
Ha by K 8, 20 , Jun by Ka Raza
This guidance a 21 f
sna also ay .51 ain
in wisapplies
rom to residential buildings with shared rooftops, like
nd townhouses.
6 n
Ra h G I M 95.17 Has
o
za hu P 78.
lam
115
Example IP Explanation
ro m m
With evidence f la
2 0 21 Ghu
8, sh Mo
n e 2 Kawi za 78 nor
, Ju 1 by in Ra With street imagery.95 dayother strong evidence, the
y ,J
a
nd 6.5 na exact location of the1business
. 76 une (or address) can be
Mo 95.17 Has confirmed. Draw imaginary
.51 28
78. Ha bylinesK
, 2on that part of the
02
shared rooftop to create the
s na areaaw for 1 Perfect. The
in ish from
rest of the connected rooftop Rand
aza Gh shared
the IP
parking lot are rated Approximate. ulam
Without evidence
EXAMPLE TYPE: MULTIPLE ROOFTOPS WITH THE SAME STREET NUMBER AND MULTIPLE UNIT
NUMBERS
Samurai Sam’s
4801 Washington St, Suite 5
Phoenix, AZ 85034
The result is a business (or an address) under a rooftop that's one of several rooftops sharing a
single street number and containing multiple unit numbers. All the buildings share a parking lot.
(The small rectangles on the bottom right are solar parking covers, not buildings.)
Mo IP
o m
This
78 guidance
n also applies to residential buildings with shared rooftops, like townhouses.1 fr ulam
.95 day, J 202 sh Gh
.17 un 8, i
6.5 e 2 2
1 b 8, u ne Kaw aza
Ha y K 20
sna aw 21 da y, J 51 by in R
in i fr n 6. na
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
116
Example IP Explanation
ro m m
f ula
With evidence for rooftop 0 21 Gunit
and h
2
8, wish With street imagery or other strong evidence for
locations 2 Mo
ne a a the location of the
78 rooftop
n and the unit under it, the
Ju by K Raz .95 dbusiness
exact location of the
ay,
.17 Jun (or address) can be
a y , 1 in
nd 176.5 asna confirmed. Draw imaginary 6.5 lines
1 b 28, on that part of the
o e
M 95. H
78. H
shared rooftop to createasthey area 20for Perfect. The
na Kaw 21 fr
rest of the connected rooftop in and
Ra shthe
i oshared
m
parking lot are rated Approximate. za Ghu IP
lam
Note: If there are any other buildings within the
shared parking lot that are not connected to the
Perfect location, they will also be rated
Approximate.
117
Example IP Explanation
m
ro lam
EXAMPLE TYPE: ONE BUILDING 1 fWITH
u
, 2 0 2
h Gh SINGLE STREET NUMBER AND MULTIPLE BUSINESSES UNDER
THE ROOFTOP 28 is Mo
u ne Kaw aza 7 n
8.9 day,
y , J by R
Swiss Chalet nda 6.51 nain 5.17 Jun
o 1 7 a s 6.5 e 2
1141 Highbury
M Ave 9 5. H 1 b 8,
.
78 Canada, N5Y 1A5 H asn y Ka 2021
London, Ontario,
ain wis fro
h
The result is a business under a single rooftop that has one street number andRcontains aza Gh mmultiple
ula IP
business. m
A Swiss Chalet, Globally Local, Fast Photo and other businesses all share this address.
With evidence
Without evidence
Mo IP
m
78 nda TYPE: SHOPPING MALL WITH A SINGLE ROOFTOP
EXAMPLE o
fr ulam
.95 y, J 2 1
.17 un 8 , 20 sh Gh
[Link]
51 e 2Fair
8 n e 2 Kawi za
2855 Stevens
Ha byCreek , 2 Blvd Ju y Ra
snaCAK95050
Santa Clara,
0
aw 21 f day, .51 b ain
in i r n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
This large shopping mall lcontains
am many stores under one rooftop at the same address.
118
Example IP Explanation
ro m m
f la
2 0 21 Ghu
8, sh Mo
n e 2 Kawi za 78 nda
a y , Ju 1 by in Ra .95 y, J
nd 6.5 na .17 un
6.5 e 2
Mo 95.17 Has 1
78. Ha by K 8, 20
sna aw 21
in i fr
Ra sh G om I
za hu P
lam
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
119
Example IP Explanation
ro m m
f la
EXAMPLE TYPE: STORE IN A20MULTI 21 Gh-uSTORY MALL
8, sh Mo
n e 2 Kawi za 78 nda
H&M , Ju 1 by in Ra .95 y, J
1004 Stoneridge a y
d Mall.5Rd Suite A 105 .17 un
a
on .176 asn 6.5 e 2
Pleasanton,M
CA.994588
5 H 1
Ha by K 8, 20
78 sna aw 21
With evidence in i fr
Ra sh G om I
za hu P
lam
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
120
Example IP Explanation
ro m m
f la
2 0 21 Ghu
8, sh Mo
n e 2 Kawi za 78 nda
a y , Ju 1 by in Ra .95 y, J
nd 6.5 na .17 un
6.5 e 2
Mo 95.17 Has 1
78. Ha by K 8, 20
sna aw 21
in i fr
Ra sh G om I
za hu P
lam
Without evidence
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
121
Example IP Explanation
ro m m
EXAMPLE TYPE: EMPTY PLOT 0 2 1 f hula
G
2 8, 2 wish Mo
n e Ka za 7 n
86 Liberty St. , u
J by R a 8.9 day,
Binghamton, NY a y 1 in 5.17 Jun
ond 176.5 asna 6.5 e 2
M 95. H 1 b 8,
All features that. H
78 do not have a rooftop will be rated as Perfect if the pinais y K 202within the
sndropped
a 1
boundaries of the feature. a in wish from
Ra
za Ghu IP
lam
57 Neal Street
London, England
Mo example, the rooftop behind the intended feature will not be considered Next Door. Next IP
In this o m
fr ulam
78 nda 1
Door5will
. 9
.17 be
y , J considered to the left or right of the intended feature. 2
20 sh Gh
un 2 8, i
6.5 e 2
1 b 8, u ne Kaw aza
The screenshot
Ha y K shows 2 that the boundaries of the Next Door property contain y, half
J of y the street. The
sna aw 021 d a . 51 b ain R
building behind in theishPerfect
fro
m building is not considered Next Door because
on it.1has
76 aasdifferent
n street
Ra G M 5 H
address. hu P I 9
za
lam 78.
122
Example IP Explanation
ro m m
f la
2 0 21 Ghu
8, sh Perfect -> The pin Mois on the rooftop specified in
e 2 Kawi za n
n the address (green
78 area)
.95 day, J
y , Ju 1 by in Ra
a
nd 6.5 na Approximate -> The .17pin uisn within the boundaries
6.5 e 2
Mo 95.17 Has of the feature (yellow Harea)1 b 8,
78. Next Door -> The pin is ona s
y K 202
na theawimmediate
1f property
i i rom
next to the intended featuren(purple
Ra sh Garea)
za h IP
Wrong -> The pin falls outside of the uproperty
lam
boundaries or Next Door property (everything
else)
Can’t Verify -> See Can’t Verify section
44 Russel Square
London, England
Here there is only one property that qualifies as Next Door. The property marked in red is on
another street (Montague Street) and does not meet all the criteria for the rating of Next Door.
When a property is on a corner, the Next Door property can be behind it as long as that property
shares the same street name.
123
Example IP Explanation
ro m m
EXAMPLE TYPE: RURAL AREA 0 2 1 f hula
G
2 8, 2 wish Mo
100 Mulligan Rd u ne Ka aza 7 n
8.9 day,
J
Laytonville CA ay, 51 b in R
y
5.17 Jun
ond 176. asna 6.5 e 2
M 95. H 1 b 8,
In rural areas,78the Next Door property will often be quite large. This is expected.
. H asn y Ka 2021
ain wis fro
Ra h G m I
za hu P
Perfect -> The pin is on the rooftop specified
lam in
the address (green area)
Approximate -> The pin is within the boundaries
of the feature (yellow area)
Next Door -> The pin is on the immediate property
next to the intended feature (purple area)
Wrong -> The pin falls outside of the property
boundaries or Next Door property (everything
else)
Can’t Verify -> See Can’t Verify section
1491 Kooser Rd
San Jose, CA 95118
This property has only one next door neighbor because the property to the left, in red, is not on the
same block as the intended property.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
124
9.2.1. Leaning Buildings IP
ro m m
f la
2 0 21 Ghu
8, sh Mo
n e 2 Kawi za 78 nda
Normal a y , JuBuilding
y
1 b ain R
a
Leaning.9Building
5.1 y, Ju
n d 6 . 5 n 76 ne
Mo 95.17 Has .51 2
78. Ha by K 8, 20
sna aw 21
in i fr
Ra sh G om I
za hu P
lam
When a building appears to be leaning in satellite view, the satellite photos do not always give
accurate information about a building’s shape or location. This is why even when a pin appears to
land on a leaning building, you cannot rely on satellite photos alone to rate pin placement.
Research the leaning building’s true location using consensus from multiple reliable resources,
including:
• Vector views
• Hybrid views, which may provide additional points of reference, including the locations of
streets the buildings lean over
• Street imagery
• Reliable online map resources
Always rate the pin based on the building’s actual location as confirmed by reliable resources, not on
the appearance of leaning caused by satellite photography.
If no reliable resources are available and the pin is not objectively wrong, rate Can’t Verify and leave
a comment.
Rating Explanation
Mo IP
o m
78 nda Pin falls on the building’s actual location as confirmed by consensus 1 fr ulam
Perfect
. 9 y
5.1 , Ju among multiple reliable sources. 2
20 sh Gh
76 ne 8 ,
.51 28 n e 2 Kawi za
,2
Ha by K Pin u y a
Approximate sna aw 0falls
21 within the boundaries of the property including on danya y, Jrooftop
51 b ain R
in that’s fro the intended one. n 6 . n
Ra sh Gnot
i m
I Mo 95.17 Has
za hu P 78.
l m
Next Door See Next aDoor.
125
Wrong Pin falls outside ofmthe IP property boundaries or next door property.
ro m
0 2 1 f hula
2 sh G
8, Verify.
Can't Verify See Can’t 2 i Mo
u ne Kaw aza 7 n
8.9 day,
y , J by R
a 1 in 5.17 Jun
ond 176.5 asna 6.5 e 2
M 95. H 1 8,
.
Satellite
78 View Vector View as by K 2021
H
na aw fr
Langham Tower and Jollibee Langham Tower and Jollibee in i
Ra sh G om I
za hu P
lam
The tallest building seen in satellite view, above left, is Langham Place Office Tower,
located at the corner of Argyle and and Portland streets in Hong Kong.
While in satellite view the building appears to lean over both Argyle and Portland
streets, the vector view, above right, shows the building’s actual location.
The fast food restaurant Jollibee, circled in red on vector diagram, above right, is
located at 16 Argyle Street. It cannot be seen in satellite view because the tower leans
over it.
Langham IP
Mo m
Place
78 nOffice
o
fr ulam
.95 day, J
Tower 2 1
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
126
Target Screenshot IP Pin Rating
Location ro m m
f la
0 21 Ghu
8, 2 sh Research shows that the pin lands
Mo
n e 2 Kawi za off the building’s
78 rooftop
nd (green
a y , Ju 1 by in Ra a
area), but on its.9property,
5.1 y, Ju making it
nd 6.5 na Approximate.
76 ne
Mo 95.17 Has .51 2
78. Ha by K 8, 20
sna aw 21
in fr
Langham i
Ra sh G om I
Place Office za hu P
lam
Tower
Some residential properties consist of more than one building associated with a single address. A pin
falling on any house(s) on the property will be rated Perfect. If the evidence shows that any other
structure on the property could also be a dwelling, it can also be rated Perfect.
In cases where the property also contains support or auxiliary buildings, including, but not limited to,
sheds, garages, greenhouses, playhouses, pergolas, and doghouses, these structures should be
considered
Mo part of the Approximate area. IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 b 8, u ne Kaw aza
Ha y K 20
sna aw 21 da y, J 51 by in R
in i fr n 6. na
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
127
Rating IP Explanation
m
fro of
Pin falls on21any
m
ulathe rooftop(s) of the house(s) within the boundaries of the
Perfect 0 Gh
2 8, 2 wish
property. Mo
u ne Ka aza 7 nd
8.9 on
,Pin
J falls
b y within
R the boundaries of the property (or asupport
y or auxiliary
y
Approximate nda 6.51 ain 5.17 , Jun
buildings
n within it) 6.5 e 2
Mo 95.17 Has 1 b 8,
78. H asn y Ka 2021
Next Door The next door property. ain wis fro
Ra h G m I
za hu P
lam
Pin falls outside of the property boundaries or outside of the Next Door
Wrong
property.
Example Explanation
EXAMPLE TYPE: INDIVIDUAL HOME WITH SEPARATE GARAGE
1351 Navarro Dr
Sunnyvale CA 94087
This property contains two buildings: the main house and a garage. Both buildings are on the same
parcel, belong to the same entity, and share an address.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 b 8, u ne Kaw aza
Ha y K 20 J y R
9.3. Multiple aw 21 f
sna Rooftops day, .51 b ain
in ish rom n 6 n
Ra Mo 95.17 Has
za Ghu IP .
Some POI results consist of lammultiple buildings associated with/owned by 7a8single business or POI. To
rate the pins for these results correctly, you must research and understand the relationship of the
structures within the boundaries of the property (or parcel of land) to the POI.
128
Two kinds of ratings are possible ofor IP
m multiple rooftop POI results:
1 f ulam
r
02 Gh
1. Multiple-Rooftop: When 8, 2 theshresult is a POI that contains no other Mo POIs and consists of more than
n e Kawi za
2
nd
one building with multiple
, u
J by rooftops
R a on the property. In cases like this,
7 8.9 primary
ay, rooftops will be rated
Perfect. The parcel y 1 n
d of.5 landa inside the boundaries of the POI will be rated
a i 5. J
17 Approximate.
u Properties
on .176 asn 6.5 ne 2
next door to Mthe.9intended
5 H one will be rated Next Door. 1 b 8,
Ha y K 20
78 sna aw 21
in ish from
2. Campus: When a multiple-rooftop result is a higher education institution like Raa university or a
za Ghu IP
medical, retail, or other type of business complex, most often containing other public-facing lam POIs. In
cases like this, the entire parcel or property inside the boundaries of the POI, including all rooftops,
will be rated Perfect. There will be no Approximate or Next Door ratings.
Single entities with multiple rooftops are single businesses or POIs that operate out of more than one
building. This category includes, but is not limited to, entities like factories, gas stations, apartment
complexes, company headquarters, lumberyards, and breweries, and other types of POIs that
generally do not contain additional businesses or POIs within them.
Every primary rooftop on the property will be rated Perfect. The parcel of land inside the boundaries
of the POI will be rated Approximate. Properties next door to the intended one will be rated Next
Door.
In cases where the property also contains support or auxiliary buildings, including, but not limited to,
guardhouses, dumpsters, storage sheds, donation bins, utility buildings, and toilets, these buildings
should be considered part of the Approximate area.
Rating Explanation
129
Example IP Explanation
m
fro ulam
EXAMPLE TYPE: BUSINESS 2WITH 0 21 GMULTIPLE
h ROOFTOPS AT SAME ADDRESS (GAS
, ish
STATION) 2 8 Mo
u ne Kaw aza 7 n
8.9 day,
y , J by R
a 1 in 5.17 Jun
Super Gaz nd 176.5 asna 6.5 e 2
o
700 Chambly M Road
. 9 5. H H
1 b 8,
20
8 a y
7
Longueuil, QC J4H 3M1 s na Kaw 21 fr
in i
Canada Ra sh G om I
za hu P
lam
This business (or address) is a gas station with a main building and a canopy over the
pumps. All structures are on the same property, belong to the same business, and
share an address.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
Figure 2:6Annotated
.51 e 28 satellite view of gas 2
b , u ne Kaw aza
H
station asn y Ka 2021 J y R
ain w fr day, .51 b ain
i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
130
Example IP Explanation
m
fro ulam
EXAMPLE TYPE: BUSINESS 2WITH 0 21 GMULTIPLE
h ROOFTOPS ON A SHARED PARCEL (GAS
, ish
STATION) 2 8 Mo
u ne Kaw aza 7 n
8.9 day,
y , J by R
Canadian Tire Gas+a 1 in 5.17 Jun
ond 176.5 asna 6.5 e 2
401225 ON-401
M 95.
. H 1 b 8,
78 N4S 7W8 H asn y Ka 2021
Woodstock, ON
ain wis fro
Canada Ra h G m I
za hu P
lam
This business is also a gas station with a canopy over the gas pumps, but it shares a
parcel with other businesses and a wooded picnic area.
131
Example IP Explanation
m
fro ulam
EXAMPLE TYPE: BUSINESS 2WITH 0 21 GMULTIPLE
h ROOFTOPS AT SAME ADDRESS
2 8, wish Mo
Bremac u ne Ka aza 7 n
8.9 day,
y , J by R
8133 Mechanicsville 51 nain 5.17 Jun
nd [Link]
a
o a s 6.5 e 2
Mechanicsville,
M 9VA 5. 23111 H 1 b 8,
. H asn y Ka 2021
United States78
ain wis fro
Ra h G m I
The business has three buildings. All buildings are on the same property, belongzato the hu P
lam
same business and share an address.
Fazerintie 2
01230 Vantaa Finland
Mo IP
o m
7 nd fr ulam
This.9is
8
5.1a large
ay, factory consisting of several buildings. 2 1
J , 20 sh Gh
76 une 2 8 i
.51 2 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
132
Example IP Explanation
ro m m
f la
2 0 21 Ghu
8, sh Perfect (green area inMFigure 2) -> If the
e 2 Kawi za on
n pin falls on any of the78 buildings.
.95 day, J
y , Ju 1 by in Ra
a
nd 6.5 na Approximate (yellow area .17 in Figure
6.5 ne 2 2) ->
u
Mo 95.17 Has If the pin falls within the property
1 b 8,
78. boundaries.
Ha y K 20
sna aw 21
in i fr
Ra sh G om I
z hu P
This particular POI has no Next Doora lam
area.
Merkuriuksentie 13
00750 Helsinki
Finland
This query is for an address that is shared by several apartment buildings on the same
parcel.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
133
Example IP Explanation
ro m m
f la There are five buildings with the same
2 0 21 Ghu
8, sh address on the [Link] pin on any of
e 2 Kawi za on
n them is rated Perfect78 while
.95 day,aJpin on the
y , Ju 1 by in Ra
a
nd 6.5 na parcel or any of the support
.17 structures
u
6.5 ne 2 is
Mo 95.17 Has rated Approximate. 1 b 8,
78. Ha y K 20
sna aw 21
in i fr
Ra sh G om I
za hu P
lam
33 Mile Roadhouse
33 Mile Haines Hwy
Haines AK 99827
United States
This business is a restaurant with a support building — a storage shed — in the back.
134
9.3.2. Campus Rating
IP
ro m m
f la
0 21 Ghu
Some POIs will encompass entire business complexes, meaning that
2
Mo there are multiple buildings
28, awish
associated with/owned n eby the POI.
a These POIs include (but are not
78 limited
nd to) institutional complexes
, Ju by K Raz . 9 ay,
like universities, dhospitals,
a .51 aand
y i n airports. Other POI types that can be rated 5. 1 Jas
uncampuses include
n 176 asn 7 6 e 2 zoos.
shopping and strip
o
M 95. malls
H with multiple rooftops, amusement parks, resorts, . 5 1 and 8,
. H b
78 asn y Ka 2021
wi
ain includingfr
In cases like this, the entire parcel or property inside the boundaries of the POI, Ra sh G omall rooftops,
will be rated Perfect. There will be no Approximate or Next Door ratings. z a h ula I P
m
The property of a campus complex includes the buildings themselves, any shared parking lots, and
half ’n half as described in the guidelines.
Wondering if a multiple-rooftop result is a campus? Many, though not all, campuses can be
identified by the presence of POIs within the POI. That is, individual stores within multiple-rooftop
malls, departments within hospitals, libraries and colleges within universities, spas and
restaurants within multiple-rooftop resorts, terminals within airports, and so on.
Rating Explanation
Note: The result may be for an address that should have the campus rule applied.
Some of these types of POIs may have polygons outlining the boundaries of the POI on the map.
These polygons may not always be present or perfect, so rate against the true boundaries of theIP
Mo m
campus
78 ndor complex as determined by research. A few examples of campuses are below, including fro ulamone
a 1
that .is
95missing
.17 , Jun its polygon.
y
8, 202 sh Gh
6.5 e 2 2 i
1 b 8, u ne Kaw aza
Ha y K 20
sna aw 21 da y, J 51 by in R
in i fr n 6. na
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
135
POI type IP Screenshot
ro m m
f la
2 0 21 Ghu
8, sh Mo
n e 2 Kawi za 78 nda
a y , Ju 1 by in Ra .95 y, J
nd 6.5 na .17 un
6.5 e 2
Mo 95.17 Has 1
Hospital 78. Ha by K 8, 20
sna aw 21
in i fr
Ra sh G om I
za hu P
lam
Park
Airport
Outlet Mall
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
136
POI type IP Screenshot
ro m m
f la
2 0 21 Ghu
8, sh Mo
n e 2 Kawi za 78 nda
a y , Ju 1 by in Ra .95 y, J
nd 6.5 na .17 un
6.5 e 2
Mo 95.17 Has 1
78. Ha by K 8, 20
sna aw 21
in i fr
Ra sh G om I
za hu P
Amusement Park lam
No Polygon available
Entities made up of a single cluster of buildings are the easiest to identify. On the map, these entities
can be represented by a single, continuous polygon. Remember, the polygons on the map may not
always be perfect or present, so rate against the true boundaries of the campus or complex as
determined through research.
The property of a complex includes the buildings themselves, any shared parking lot and half n half
as described in the guidelines.
Note: Parking facilities may be included in the polygon if they are owned by the POI
and contiguous to the campus (contiguous means that they are not separated from
the campus by a street).
Tip: Start by looking at the pin's location, then determine if the property surrounding
the pin belongs to the POI you are looking at.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
137
POI IP Screenshot Rating Explanations
ro m m
f la
2 0 21 Ghu
8, sh Mo
n e 2 Kawi za 78 nda
a y , Ju 1 by in Ra .95 y, J
nd 6.5 na .17 un
6.5 e 2
Mo 95.17 Has 1
78. Ha by K 8, 20
sna aw 21
in i fr
Ra sh G om I
za hu P
lam
Perfect (green area in Fig. 2) ->
If pin falls within campus
boundaries.
Wrong (everything else outside
Fig. 1: Vector view of Stanford
of green area in Fig. 2)-> If pin
University campus
falls outside campus
Stanford University
boundaries.
Remember, there is no
Approximate or Next Door
rating for campus and business
complexes.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
138
POI IP Screenshot Rating Explanations
ro m m
f la
2 0 21 Ghu
8, sh Mo
n e 2 Kawi za 78 nda
a y , Ju 1 by in Ra .95 y, J
nd 6.5 na .17 un
6.5 e 2
Mo 95.17 Has 1
78. Ha by K 8, 20
sna aw 21
in i fr
Ra sh G om I
za hu P
lam
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
139
POI IP Screenshot Rating Explanations
ro m m
f la There is no polygon available for
2 0 21 Ghu
8, sh Mothis POI, so an imaginary
n e 2 Kawi za n
78 polygon
y , Ju 1 by in Ra .95 day, J outline must be created
a
nd 6.5 na according
.17 un to the actual
6.5 e 2
Mo 95.17 Has boundaries
Ha by K 8,of2 the POI.
1
78. sna aw 021
in i h from
To determineRa swhere the valid
za Ghu IP
pin area is, look at the
lam location
of the attractions within the
amusement park and visualize
the boundary of the park to
determine the POI’s polygon.
Fig. 1: Vector view of The green area highlighted in a
Disneyland Park Disneyland Park satellite view of the POI (Fig. 2)
represents the valid area for the
pin to land in. A pin landing
anywhere outside of this green
area would be a Wrong pin.
In some cases, a campus will not have a single, continuous location that a polygon can be drawn over,
but rather be spread out across a large area like a city. Sometimes, the pin will fall on this type of
campus and there may not be a polygon for the campus. If this occurs, research to determine where
the polygon should be. Pins that fall on campus-associated, non-parking facilities are valid pins.
Apply the single rooftop rules to any standalone, non-parking facility, campus building. IP
Mo o m
78 nda 1 fr ulam
.
If two 5or y 2 Gh
.17more
, J campus buildings are next to each other, apply the single complex campus 20 logic.
9
un 2 8, i s h
6.5 e 2
1 ne Kaw aza
Ha by K 8, 20 u
y, 51 by in R
J
sna aw 21 da
in i fr n 6. na
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
140
IP
POI ro mScreenshot
m Rating Explanation
0 2 1 f hula
G
2 8, 2 wish Mo
ne a a 78 nda
y , Ju by K Raz .95 y, J
a 1 in .17 un
ond 176.5 asna 6.5 e 2
M 95. H Perfect
Ha ->
1 b If8the pin falls the
78. y K , 202
green polygon
s na awminus 1 f campus-
in parking
i rom
associated Ra sh G facilities and
za hu IP
non-campus-associated lam
buildings.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
141
IP
POI ro mScreenshot
m Rating Explanation
0 2 1 f hula
G
2 8, 2 wish Mo
ne a a 78 nda
y , Ju by K Raz .95 y, J
a 1 in .17 un
ond 176.5 asna 6.5 e 2
M 95. 1
78.
H Ha by K 8, 20
sna aw 21
in i fr
Ra sh G om I
za hu P
l m
The Boston Universityacampus is
also spread out across the city, as
represented by the highlighted
green areas. In this case, the pin
happens to fall on the Boston
Boston University Center for
University Computational Neuroscience and
Neural Technologies building. The
building is a standalone, non-
parking facility building that is
Fig. 1: Annotated vector view of the Boston associated with the campus, so
University campus the pin is Perfect.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
142
9.4. Features Without a Rooftop
IP
r o m m
This chapter will describe how21tof rate la
2 0 G hu pin accuracy for features that typically do not have a rooftop.
e 28, awish Mo
9.4.1. Natural Features u
J by
n K a z a 7 n
8.9 day,
y , R 5
a .51 ain .17 Jun
Natural features
ondinclude
1 7 6 abut s n are not limited to: 6.5 e 2
M 95. H 1 b 8,
78 . H asn y Ka 2021
• Lakes (Lake Victoria) ain wis fro
Ra h G m I
• Oceans (Pacific Ocean) za hu P
lam
• Creeks (Bear Creek in Colorado)
• Rivers (the Danube river)
• Ponds (Antonelli Pond in California)
• Wetlands (Laguna de Rocha)
• Seas (Black Sea)
• Forests (Black Forest)
• Mountains (Carpathian Mountains)
• Hills (Chocolate Hills of the Philippines)
• Plateaus (Colorado Plateau)
• Valleys (Death Valley)
• Plains (The North American Great Plains)
• Fjords (Geirangerfjord in Norway)
• Peninsulas (Indian Peninsula)
• Volcanoes (Etna)
• Deserts (Gobi Desert)
• Glaciers (Patna Glacier in Iceland)
• Waterfalls (Niagara Falls)
A natural feature may also have other natural features within or surrounding it. These could include,
but are not limited to, the shore of a lake, an island in a river, and a forest surrounding a mountain.
Similar natural features, even if not listed above, should be rated using these guidelines.
Rating Explanation
If the natural feature has a defining feature (water for a river/ocean, cliffs/peak of
a mountain, the sand for a beach), pin should fall on that feature or if the natural
Perfect
feature is defined by an arbitrary boundary (parks, national forests), pin should
fall in their polygon or where it would be if we had that information.
The pin falls outside of the defining features of a natural feature but still on it
(slope of a mountain rather than the peak, the shore of a river or lake). Consider
Approximate each situation individually. Not all natural features will have an Approximate. If
Mo the natural feature exists within an urban or suburban area, you may apply the IP
o m
78 nda Half 'n' Half rules. 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
Next Door6.5 e 2 N/A - Natural features do not have Next Door ratings. 2
1 b 8, u ne Kaw aza
Ha y K 20
sna aw The y, J 51 by in R
21 pin falls in an area that does not meet the criteria for dPerfect
a
on .176 asor
ish from . na
Wrong in
Ra Approximate. M H
za Ghu IP 95
lam 78.
Can't Verify See Can’t Verify
143
IP
o m m
Type of POI Screenshot
f r la Explanation
2 0 21 Ghu
8, sh Mo
n e 2 Kawi za 78 nda
a y , Ju 1 by in Ra .95 y, J
nd 6.5 na .17 un
6.5 e 2
Mo 95.17 Has 1
.
78Lake Merritt Ha by K 8, 20
sna aw 21
in i fr
Ra sh G om I
za hu P
lam
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
144
Type of POI Screenshot IP Explanation
ro m m
f la
Land feature Mount Rainier 2 0 21 Ghu Land features, such as mountains, mountain
8, sh ranges, or volcanoes,
Mo should use the following
n e 2 Kawi za 7 nd
, Ju 1 by in Ra guidelines. 8.9 ay,
a y 5.1 Ju
nd 6.5 na 76 ne
Mo 95.17 Has Perfect (area above
.51 28
78. Hagreen
by line
, 2 in Fig. 4) ->
0
sna Kfeature
Anywhere on the defining aw 21 fof the
in i r
Ra sh G om
mountain (peak or ridge, depending
za hu onIPthe
mountain). lam
Fig. 1: Vector view of Mount Wrong (area below yellow line in Fig. 4) ->
Rainier Valley of the mountain, anywhere farther out
than the obvious slope.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna Fig.
a 4:21Annotated 3D view of day, .51 b ain
in wish from n 6 n
Mount
Ra Rainier Mo 95.17 Has
za Ghu IP 78.
lam
145
IP
ro m m
9.4.2. Administrative Divisions f la
2 0 21 Ghu
28, awish Mo
Administrative divisions n e can referato, but are not limited to: 78 nda
, Ju by K Raz .95 y, J
• Countriesda .51 ain
y .17 un
n 6 n 6.5 e 2
• StatesMo 5.17 Has 1
• Counties78. 9 Ha by K 8, 20
sna aw 21
• Provinces in i fr
Ra sh G om I
• Cities za hu P
lam
• Neighborhoods
Rating Explanation
Perfect Pin should fall in within the boundaries/polygon of the administrative division.
Approximate N/A
Next Door N/A
Wrong Pin falls in an area that does not meet the criteria for Perfect.
Can’t Verify See Can’t Verify
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
146
9.4.3. Streets
IP
ro m m
In this chapter, rating pins for 2streets 1 f hulwill
a be explained.
2 0 G
8, sh ExplanationMon
Rating n e 2 Kawi za 78 da
u
, J 1 by in Ra .95 y, J
y Pin can fall anywhere on the street, including medians
.17 and
6.5 ne intersections the
d a . 5 a u
Perfect o n 176 asn
M 95. street H passes through completely (but not on sidewalks).1 28
78. Ha by K , 20
sna aw 21
Approximate N/A in i fr
Ra sh G om I
za hu P
Next Door N/A lam
Wrong Pin falls in an area that does not meet the criteria for Perfect.
Can’t Verify See Can’t Verify
Example Explanation
Perfect – The pin can fall anywhere on the street,
including medians and intersections the street
passes through completely, whether seen in
satellite view or on the vector map. If there is a
discrepancy between the satellite view and vector
map of the street boundaries, use the most
favorable layer. Note that sidewalks are not part of
the Perfect area.
Approximate – not applicable
Next Door – not applicable
Wrong – everything outside of Perfect, including
intersections the street does not pass through
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
147
IP
o m m
Query: [highway1 92] f r la
2 0 2 Ghu
8, San h
wis Francisco, Mo
User and fresh viewport
n e 2 in a
K aza
CA
78 nda
u Perfect – The pin.9can
5.1 yfall
, J anywhere on the street,
J y R
ay, 1 b in
ond 176.5 asna including bridges that76are
un
.51 parte 2 of the street. Both
M 95. H 8
78. result 1 and result 2 areaPerfect
H b y , since
2 the pin falls
sna Kaw 021
on the San Mateo-HaywardinBridge, ish om is part of
which
f r
the highway. R a za Ghu IP
lam
Approximate – not applicable
Next Door – not applicable
Wrong – everything outside of Perfect, including
intersections the street does not pass through
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
148
9.5. Parking Lots and Structures
IP
ro m m
Shared parking lots are considered f ula
2 0 21 GhApproximate even though they do not belong entirely to the
feature. Assume that parking ,
28 awis lotsh belong to the feature and do not M
split them. When Sourdough & Co
(green building) is the e
result, on to the public road to the north.
u n K the a z approximate area (yellow) extends
a 78 up d
a y J
, 1 b in Ry . 95 ay, J
nd 6.5 na . 17 un
6.5 e 2
Mo 95.17 Has 1 b 8,
78. H asn y Ka 2021
ain wis fro
Ra h G m I
za hu P
lam
In cases
Mo where the parking structure can be verified in satellite imagery (by either parked carsom orIP
78 ndlot
parking r be lamno
.95 ay, striping), consider the entire structure a parking lot. The assumption is that there 1 fwill u
0 2 G h
businesses
.17 Jwithin
u the structure other than parking-related businesses. 8, 2 wish
6.5 ne 2 e 2
1
Ha by K 8, 20 , Jun by Ka Raza
sna aw 21 ay 1 in
in ish from o nd 176.5 asna
Ra M 95. H
za Ghu IP 78.
lam
149
IP
ro m m
f la
2 0 21 Ghu
8, sh Mo
n e 2 Kawi za 78 nda
a y , Ju 1 by in Ra .95 y, J
nd 6.5 na .17 un
6.5 e 2
Mo 95.17 Has 1
78. Ha by K 8, 20
sna aw 21
in i fr
Ra sh G om I
za hu P
Always consider parking lots and parking structures as belonging to the feature. There’s lno
am need
split them by applying the Half n' Half rule.
In the example below, the result is a shopping mall with both a parking lot and parking structures. Pins
that fall on the building (rooftop) of the mall are Perfect. Apply the Half 'n Half rule to the street and
internal access roads, if any, to determine the area for Approximate, as parking lots and parking
structures are also Approximate.
Transit POIs include, but are not limited to, POIs that are transit stops, stations, toll booths, and
terminals.
Mo A transit stop is a small, transit location typically designated by a bench or covered bench IP
o m
area,
78 anposted sign, or street markings. Transit stations, on the other hand, are typically larger fr stopslam
.95 day, J 0 2 1
G h u
that have.17 a major
u structure associated with it, which include, but are not limited to, platforms, 8, 2 wish ticketing
6.5 ne 2 2
offices, enclosed
1 waiting/seating areas, or terminal buildings/structures encompassing un by Kthe
e a transit
aza
Ha by K 8, 20 , J R
area. The termsna “station”
aw 21 f is primarily used to refer to transit locations that arendlarger
ay .51andatypically
n a
i i r o 7 6 asn i
terminal housingRmultiple
n
aza Gh routes.
s h o m All stations are stops, but not all stops M
are stations.
5. 1 H
ula IP 7 8.9
m
If a transit POI does not meet the criteria to be rated under the Single Rooftop or Campus/Complex
guidelines, please use the following criteria to rate.
150
Rating IP Explanation
m
ro lam
The pin falls02on 1 fthe upolygon for the transit POI or in the area where you
2 Gh
Perfect would wait 28 foristransit or within the entrance polygon
, h Mo for an
u ne Kawtransit
underground a z a station 7 n
8.9 day,
y , J by R
a .51 ain 5.17 Jun
ndThe 6pinasfalls
n within 50 meters of where you would wait for
6.5 transit
1 b 28, or
o 1 7 e
M 95. H
Approximate .
78 within station parking lots and surrounding property up to H asnwhere
y K 2the0
a aw 21 f
Half 'n' Half rule allows. in i r
Ra sh G om I
za hu P
Next Door Transit POIs do not have Next Door ratings. lam
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
151
9.6.1. Bus, Tram, and Streetcar Stops
IP
ro m m
Bus, tram and streetcar stops2are 1 f often,
la but not always, on the side of the street and have one spot
0 G hu
where users can wait to board 8, withe
2 sh bus. Perfect pins should be placed Mo on the spot where a user would
wait while Approximate e 2pins can be placed within 50m of the waiting
78 ndspotay, and within the Half 'n' Half
n a a
, Ju by K Raz . 9
rule. a y 1 in 5.17 Jun
ond 176.5 asna 6.5 e 2
POI M 95. Screenshot
H Rating Explanation
1 b 8,
78 . H asn y Ka 2021
ain wis fro
Perfect (green area in Fig. 2) -> Where Raa user
h G would
m wait for
z h I P
the bus. a ula
m
Approximate (yellow area in Fig. 2) -> 50 m away from
where a user would wait for the bus but no farther out than
the Half 'n' Half rule allows and not on a building rooftop.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
152
9.6.2. Transit POI with Multiple Rooftops/Platforms
IP
ro m m
If the POI has multiple rooftops/platforms,
f
21 Ghu
la apply similar ideas from the campus/complex pin
guidelines when determining 0
8, the
2 sh valid area for the pin to land on. M
n e 2 Kawi za o
78 nda
J u y R a . y, Jthe campus. Use the same
d ay, .51 b aainpolygon was created using the boundaries
For campuses/complexes, 95 of
. 17 un
on .176POIs
concept withMtransit asnand create a polygon for the transit POI using the 6.5 POI's
e 2 multiple rooftop/
. 9 5 H 1 b 8,
platforms. 78 H asn y Ka 2021
ain wis fro
Ra h G m I
za h P
POI Screenshot Explanation ulam
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
153
POI Screenshot IP Explanation
ro m m
f la
2 0 21 Ghu
8, sh Mo
n e 2 Kawi za 78 nda
a y , Ju 1 by in Ra .95 y, J
nd 6.5 na .17 un
6.5 e 2
Mo 95.17 Has 1
78. Ha by K 8, 20
sna aw 21
Some transit stops only in have fro
Ra shaGplatform where
i m
a user can wait for the transit.
z a h ula I P
m
Perfect (green area in Fig. 2) -> Where a user
would wait for transit or the area between
where a user would wait for transit.
Fig. 1: Vector view of Sunnyvale Approximate (yellow area in Fig. 2) -> Within
Station 50 meters of where you would wait for transit
Sunnyvale
or within transit stop parking lots and
Station
surrounding property up to where the Half 'n'
Half rule allows.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
154
POI Screenshot IP Explanation
ro m m
f la Some stations have both a building rooftop
2 0 21 Ghu
8, sh and an openMplatform waiting area. Both of
n e 2 Kawi za these areas78are onconsidered valid places for
y , Ju 1 by in Ra .95 day, J
a
nd 6.5 na pins to fall on. .17 un
6.5 e 2
Mo 95.17 Has 1
78. Ha by K 8, 20
Perfect (green areasnin ainFig.
aw2) 2-> 1 f Pin falls on
the platform(s) where theRauser i s rom wait or
h Gwould
za hu theIP
the area between the platforms or lam rooftop.
Solana
Fig. 1: Vector view of Solana Beach Approximate (yellow area in Fig. 2) -> Pin
Beach
station falls within 50 meters of where you would wait
Amtrak
for transit or within transit stop parking lots
Station
and surrounding property up to where the Half
'n' Half rule allows.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
155
9.6.3. Transit POIs with a Single Rooftop
IP
ro m m
If the POI has a single rooftop,21apply f ulthea single rooftop guidelines.
2 0 G h
8, sh Mo
n e 2 Kawi za 7 n
POI , J by Screenshot
u R a 8.9 daExplanation
y, J
d y
a .51 ain 5. 1 u
n 6 n 7 6.5 ne 2
Mo 95.17 Has 1
78. Ha by K 8, 20
sna aw 21
in i fr
Ra sh G om I
za hu P
lam
Some transit stations are underground. For stops that do not have polygons available on the tool map,
apply Mosimilar rules to the satellite campus and use your imagination to draw a polygon using the IP
o m m
78 nda to the underground station as polygon coordinates. A pin dropped within 50 meters
entrances 1 fr of u lathis
.95 y, J 0 2 G h
polygon .17should
6.5 ne be
u rated Approximate. 2 8, 2 wish
1 2 e
Ha by K 8, 20 , J un by Ka Raza
sna on
If a pin is placed a 2building
in wia
1f
rom within the polygon, the building must contain nandayentrance1 n
6.5 asnai to the transit
s h o 1 7
stop for the pin to Rabe Perfect.
za Ghu IP If the pin falls on any other building within the
M 95polygon,
.
. H rate it
7 8
Approximate. l am
156
Some entrances can be seen via satellite view of the station, while other entrances can only be found
by doing more research, includingom IP street imagery of the station area to find entrances or using a
using
r am
1 f hulthat
station map from the transit provider 0 2 shows entrances to the station.
, 2 h G
8 s Mo
n e 2 Kawi za 7 n
[Link]. How to Establish an Entrance Polygon
, u
J by R a 8.9 day,
a y 1 in 5 .17 Jun
ond 176.5 asna 6.5 e 2
. 5.
M 9three
1. Find at least entrances
H to the underground transit station, if possible.
H
1 b 8,
78 asn y Ka 2021
ain wis fro
• Use street imagery or an official source to determine where the transit station Ra h Gentrances
m
za hu IP are
located. lam
• Tip: A good place to start looking for transit entrances is near the pin's location. This will
make it easier to determine whether or not the pin falls within the polygon.
2. Connect the entrance points to create an enclosed polygon, where each entrance is a point of the
polygon.
3. Determine whether or not our pin falls within 50 meters of the polygon or within the property
covered by the Half 'n' Half rule.
If the underground transit station only has two entrances, use the following steps to create an
entrance polygon.
157
POI StepsIP Satellite Views
ro m m
f la
2 0 21 Ghu
8, sh Mo
n e 2 Kawi za 78 nda
a y , Ju 1 by inwhether
3. Determine Ra or not the pin falls .95 y, J
d . 5 a .17 un
Mo 95within
n 176 a50 sn meters of the polygon. 6.5 e 2
. 1
78. H Ha by K 8, 20
sna aw 21
Note: For underground transit POIs that in i fr
Ra sh G om I
only have one entrance, create the same za hu P
lam
polygon around the entrance as the
Perfect pin rating area, then measure
50 meters from that polygon for the
Approximate pin rating area.
[Link]. Examples
158
POI Screenshot
IP Explanation
ro m m
f la
2 0 21 Ghu
8, sh Mo
n e 2 Kawi za 78 nda
a y , Ju 1 by in Ra .95 y, J
nd 6.5 na .17 un
6.5 e 2
Mo 95.17 Has 1
78. Ha by K 8, 20
sna aw 21
in i fr
Ra sh G om I
za hu P
lam
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
160
POI Screenshot
IP Explanation
ro m m
f la
2 0 21 Ghu
8, sh Mo
n e 2 Kawi za 78 nda
a y , Ju 1 by in Ra .95 y, J
nd 6.5 na .17 un
6.5 e 2
Mo 95.17 Has 1
78. Ha by K 8, 20
sna aw 21
Perfect -> Pininfalls ish froentrance
Ra within
Gh m IP
polygon and not onza a building
ula rooftop
m
(unless there is an entrance within the
building)
161
10. How to Rate Results IP
ro m m
f ula
This chapter shows how to rate 2 0 21 aGvariety
h of examples.
2 8, wish Mo
e Ka za 78 nda
For each result, you un need
Jwill y to
Ra answer questions about: .95 y, J
d a .51 b ain
y ,
.17 un
n 6 n 6.5 e 2
Mo 95.17 Has 1
• Relevance
78 . Ha by K 8, 20
• Name accuracy sna aw 21
in i fr
• Address accuracy Ra sh G om I
za hu P
• Pin accuracy lam
When the query is an address, and the user explicitly states their location intent by including the
name of a locality, this is an explicit location query and the user’s viewport and location are irrelevant.
The query refers to a unique location, so a result for this exact location should be rated Navigational.
162
Query ResultsIP Ratings and Explanation
ro m m
f la Relevance Navigational
[12112 0 21 Ghu
Camden Westchase
2
8, wish Park
2 Mo
sugarloaf key Apartments ne Ka aza Name Accuracy
78 nda Correct
st tampa fl a12112
y , Ju 1 Sugarloaf
by n R Key St .95 y, J
d . 5 ai 33626 Address Accuracy .17 Correct
u
6.5 ne 2
33626]Mon Tampa,1 7 6 asnFL
95. H 1 b 8,
78. Classification: Apartment Pin Accuracy
Ha y K 20
sWrong
na aw 21 fr
in i
Ra sh G om I
za hu P
lam
The result includes the name of the business,
which is located at this address.
163
Query ResultsIP Ratings and Explanation
ro m m
f ula Relevance Bad (User Intent Issue)
11244 Windsor2 0 21 GhPl
28, awish Pl Cir
11244e Windsor Name Accuracy
Mo
n K 33626
Ju byFL
Tampa, aza 78 nda n/a
y , R .95 y, J
da 6.51 snain n/a Address Accuracy .17 Correct
u
6.5 ne 2
[12112 Mon Classification:
7
9 5.1 Ha 1 b 8,
sugarloaf key
78. Ha y K 20
st tampa fl Pin Accuracy na aw 21 fr
sPerfect
in i
Ra sh G om I
33626] za hu P
The result does not satisfy the query lamand is not
considered relevant. However, the address and
pin placement are Correct and Perfect.
Remember, the data and relevance of the result
are considered separately. The data can be
correct even when the result’s relevance is
Bad.
[220 yonge st Is there a Navigational Result for this Query? Yes
toronto]
Toronto Eaton Centre Relevance Navigational
User in Toronto, 220 Yonge St
Toronto ON M5B 2H1 Name Accuracy Correct
Canada
Classification: Shopping Center Address Accuracy Correct
Pin Accuracy Perfect
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
164
Query ResultsIP Ratings and Explanation
ro m m
Indigo f la Relevance Good
2 0 21 Ghu
220 Yonge 8, Stsh Mo
e 2 Kawi za Name Accuracy
78 nda Correct
[220 yonge st Toronto, n ON M5B 2H1
, Ju 1 by in Ra .95 y, J
a y .17 Correct
toronto] ond Classification:
6.5 na Book Shop Address Accuracy u
6.5 ne 2
M 95.17 Has 1 b 8,
78.
User in Toronto, Pin Accuracy
Ha y K 20
sPerfect
na aw 21 fr
in i
Canada Ra sh G om I
za hu P
lam
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
165
Query ResultsIP Ratings and Explanation
ro m m
Moneysworth la
f & Best Acceptable (Distance/
2 0 21 G hu Relevance
220 Yonge 8, Stsh Mo Prominence)
e 2 Kawi za 78 nda
[220 yonge st Toronto, ON M5B 2H1
n
a y , Ju 1 by in Ra Name Accuracy.95 y, JCorrect
toronto] ond Classification:
6.5 na Shoe Repair .17 un
6.5 e 2
M 95.17 Has 1 b 8,
Address AccuracyH Correct
78.
User in Toronto,
asn y Ka 2021
ain wis fro
Canada Pin Accuracy Perfect
Ra h G m I
za hu P
lam
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
166
Query ResultsIP Ratings and Explanation
ro m m
f la
[220 yonge st Subway 2021 Ghu Relevance Bad (User Intent)
toronto] 260 Yonge 8, Stsh Mo
e 2 Kawi za Name Accuracy
78 nda Correct
Toronto,n ON M5B 2H1, CAN
a y , Ju 1 by in Ra .95 y, J
.17 Correct
on Classification: Fast Food
User in Toronto, d 6.5 sna Address Accuracy u
6.5 ne 2
M . 1 7 a
Canada 9 5 H 1 b 8,
78. Pin Accuracy
Ha y K 20
sPerfect
na aw 21 fr
in i
Ra sh G om I
za hu P
lam
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
167
Query ResultsIP Ratings and Explanation
ro m m
[1141 Swiss Chalet f la
2 0 21 Ghu Relevance Excellent
Highbury 1141 Highbury
8, shAve Mo
e 2 Kawi za 78 nda
Ave, London, London, n ON N5Y 1A5 CAN
y , Ju 1 by in Ra Name Accuracy .95 y, JCorrect
Ontario] nd 6.5 na
a .17 un
6.5 e 2
Mo 95.17 Has 1 b 8,
78.
User in London,
H
Address Accuracy asCorrect y 20
na Kaw 21 fr
in i
Canada Ra sh G om I
Pin Accuracy Approximate
za hu P
lam
All four of these businesses:
1. Swiss Chalet
2. Wings Kitchen
3. Fast Photo
4. Globally Local
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
168
Address queries can also be just the name of a street, neighborhood, intersection, or city. Results for
streets, neighborhoods, intersection IP city queries are eligible for Navigational.
ro m andm
0 2 1 f hula
2 sh G
The expectation is that we 8,return the requested entity with the same Molevel of broadness that the user
e Kawi za
2
nnot n
requested, which may , u
J by include
R a all of the elements of a full address.
7 8.9 day,
a y 1 in 5.17 Jun
ond 176.5 asna 6.5 e 2
M 95. H 1 8
Query 78 . Results y ,2
Ratingsa & bExplanation
H
sna Kaw 021
i i fr
Is there a Navigational Result for this Query? Yesn Ra sh Gh om IP
za ula
Relevance Navigational m
Stevens Creek Blvd
Stevens Creek Blvd Name Accuracy n/a
Cupertino, CA
Address Correct
Classification: n/a
Accuracy
Pin Accuracy Perfect
Relevance Navigational
Name Accuracy n/a
Address Incorrect – Locality
Stevens Creek Blvd Accuracy
Pin Accuracy Perfect
[stevens Stevens Creek Blvd
creek blvd San Jose, CA
cupertino] Classification: n/a
169
Query ResultsIP Ratings & Explanation
ro m m
f la Relevance Bad (User Intent)
2 0 21 Ghu
8, sh Mo
n e 2 Kawi za Name Accuracy
78 nda n/a
a y , Ju 1 by in Ra .95 y, J
nd 176.5 asna Address .17 Correct
u
6.5 ne 2
Mo 95Stevens
. 1
H Creek Blvd
78. Stevens Creek Blvd
Accuracy Ha by K 8, 20
Pin Accuracy Wrong
sna aw 21
in i fr
San Jose, CA Ra sh G om I
za hu P
lam
Classification: n/a
170
Query ResultsIP Ratings & Explanation
ro m m
19062 Stevens f ula
2 0 21 GhCreek Blvd Relevance Bad (User Intent)
19062 2Stevens
8 wis Creek Blvd
, h Mo
ne KaCA, Name Accuracy78 nda n/a
Cupertino,
, u
J by R aza95014 .95 y, J
y
a .51 ain n/a .17 Correct
nd Classification:
6 n Address u
6.5 ne 2
M 95.17 Has
o
1
78 . Accuracy Ha by K 8, 20
Pin Accuracy Perfect
sna aw 21
in i fr
Ra sh G om I
za hu P
lam
The result includes a street number when the
query is just for a street, making this result too
specific for the requested query. The pin is
dropped on the result address.
[stevens
creek blvd The result is for a business on the street. When
cupertino] the query is for an entire street, returning a
business is too specific a result for the
requested query.
171
Query Results IP Ratings & Explanation
ro m m
[upper east 0 2 1 f hula
Is there a Navigational Result for this Query? Yes
2 G
side] 28 , is h M
u ne Kaw aza Relevance 7 ond Navigational
J y R 8.9 ay,
d ay, .51 b ain 5
Name Accuracy.176.n/a
Ju
ne
on 176 asn
M 95Upper. East Side 5 1 2
8 . H H by 8, 20
7 Upper East Side Address aCorrect
sna Kaw 21
in i fr
New York, NY 10021 Accuracy Ra sh G om I
Pin Accuracy Perfectza hu P
Classification: n/a lam
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
172
Query Results
IP Ratings & Explanation
ro m m
f ula Relevance Bad (User Intent)
Boqueria2Upper 0 21 GhEast Side
8 , ish Mo
1460 e2nd Ave
2 Name Accuracy
78 nda Correct
w a
New J u n
York,
y KaNYa10075
z
.95 y, J
a y , 1 b in R
nd 176.5 asna Address .17 Correct
u
6.5 ne 2
Mo 95Classification:
. Spanish 1
8. H Accuracy Ha by K 8, 20
7 Pin Accuracy Perfect
sna aw 21
in i fr
Ra sh G om I
za hu P
The result is for a business within the lamqueried
neighborhood. Even though the business
name contains the query terms, this result
does not satisfy user Intent, and is not
internationally prominent enough to be
considered relevant for the query.
Mo IP
m
78 nda The result is for the city of Cork in Ireland.
1 fr uAlam
o
.95 y, J perfect pin can drop anywhere within 2
20 sthe Ghcity
.17 un 8, i h
6.5 e 2 boundaries. 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
173
Query ResultsIP Ratings & Explanation
ro m m
f la Relevance Good (User Intent)
Cork Airport 2 0 21 Ghu
8, wish Mo
Kinsale
n e 2Rd a a Name Accuracy
78 nda Correct
y , b y K Raz
Ju Ireland
Cork, .95 y, J
a .51 ain Address .17 Correct
u
nd Classification:
6 n Airport 6.5 ne 2
M 95.17 Has
o
1
8. Accuracy Ha by K 8, 20
7 Pin Accuracy Perfect
sna aw 21
in i fr
Ra sh G om I
za hu P
lam
Mo IP
o m
78 nda 1 fr ulam
.95 y, J The query is for an intersection and 2
20 the Gh
.17 un 8, i s h
6.5 e 2 specific intersection is returned.2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
174
Query ResultsIP Ratings & Explanation
ro m m
f la Good/Acceptable (User
2 0 21 Ghu Relevance
Stevens 8,Creeksh and De Anza Mo Intent)
n e 2 Kawi za 78 nda
Blvd.
, Ju 1Stop
by n Ra .95 y,Correct
y Name Accuracy .17 Jun
n 176 asna CA 95014
Cupertino
d a . 5 i
o . 6.5 e 2
M 95Classification: Address 1 b 8,
78.
H Bus Stop HaCorrect
y 20
Accuracy s na Kaw 21 fr
Pin Accuracy in
Perfect i
Ra sh G om I
za hu P
l
The query is for an intersection andaambus stop
with the same name is returned. In some
countries, bus stops carry the same name as
the intersection where they are located and
can satisfy a secondary intent for the query.
The pin falls where a user would wait for the
bus.
[95051]
Is there a Navigational Result for this Query? Yes
175
Query Results IP Ratings & Explanation
ro m m
f la Relevance Navigational
2 0 21 Ghu
Santa Clara28, awish Mo
Santa e Name Accuracy78 nda n/a
Ju Clara,
y K RCA aza
n
y , b .95 y, J
a .51 ain n/a .17 un
nd Classification:
6 n Address 6.5 e 2
M 95.17 Has
o Incorrect
1 – Postal Code
78 . Accuracy Ha by K 8, 20
sna aw 21
in i fr
Pin Accuracy Ra sh G om I
Perfect
za hu P
lam
The expectation for this result is to include
locality, state and postal code. The postal code
is a mandatory component for a postal code
query.
For queries where the location intent is not explicitly stated in the query, you must infer the location
intent from the user’s viewport and the user’s location. One difficulty in evaluating address queries
has to do with partial addresses, which could refer to multiple locations.
Generally, for partial addresses, users are looking for the location closest to their position or within/
near the fresh viewport. Some general considerations:
• Exact location that exists returned very close to the user is eligible for Navigational, unless
other addresses that satisfy the user intent are also very close.
• Exact location returned within a fresh viewport is eligible for Navigational, unless other
addresses that satisfy the user intent are also very close.
• Results that are farther away from an ideal result but can potentially satisfy the user’s intent
can be rated as high as Good (Distance/Prominence)
• Results are demoted based on distance.
• Results are demoted based on the density of potential results in a given area
• Results that are too far away will be rated Bad (Distance/Prominence)
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
176
Consider the query [154 orchard st] in different scenarios:
IP
ro m m
Scenario 1: Fresh viewport over f ula
2 0 21 Midtown
Gh
Manhattan in New York City.
28 , is h Mo
u ne Kaw aza 7 n
8.9 day,
y , J by R
a .51 ain 5.17 Jun
nd 1Query6 asn User and [Link]
o
M 95. 7
H 51 e 28
. H by , 20
78 User and fresh viewport over asnMidtown
K 2Manhattan in
[154 orchard st] ain awis 1 fro
New York City Ra h G m I
za hu P
User Intent: The query does not specify in which locality the address is expected. Use lathe
m
location intent given by the user and viewport to rate the results.
Is there a Navigational Result for this Query? Yes
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
177
Results IP Ratings and Explanation
ro m m
f la
① 154 Orchard St 2 0 21 Ghu Relevance Navigational
154 Orchard St, New York, 8, wis10002
h Mo
e 2 KNY
a Name Accuracy 78 n/a
n
n
Ju by aza .95 day, J
Classification: n/a
a y , 1 in
R
.17 un
ond 176.5 asna Address Accuracy Correct
6.5 e 2
M 95. 1
78.
H Ha by K 8, 20
Pin Accuracy Perfect
sna aw 21
in i fr
Ra sh G om I
za hu P
lam
178
Results IP Ratings and Explanation
ro m m
f la
③ 154 Orchard St 2 0 21 Ghu Relevance Good (Distance/Prominence)
154 Orchard St, Garfield, 8, w07026
ish Mo
n e 2 NJa a 78 nda
Classification: n/a y , Ju by K Raz Name Accuracy .95n/ay, J
a 1 in .17 un
ond 176.5 asna 6.5 e 2
M 95. 1
78.
H Address Accuracy Ha by K 8, 20
Correct
sna aw 21
f
Pin Accuracy Perfectin Ra ish G rom
za hu IP
lam
The pin lands on the house with the street number 114,
which can be verified via street imagery. Since this is
several houses down from the intended address, it is
incorrect.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
179
Scenario 2: Viewport/user’s location IP in Maine. There is no address in the vicinity that contains
o m is
r
1 fwith am
ulthis
[154 Orchard St]. All locations 0 2 h address are far from the location intent of the query.
, 2 h G
28 is Mo
u ne Kaw aza 7 nd
8.9 and ay,Viewport
yQuery
, J by
a .51 ain
R User 5 Ju
d
n 176 asn . 17 ne
o . 6 . 5 2
[154 orchardM st]
. 9 5 H User and viewport in Maine H
1 by 8, 20
7 8 asn Ka 21
User Intent: Since there is no matching result close to the location intent given ain wby frouser and
Ra sh the
i m
G hu IP
viewport, the closest address is rated without demotion for user intent or distance/prominence. za
lam
Is there a Navigational Result for this Query? No
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
180
Results IP Ratings and Explanation
ro m m
f la Relevance Excellent
① 154 Orchard St 2 0 21 Ghu
154 Orchard St, New York, 8, wis10002
h Mo
e 2 KNY
a Name Accuracy 78 n/a
n
n
Ju by aza .95 day, J
Classification: n/a
a y , 1 in
R
.17 un
ond 176.5 asna Address Accuracy Correct
6.5 e 2
M 95. 1
78.
H Ha by K 8, 20
Pin Accuracy Perfect
sna aw 21
in i fr
Ra sh G om I
za hu P
lam
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8 ,
6.5 e 2 This location is among the closest possible2 resultsi to
1 ne Kaw aza
Ha by K 8, 20 the viewport/user’s location. , Ju b y R
sna aw 21
in i fr n day 6.51 snain
Ra sh G om I Mo 95.17 Ha
za hu P 78.
lam
181
Results IP Ratings and Explanation
ro m m
f la
④ 154 Orchard Dr 2 0 21 Ghu Relevance Bad (User Intent)
154 Orchard Dr, Levittown, 8, wish Mo
e 2 KaPennsylvania n
19054 ,
n
Ju by R aza Name Accuracy 78 n/a
.95 day, J
y
da 6.51 snain .17 un
Classification: nn/a Address Accuracy 6.5 e 2
Correct
M 95.17 Ha
o
1
78. Ha by K 8, 20
Pin Accuracy Wrongs na aw 21 fr
in i
Ra sh G om I
z a hu Plocation
This location is farther from the viewport/user lam
than the result in New York and therefore demoted for
distance. The user is also looking for a Street, but has
been presented with a Drive.
The pin lands on the house with the street number 114
which can be verified via street imagery. Since this is
several houses down from the intended address, it is
Wrong.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
182
Here is another example of an address query with implicit location intent. Although this is a common
address in US cities, it overwhelmingly IP
r o m mrefers to the location of the White House and should be
considered the primary intent02of 1 f the la
2 G huquery unless an additional location modifier is provided (i.e.
state, city, or postal code) 8or
, a different
sh 1600 Pennsylvania Ave that’sMo not the White House is already
n e 2 Kawi za n
in or very near the location
, u
J by intent.
R a 7 8.9 day,
a y 1 in 5.17 Jun
ond 176.5 asna 6.5 e 2
Scenario 1: M Fresh
. 9 5. viewport
H on Los Angeles, CA (not near Richmond, CA): H
1 b 8,
78 asn y Ka 2021
ain wis fro
Ra h G m I
Query Results Ratings and Explanation
za hu P
lam
Is there a Navigational Result for this Query? Yes
The White House Relevance Navigational
1600 Pennsylvania Ave,
Washington, DC, 20500 United Name Accuracy Correct
States Address Accuracy Correct
Classification: Landmark
Pin Accuracy Perfect
Fresh viewport
on Los Angeles,
1600 Pennsylvania Ave Acceptable/Bad
CA (not near Relevance
1600 Pennsylvania Ave, (Distance/Prominence)
Richmond, CA)
Richmond, CA 94801
Name Accuracy n/a
Classification: n/a
Address Accuracy Correct
Pin Accuracy Perfect
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
183
Scenario 2: The fresh viewport is in San Francisco, CA (near Richmond, CA). The proximity of the
user viewport to the Richmond location IP
r o m m makes this location just as relevant as the prominent location
in Washington DC. f la
2 0 21 Ghu
8, sh Mo
Query n e 2 Kawi Resultsz a 7
Ratings
nd & Explanation
J u y R a 8 . a y
ay, .51 b aainNavigational Result for this Query?95.17 , JNo
ond 1Is76there a s n u
6.5 ne 2
M 95. H 1 by 8, 2
78. The White House Relevance Ha Excellent
sna Kaw 021
1600 Pennsylvania Ave, in i fr
Name Accuracy Ra sh G om I
Correct
Washington, DC, 20500 za hu P
lam
Classification: Landmark Address Accuracy Correct
Pin Accuracy Perfect
Fresh viewport
on San 1600 Pennsylvania Ave Relevance Excellent
Francisco, CA
1600 Pennsylvania Ave,
(near Richmond, Name Accuracy n/a
CA)
Richmond, CA 94801
Classification: n/a Address Accuracy Correct
Pin Accuracy Perfect
To be useful to the user, address results need to point to either a building with that address or a plot
of land that has been officially assigned the address. Sometimes your research will show that a full
query address does not exist (or no major search engine will be able to determine its exact location).
In cases like this, you will see one of three types of results:
•M The closest verified address (on the same street and in the same city and state):mRate IP
onrelevance as Excellent. o
fr ulam
78 da 2 1
.95 y, J h
• The.17 same
un address as the query address: Rate relevance as Excellent and2address 8, 20 ish Gas
6.5 e 2
Incorrect
1 – Address does not exist. The pin will be rated Can’t Verify. une Kaw aza
Ha by K 8, 20 y, J 51 by in R
• Thesqueried
na aw street
21 without a street number: Rate relevance as Acceptable.
da
in i fr n 6. na
Ra sh G om I Mo 95.17 Has
hudoesP
When a queried addressza 78. a navigational result for
lam not exist, the answer to the question “Is there
this query” will always be No.
184
Query Results IP Ratings and Explanation
ro m m
[2001 Duncan Is there a 0Navigational2 1 f hula Result for this Query? No
2 G
St, San ,
28 awis St h M
Francisco] 1099 u ne Duncan
K z a Relevance 7 ond Excellent
by n Ra St., San
y, J 51 Duncan
a1099
8.9 ay,
5.1 Ju
d . a i Name Accuracy 76 n/a
o
M 95.1 Ha7 6
n Francisco, s n 94131, CA .51 ne 28
78. Classification: n/a H by K , 20
Address Accuracy asnCorrect 2
ain awis 1 fro
Ra h G m I
Pin Accuracy Perfect za hu P
lam
If 2001 does not actually exist then selecting
1099, the closest address on the same street in
the same city and state that does exist, is
considered correct.
For a locale that uses the rule of even numbers
on one side of the street and the odd numbers
on the other, we need to return the closest
existing address on the same side of the street
as the query. If the rule of odds and evens does
not apply then the closest numeric number will
be considered correct.
The pin has to be correctly dropped on the
address presented in the result to be rated
Perfect.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
185
Query Results IP Ratings and Explanation
ro m m
Duncan St021 f hula Relevance Acceptable (User Intent)
, 2 San G
Duncan 2 8St, i sh Francisco, Mo
94131,
w
ne Ka aza Name Accuracy 78 nda n/a
y , Ju byCA R .95 y, J
a .51 ain Address Accuracy.176. Correct
nd Classification:
6 n n/a un
o
M 95.1 Ha7 s 51 e 28
78. Ha by K , 20
Pin Accuracy snPerfect 2
ain awis 1 fro
Ra h G m I
The result returns only the street
za with
hu aPpin
la
dropped within the boundaries of the m street.
This result technically satisfies the user intent,
but this intent is unlikely, so relevance should
be rated Acceptable.
A correct location result should be rated Navigational for queries referring to a point of interest.
Consider the query [mount rushmore], the famous US monument. Although the query terms do not
contain an explicit location, the Mount Rushmore monument is so prominent and unambiguous that
its location should be considered the primary location intent. The user viewport and user location are
irrelevant for this query because the user is looking for the place of interest no matter where they
currently are.
186
Query Results
IP Ratings and Explanation
ro m m
Mount Rushmore f la
2 0 21 Ghu KOA at Relevance Bad (User Intent)
Palmer 8,Gulch sh Mo
e 2 Kawi za 78 nda
12620 n Highway 244
y , Ju 1 by in Ra .95 y, JCorrect
Name Accuracy
nd Hill .5City,aSD 57745
a .17 un
176 Hasn
Mo [Link]:
6.5 e 2
1 b 8,
Campground Address AccuracyHa Correct
78. y 2
sna Kaw 021
in i fr
Pin Accuracy Perfect
Ra sh G om I
za hu P
lam
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
187
Query ResultsIP Ratings and Explanation
ro m m
2 1 f hula
Is there a0Navigational Result for this Query? Yes
, 2 h G
Route 28 awis M
Relevance7 ond Navigational
u ne 66
K a z a 8.9 ay,
y , J by AZ
Seligman, R 86337
a .51 ain 5.17 Jn/a
u
ond United
7 6 asnStates Name Accuracy 6.5 ne 2
M 95. 1 1
H
78. Classification: n/a H by K 8, 20
Address AccuracyasnCorrect 2
ain awis 1 fro
Ra h G m I
Pin Accuracy Perfect
za hu P
lam
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
188
Query ResultsIP Ratings and Explanation
ro m m
2 1 f hula
Is there a0Navigational Result for this Query? Yes
, 2 h G
Machu 28 awis M
Relevance7 ond Navigational
u ne Picchu
K a z a 8.9 ay,
Aguas
y , y
J bCalientes, R Peru
a 1 in 5.17 JCorrect
ond 176.5 asna Name Accuracy u
6.5 ne 2
M 95. 1
78.
H H by K 8, 20
Address AccuracyasnCorrect 2
ain awis 1 fro
Ra h G m I
Pin Accuracy Perfect
za hu P
lam
Fresh viewport
over Relevance Good (User Intent)
Massachusetts,
some distance Machu Picchu Restaurant Name Accuracy Correct
away from 307 Somerville Ave, Somerville, MA
Somerville, MA
Address Accuracy Correct
02143
Pin Accuracy Perfect
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
189
10.5. Understanding Multiple Query Interpretations: Beyond Viewport and User Location
IP
ro m m
Many address/POI queries have f ula interpretations. Understanding which interpretation is most
0 21 multiple
h
, ish G in addition to considering the viewport
2
likely often requires extra28research Mo and user’s location. It is
e a w a
critical to fully understand n the
K query z through research rather than78guessing.
n
y , Ju 1 by in Ra .95 day, J
a .17 un
ond 176.5 asna 6.5 e 2
.
Query M 8.95 H Results RatingsH
1 b Explanation
asand
8
y K , 202
7 na aw 1 fr
in i
Is there a Navigational Result for this Query? Yes Ra sh G om I
za hu P
la
New York City Relevance Navigational m
New York City, NY, US
Name Accuracy n/a
Classification: n/a
Address Accuracy Correct
Pin Accuracy Perfect
Mo IP
o m m
78 nda The result is within the fresh viewport, 1 fr butu lais
.95 y, J 02 h
.17 un not a very prominent street. Although 8, 2 wish this is
G
6.5 e 2 2
1 still a possible interpretation,un bity is
e Kanotzaa perfect
Ha by K 8, 20 J a
sna aw 21 match to the query and d
,
. 51 ain R
ayis overshadowed by
in i fr n 176 asn
Ra sh G om I the prominence of MNew
o York H City.
hu P 95.
za
lam 78.
190
Query ResultsIP Ratings and Explanation
ro m m
2 1 f hula
Is there a0Navigational Result for this Query? Yes
, 2 h G
28 is M
Amsterdam
u ne Kaw aCafe z a Relevance7 ond Navigational
J South y Gay 8.9 ay,
410
y ,
a .51 ain b R St 5.17 JCorrect
u
ond Auburn,
7 6 asn AL 36830 Name Accuracy 6.5 ne 2
M 95. 1 1
H
78. Classification: American (New) Ha by K 8, 20
[amsterdam Address Accuracy snCorrect 2
ain awis 1 fro
cafe] Ra h G m I
Pin Accuracy Perfect
za hu P
lam
User and fresh The user and fresh viewport are close to
viewport in Auburn, Alabama, this cafe is an exact match,
Auburn, AL and can therefore be considered the main
intent.
191
Query Results
IP Ratings and Explanation
ro m m
2 1 f hula
Is there a0Navigational Result for this Query? Yes
, 2 h G
28 is M
u ne Kaw aza Relevance7 ond Navigational
, J by R 8.9 ay,
a y 1 in 5.17 Jn/a
ond 176.5 asna Name Accuracy u
6.5 ne 2
M [Link] 1
78.
H Ha by K 8, 20
Address Accuracy snCorrect 2
[europe]
Europe ain awis 1 fro
Ra h G m I
Classification: n/a Pin Accuracy Perfect
za hu P
lam
User and
The query is clearly for the European
viewport
somewhere in continent, so returning the continent should
US be rated Navigational. If the name of a local
business exactly matches the query with no
extra words then that business may be a
reasonable interpretation of the query and
should be rated based on distance from the
user or viewport. All other businesses are
Bad.
Is there a Navigational Result for this Query? Yes
Relevance Navigational
Name Accuracy n/a
Paris
Paris, France Address Accuracy Correct
Classification: n/a Pin Accuracy Perfect
192
Query Results
IP Ratings and Explanation
ro m m
2 1 f hula
Is there a0Navigational Result for this Query? No
, 2 h G
28 is M
u ne Kaw aza Relevance7 ond Excellent
, J by R 8.9 ay,
y
a .51 ain 5.17 JCorrect
u
ond Brandy
7 6 asn Ho's Hunan Food Name Accuracy 6.5 ne 2
M 95. 1 1
H
78. 217 Columbus Ave, San Ha by K 8, 20
Address Accuracy snCorrect 2
[hunan] Francisco, CA 94133 ain awis 1 fro
Ra h G m I
Classification: Hunan Pin Accuracy Perfect
za hu P
User and fresh lam
viewport The query [hunan] represents both the
somewhere in seventh most populous province in China and
San Francisco, a popular type of cuisine. In this case, both
CA user location and viewport are in the San
Francisco Bay area. An online maps search
done by a user in this area shows that the
dominant intent of this query is for the
cuisine. The province is a less likely, but still
viable, intent that can be rated Acceptable.
• Multiple interpretations: Are there ways to interpret the query terms other than as a
business name? French Laundry is both a famous restaurant in Napa and a type of
laundromat/cleaner.
• Number of locations: How many locations of this business exist? If there are many of them
(like Starbucks) then the user expects to find locations in or very close to the their location
intent.
• Population density: Is the area of the business results urban, suburban, or rural? City
dwellers are less willing to travel longer distances than suburban and rural users.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
193
10.6.1. Non-Chain Businesses
IP
ro m m
Some businesses have only one 21 location,
f ula so treat and rate them as navigational queries. The correct
0 G h
location should be rated Navigational
8, 2 sh and any other results should
Moreceive Bad (User Intent).
n e 2 Kawi za 78 nda
y , Ju by R a .95 y, J
Query onda 76.51 snain Results .17 and
Ratings 6.5 ne 2Explanation
u
M 95. 1 H a 1 8
78. Is there a Navigational Result for this Query? Ha bYes y ,2
sna Kaw 021
in ish from
Klein High School R
Relevance za Ghu IP
Navigational
a
lam
16715 Stuebner Airline Rd
Spring, TX 77379 Name Accuracy Correct
Classification: High School Address Accuracy Correct
Pin Accuracy Perfect
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
194
Query ResultsIP Ratings and Explanation
ro m m
2 1 f hula
Is there a 0Navigational Result for this Query? Yes
, 2 h G
28 is M
Restaurant
u ne Kaw Gary z a Danko Relevance7 ond Navigational
J North y Point a 8.9 ay,
800
y ,
a .51 ain b R St, San Francisco, 5.17 JunCorrect
ond California
7 6 asn 94109 Name Accuracy 6.5 e 2
M 95. 1 H 1 b 8,
.
78 Classification: American (New) H y K 202
Address Accuracy asn Correct
ain awis 1 fro
Ra h G m I
Pin Accuracy Perfect
za hu P
lam
195
Sometimes there are multiple unrelated businesses with the same name in the same area. In this
case, rate each business independently IP
ro m m considering its relevance and distance from the location
intent of the query. f la
2 0 21 Ghu
8, sh Mo
n e 2 Kawi za 7 nd
u
J by a 8.9 and ay,Viewport
yQuery
,
a .51 ain
R User 5 . Ju
d
n 176 asn 17 ne
o . User inside a fresh viewport over 6 . 5 in
2 Dearborn, MI (a
M
[lighthouse]8.9 5 H 1 by 8, 20
H
7 suburb of Detroit) asn Ka 21
ain wis fro
User Intent: When there are multiple unrelated businesses with the same name Ra inh the m
za GhusameIP area,
rate each business independently considering its relevance and distance from the location lam intent of
the query.
Is there a Navigational Result for this Query? No
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
196
Results IP Ratings and Explanation
ro m m
f la Relevance Excellent
① The Lighthouse , 2 0 21 Ghu
h
4474 W Jefferson Avee 28 awis a Name Accuracy
Mo
n z 78 Correct
n
Ecorse, MI 48229y, Ju 1 by K n Ra .95 day, J
a i .17 un
Classification: nd 176.5 asna Address Accuracy Correct
Mo Pub
6.5 e 2
95. H 1
Ha by K 8, 20
78. Pin Accuracy Perfect
sna aw 21
in i fr
Ra sh G om I
This is one of the closest results thatzafits the
hu user’s
P
lam
query. This result should receive the a relevance rating
of Excellent.
A query for a chain business is generally not considered an explicit query and is therefore not eligible
a for Navigational rating unless the query contains a location modifier that points to a single unique
location (see Chain Business with Location Modifier). IP
Mo o m
78 nda 1 fr ulam
Chain5businesses
. 9 y
.17 , Jun are businesses that have more than one location, and include everything , 20 shfrom
2 Gh
national chains
6.5 elike 8 i
1 2 Starbucks, Target, Auchan, Albert Heijn, and Boots down to small ne local
2 aw chains.
Ha by K 8, 20 Ju y K aza
sna aw 21 ,
y 51 b R
daworld,
. a in
Distance evaluations
in ishshould
fro be based on chain business locations in the real
n 6 not
n only the
Ra G m Mo 95.17 Has
returned results. za hu P I
78.
lam
197
• The more locations the chain business has in the area, the closer the results should be in
order to be considered relevant. IP
ro m m
a
f ulbusiness
• The fewer locations the 0 21chain h has in the area, the more you can widen the distance
2 G
for relevant results. 28 , is h Mo
u ne Kaw aza 7 n
8.9 day,
y , J by R
Note: Go to thendchain 1
a .5business’ n official website and check the address 5.17of Jthe
6 asnai 6.5 ne specific branch you’re
u
o 1 7 28 at the address
rating. For each
M 9branch
5 . H of a chain business, research to verify that it actually1 exists
Ha by K , 20
78.
listed in the result. sna aw 21
in i fr
Ra sh G om I
za hu P
lam
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
198
IP
Query ro m m User and Viewport
0 2 1 f hula
G
[whole foods] 2 8, 2 wish User and freshMviewport in Irvine, California
ne Ka aza on
u 7 d
8.9 ay,
User Intent: The , J 1is
ayuser byclearly
n R looking for the grocery chain Whole [Link]
d
n 176 asn . 5 a i 17 Junclose to their location
or at least within
o the viewport. 6.5 e 2
M 95. H 1 b 8,
78 . H asn y Ka 2021
Is there a Navigational Result for this Query? No ain wis fro
Ra h G m I
za hu P
lam
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
199
Results IP Ratings and Explanation
m
ro lam
Is there a Navigational Result 2 1 f foru this Query? No
, 2 0
h Gh
28 is Mo
ne Kaw aza Relevance 7 Excellent
n
, u
J by R 8.9 day,
a y 1 in 5.17 Jun
ond 176.5 asna Name Accuracy Correct
6.5 e 2
M 95. H 1 b 8,
78 . H asn y Ka 2021
Address Accuracy Correct
① Whole Foods ain wis fro
Ra h G m I
The District, 2847 Park Ave, Tustin, CA Pin Accuracy Approximate za hu P
lam
92782
Classification: Grocery
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
200
Results IP Ratings and Explanation
ro m m
③ Whole Foods 2 1 f hula Acceptable (Distance/
2 0 G Relevance
Aliso Village ShoppingeCenter,
,
28 awis 23932h MoProminence)
n K z a 7 n
Aliso Creek Rd, Laguna u
J bNiguel,
y R a CA 92677 8.9 day,
y ,
da 6.51 snain Name Accuracy 5Correct
.17 Jun
Classification:onGrocery
1 7 a 6.5 e 2
M 95. H Address Accuracy 1 b 8,
Correct
78 . H asn y Ka 2021
a w f
Pin Accuracy Perfectin Ra ish G rom
za hu IP
lam
This is a Whole Foods store in a neighboring city,
outside of the viewport and a considerable distance
away. As such this result is less relevant to the user and
is rated Acceptable.
If the query for a chain business includes a location modifier that points to a single unique branch of
that business, that specific branch can be eligible for a Navigational rating.
When there are multiple results available for the location modifier, the highest possible rating for all
results will be Excellent. Remember:
• User and viewport location should always be ignored when there is a location modifier
• Ratings must always be based on possible real-world results
Location modifiers in the form of localities or areas are considered to be general location modifiers.
When the location modifier is general, results inside the specified location are not demoted for
distance.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 b 8, u ne Kaw aza
Ha y K 20
sna aw 21 da y, J 51 by in R
in i fr n 6. na
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
201
Quantity of results IP
Location of m m
inside the requestedro Rating and Explanation
results
location
0 2 1 f hula
G
2 8, 2 wish Mo
u ne Ka aza If there is only one result
7 nd
8.9 present
ay, in the requested
y , J by R
a 1 i n 5
location, it should receive1a76rating
. J u of Navigational.
nd 6.5 asna .51 ne 28
Mo 95.17One H
78. Ha by K , 20
It is promoted because it is the snaonlyawresult
21 that satisfies
in ish from
Inside the the user intent Ra
za Ghu IP
requested lam
When there are multiple results for the chain business in
location the requested location, they should all receive a rating
of Excellent.
More than one
Ignore user and viewport location. The user has already
told you exactly where they are looking for results.
When the location modifier is general, results outside the requested location are demoted based on
how many results there are inside it.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
202
Location of Results insideIPthe
Rating and Explanation
results om lam
requestedfrlocation
1
02 Ghu
8 , 2 sh If there are few resultsMfor the chain business inside the
e 2 Kawi za o
78 ndaoutside the area may be
n requested location, results
y , Ju 1 by in Ra .95 y, J
a
nd 6.5 na demoted less severely depending
.17 un on how close they are
6.5 e 2
Mo 95.17 Has to the named location and H how 1 bmany8 branches of the
78. a y K , 202
chain exist in the real world. Ratings
s na awmay1 range
fr from
in i
Good to Bad. Ra sh G om I
Few za hu P
lam
This is because when there are fewer locations of a
chain business inside the requested area, results that
are outside it can still be relevant. However, it’s also
possible for results to be so far away from the location
that they have no relevance at all.
When there are are many results for the chain business
inside the requested location, results outside the area
Many are demoted to Bad. This is because there are multiple
results that would satisfy user intent inside the
requested area, so there’s no need to look outside it.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
203
IP
Query ro m m User and Viewport
0 2 1 f hula
G
[Starbucks san francisco] 2 8, 2 wish User and fresh viewport Mo in San Francisco, CA
u ne Ka aza 7 n
8.9 day,
, J by R
User Intent: The da user
y 1is seeking
n a Starbucks in a specific location. The
5.17 fresh
Ju viewport and user
on ignored 6.5 asnai 6 ne
location canMbe . 1 7 since the user has an area in mind for results. Because
. 5 1 2 there are so many
. 9 5 H H by 8, 20
Starbucks within
7 8 the named area, results outside it are rated Bad. asn Ka 21
ain wis fro
Is there a Navigational Result for this Query? No Ra h G m I
za hu P
lam
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
204
Results IP Ratings and Explanation
ro m m
f la Relevance Excellent
① Starbucks 2 0 21 Ghu
2165 Polk St, San Francisco, 8, ish Mo
e 2 KawCA Name Accuracy 78 nCorrect
94102 ,
n
Ju by R aza .95 day, J
y
da 6.51 snain .Correct
17 un
Classification: nCoffee Address Accuracy 6.5 e 2
M 95.17 Ha
o
1
78. Ha by K 8, 20
Pin Accuracy Perfect
sna aw 21
in i fr
Ra sh G om I
za hu P
lam
This result is one of many Starbucks in the specified
location, San Francisco, and is rated Excellent. All results
within San Francisco are eligible for the highest possible
initial rating of Excellent.
Relevance Excellent
② STARBUCKS
Name Accuracy Correct
1231 Market St, San Francisco, CA
94103 Address Accuracy Correct
Classification: Coffee
Pin Accuracy Perfect
This result is one of many Starbucks in the specified
location, San Francisco, and is rated Excellent. All results
within San Francisco are eligible for the highest possible
initial rating of Excellent.
205
Results IP Ratings and Explanation
ro m m
④ Starbucks 2 1 f hula
0 G Relevance Bad (Distance/Prominence)
601 Westlake Center, Daly 2 8, 2City,
w i sh CA Mo
ne a a 78 nda
94015 y , Ju by K Raz Name Accuracy .95 Correct
y, J
d a .51 ain . 17 u
Classification: n 176 asn 6.5 ne 2
Mo Coffee. 1
78.
9 5 H Address Accuracy Ha by K 8, 20
Correct
sna aw 21
in i fr
Pin Accuracy Perfect Ra sh G om I
za hu P
lam
This Starbucks is outside of the boundaries of the specified
location and should be rated Bad since there are so many
Starbucks to choose from in San Francisco.
The pin drops within the Half n' Half rule boundaries of the
shared parking lot.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
206
Query IP User and Viewport
ro m m
[Aldi waco tx] 0 2 1 f hula User and fresh viewport in Houston, TX
, 2 h G
28 awifor s Mo
User Intent: The user neasked
K z a a specific chain business in a specific
7 n location. The fresh viewport
u
J the yuserRahas a specific area in mind for results. 8.9 day,
can be ignored since y , b [Link]
17 Jun there are very few
n da 6.51 snain
stores within
Mthe
o
[Link]
1 Ha area, results outside it are gradually demoted.
7 6.5 e 2
1 b 8,
. 9 H
78 asn y Ka 2021
Is there a Navigational Result for this Query? Yes ain wi fr
Ra sh G om I
za hu P
lam
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
207
Results IP Ratings and Explanation
ro m m
f la Relevance Navigational
2 0 21 Ghu
8, sh Mo
n e 2 Kawi za Name Accuracy 78 nCorrect
y , Ju 1 by in Ra .95 day, J
a .Correct
nd 6.5 na Address Accuracy 17 un
6.5 e 2
Mo 95.17 Has 1
① ALDI 78. Ha by K 8, 20
Pin Accuracy Approximate
sna aw 21
1220 N Valley Mills Dr, Waco, TX in i fr
Ra sh G om I
76710 za hu P
lam
Classification: Grocery
208
Results IP Ratings and Explanation
ro m m
2 1 f hula Acceptable (Distance/
2 0 G Relevance
③ ALDI 28 , is h Mo Prominence)
u ne Kaw aza 7 n
8.9 day,
3623 W State Highway J b31, y Corsicana,
R Name Accuracy .Correct
y , 5
n da 6.51 snain 17 Jun
TX o
M 95. 1 7 a 6.5 e 2
1 b 8–, Postal Code
. H Address Accuracy Incorrect
H
Classification:
78Grocery asn y Ka 2021
ain wis fro
Pin Accuracy Perfect Ra h G m I
za hu P
lam
Although this result is not in Waco, research shows that,
unlike the many Starbucks in the San Francisco example
above, there are very few Aldi stores in the Waco area. This
result has been demoted -3 from the highest possible
initial rating of Navigational to Acceptable because it is
significantly farther from the area of expected results.
Location modifiers in the form of streets or full addresses are referred to as specific location
modifiers.
When the a query includes a specific location modifier, results that satisfy the location intent should
not be demoted for distance:
Number of results
Location of
inside the requested Rating and Explanation
results
location
209
IP
ro m m
f la
2 0 21 Ghu
8, sh Mo
Query n e 2 Kawi zaResults Ratings
7 nd and Explanation
u a 8
J y
1 b ainaRNavigational Result for this Query?
ay, Is.5there
. 95 ay, J
d .17 uYes
on 176 asn 6.5 ne 2
M 95. H 1 b 8,
78. Kate Spade New York Relevance Ha Navigational
y 2
sna Kaw 021
in i fr
[kate spade 789 Madison Ave, New York, NY Name Accuracy Ra sh G om I
Correct
za hu P
789 Madison 10065 lam
Ave, New York] Classification: Accessories Address Accuracy Correct
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
210
Query IP User and Viewport
ro m m
[tacodeli burnet rd] 1 f hula User and fresh Viewport in Austin, TX
2 0 2 G
8, wish Mo
User Intent: Since there n e 2 are
K a two z a Tacodelis located on the named
7 street,
n both are primary intent.
u
J by R a 8.9 day,
Any other locationa y , is rated
1 Bad.
in 5.17 Jun
ond 176.5 asna 6.5 e 2
M 95.
Is there a Navigational H Result for this Query? No 1 b 8,
78 . H asn y Ka 2021
ain wis fro
Ra h G m I
za hu P
lam
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
211
Results IP Ratings and Explanation
ro m m
f la Relevance Excellent
21 Ghu
① Tacodeli 2 0
8, wish Mo
12001 Burnet Rd, Austin, n e 2 TX
a 78757 a Name Accuracy 78 nCorrect
y , Ju by K Raz .95 day, J
Classification: nMexican
da 6.51 snain Address Accuracy .17 un
Correct
6.5 e 2
M 95.17 Ha
o
1
78. Ha by K 8, 20
Pin Accuracy Approximate
sna aw 21
in i fr
Ra sh G om I
At first glance, this chain business query
za with
hu aPspecific
lam
location modifier may suggest the user is looking for a
unique location. However, research indicates that there
are two branches of this restaurant on the same road.
Both are therefore eligible for a rating of Excellent.
212
IP
ro m m
f la
2 0 21 Ghu
When a query is for a POI 28,on a hnamed street, results for this POI that
Mo are on the named street but
e a wis a
have an official address Ju bon
n
y K another
az street can also be rated Excellent.
78 nda
y , R .95 y, J
d a .51 ain .17 un
on 176 asn 6.5 e 2
M 95. H 1 b 8,
78 . H asn y Ka 2021
ain wis fro
10.6.4. Back Offices and Businesses with no Physical Location Ra h G m I
za hu P
lam
These type of results are most often rated Bad because they are either not useful to the user or have
no maps intent at all.
For these type of results, rate the address accuracy according to the official website or consensus of
three sources, otherwise rate Can’t Verify. If the entire address is missing, rate Can’t Verify. If an
address
Mo is present, rate the pin according to the address in the result. If no address is present, IP
rate
o m
the78pin
nd fr ulam
.95 Can’t
ay, Verify. 2 1
20 sh Gh
.17 Jun 8, i
6.5 e 2 2
1 b 8, u ne Kaw aza
Ha y K 20
sna aw 21 da y, J 51 by in R
in i fr n 6. na
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
213
Query Results
IP Ratings and Explanation
ro m m
2 1 f hula
Is there a0Navigational Result for this Query? No
, 2 h G
28 is M
u ne Kaw aza Relevance7 ond Bad (User Intent)
, J by R 8.9 ay,
a y 1 in 5.17 JCorrect
ond 176.5 asna Name Accuracy u
6.5 ne 2
M 95. Wendy's Flower Affair 1
H
78. 1175 E 930 N, Provo, UT 84604 H by K 8, 20
Address AccuracyasnCorrect 2
ain awis 1 fro
Classification: Wedding Planning Pin Accuracy Ra h G m I
Perfect
za hu P
[flower shop] lam
Research shows that this is a business run
User and fresh out of a residential home, not a showroom full
viewport in of flowers. The relevance rating for this
Provo, UT location is Bad. We have been able to confirm
the address and pin for this business and they
will be rated Correct.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
214
10.6.5. Business/POI does not Exist
IP
ro m m
There are situations where a result 21 Ghreturned
f ula is for a business that does not exist. You will still need to
rate relevance as if the business 0
8, 2 sh were open. Mo
n e 2 Kawi za 7 n
, u
J by R a 8.9 day,
y 5
Query onda 76.51 snain Results .17 and
Ratings 6
Ju Explanation
ne
M 95. 1 a . 5 1 2
. H H by 8, 20
7 8 Is there a Navigational Result for this Query? asnNoKa 21
ain wis fro
Ocean Blue Sushi Club Business/POI is closed/does Ra h G m I
1010 E El Camino Real, not exist
za hu P
☑
lam
Sunnyvale, CA 94087
Relevance Excellent
Classification: Sushi
[sushi]
Research shows that this business is closed.
User and fresh
The checkbox for Business/POI is closed/
viewport in
Sunnyvale, CA
does not exist should be selected. Name,
address and pin accuracy questions will not
appear. The relevance rating for this location
is Excellent because if this business were
open, it would be a very good result for the
query.
Fresh viewport
over North
Shore, CA The North Shore hotel no longer exists at this
address, but its relevance is judged as if it
were still in business.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
215
10.7. Category Queries
IP
ro m m
Category queries are the broadest f ula type because they can return the greatest variety of results.
2 0 21 Ghquery
Give prominence more weight 8, than
sh distance when rating them. M
n e 2 Kawi za o
78 nda
J u y a .
1 b ainmost
ay, .5rating
R 95 y, J
The highest relevance
d category query results will receive .is
17Excellent.
u
on 176 asn 6.5 ne 2
M 95. H 1 b 8,
78. with a location modifier are the only category queriesHeligible
Category queries asn y Kafor20a21Navigational
ain wis fro
rating (see Navigational Results for Category Queries). Ra h G m I
za hu P
lam
You’ll need to determine the user’s intent based on the query:
• Primary Intent refers to the businesses or POI the user is expecting to see for the given
category.
• Secondary Intent refers to businesses that fit the category intent but would not be the
user's first choice. Secondary intent results will receive a demotion of -1 or an initial rating of
Good.
• Unlikely Intent refers to results that technically match the query terms or category intent,
but do so poorly. They receive a demotion of -2 or an initial rating of Acceptable.
If the query contains a location modifier, all results within the specified location should receive the
highest possible initial rating of Excellent. Results outside the expected location should be demoted
based on their distance from the location modifier and the number of possible real-world results
within it. User and viewport location should be disregarded.
Further demotions can be applied based on how well the result fits the intent of the category.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
216
IP
Query ro m m User and Viewport
0 2 1 f hula
G User and viewport outside
Mo Montgomery, TX
2
[Food montgomery tx]28, wish
n e Ka za 78 nda
, Ju by R a .95 is y, Jconsidered primary
User Intent: Any d a food
y
. 5 1 provider
a i n or restaurant within the named locality. 1 un
7
on large
intent. GivenMthe 5 . 176 Hnumber
asn of possible results within the explicit area,6.5 results
1
e 2 outside it are
8,
. 9 H b
rated Bad. 78 asn y Ka 2021
ain wis fro
Is there a Navigational Result for this Query? No Ra h G m I
za hu P
lam
217
Results IP Ratings and Explanation
ro m m
f la Relevance Bad (Distance/Prominence)
② Taco Bell 2 0 21 Ghu
3207 W Davis St, Conroe, 8, wi77304
sh Mo
e 2 KTX
a Name Accuracy 78 Correct
n
n
u by
JFood aza .95 day, J
Classification: Fast
a y , 1 in
R
.17 un
ond 176.5 asna Address Accuracy Correct
6.5 e 2
M 95. 1
78.
H Ha by K 8, 20
Pin Accuracy Perfect
sna aw 21
in i fr
Ra sh G om I
za hu P
lam
Given the large number of places to get food in
Montgomery, results outside of it are rated Bad.
Sometimes it’s not clear whether a query is for a category or a specific business/POI. What first
appears to be a category query with a location modifier may lead to a single prominent result which
can be rated Navigational.
Due to the ambiguity of these queries, even if there is a Navigational result, the query should still be
treated as a potential category query and other results considered relevant.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
218
Query ResultsIP Ratings and Explanation
ro m m
2 1 f hula
Is there a0Navigational Result for this Query? Yes
, 2 h G
28 is M
u ne Kaw aza Relevance7 ond Navigational
, J by R 8.9 ay,
y
a .51 Kilkenny n 5 J
o 7 6 asnai
nd 1Hotel Name Accuracy.176. uCorrect
ne
M 95. College 5 1 2
8. H Road, Kilkenny R95 H by 8, 20
7 KP08 Address AccuracyasnCorrect
K 2
ain awis 1 fro
Ireland Ra h G m I
Pin Accuracy Perfectza hu P
lam
Classification: Hotel
219
Query ResultsIP Ratings and Explanation
ro m m
2 1 f hula
Is there a0Navigational Result for this Query? No
, 2 h G
28 is M
u ne Kaw aza Relevance7 ond Excellent
, J by R 8.9 ay,
y
a .51 ain 5 J
o nd 1Hotel
7 6 asKilkenny
n Name Accuracy.176. uCorrect
ne
M 95. 5 1 2
8. CollegeH Road, Kilkenny R95 H by 8, 20
7 Address AccuracyasnCorrect
K 2
KP08 ain awis 1 fro
Ireland Ra h G m I
Pin Accuracy Perfectza hu P
lam
Classification: Hotel
There is no result that matches the exact
wording of the query, so this is more likely to
be a category query with a location modifier.
Any hotel result returned in the locality of
Kilkenny would be rated Excellent.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
220
Query ResultsIP Ratings and Explanation
ro m m
2 1 f hula
Is there a0Navigational Result for this Query? No
, 2 h G
28 is M
u ne Kaw aza Relevance7 ond Excellent
, J by R 8.9 ay,
a y 1 in 5 J
o nd 176.5 asna Name Accuracy.176. uCorrect
ne
M 95. 5 1 2
8. H H by 8, 20
7 Address AccuracyasnCorrect K 2
ain awis 1 fro
Berlin Tegel Airport Ra h G m I
Pin Accuracy Perfectza hu P
13405 Berlin, Germany lam
Classification: Airport
There are two equally prominent airports in
Berlin. Since there is more than one possible
result for this query in the real world, it is likely
to be a category query with a location
modifier. All airports within the queried locality
should be rated as Excellent.
221
10.7.3. Clear Categories
IP
ro m m
When a query is clearly for a straightforward
f
21 Ghu
la category, results must also belong to that category
2 0
8, sh Mo
n e 2 Kawi za 7 n
Query , u
J by RResults
a Ratings
8.9 dayand , J Explanation
d y
a .51 ain 5. 1 un
n 176 asn 7 6.5 No e2
Mo 95Is . there H a Navigational Result for this Query? 1 b 8,
78. H asn y Ka 2021
Relevance aBad
in (User
wi fIntent)
r
Ra sh G om I
za hu P
Name Accuracy Correct lam
Sephora
2855 Stevens Creek Blvd, Address Accuracy Correct
Santa Clara, CA 95050 Pin Accuracy Approximate
Classification: Beauty Supplies
[mall] The query intent is for a mall. The result is a
store inside Westfield Valley Fair mall and is
User and fresh within the viewport. Since the query is a
viewport in category and the result is a specific store,
Santa Clara, CA which the user did not ask for, rate Bad due to
user intent. If the result had been the entire
mall, the result would be rated Excellent.
222
10.7.4. Soft Categories
IP
ro m m
Some category queries are straightforward f
21 Ghu
la and may have results that satisfy an intent exactly, like
[italian restaurant]. However, 0
8, wishsometimes categories are very small
2
Moor have multiple interpretations,
so several different types n e 2 of aresults
a could satisfy the user’s intent.
78Thesend are called “soft categories.”
y , Ju by K Raz . 9 ay,
d a .51 ain 5. 1 Ju
n 176 asn 7 6 ne
These category o
M 95. queries will produce a variety of results, each of which could
. 5 1 satisfy
2 the query intent
. H H by 8, 20
to a greater or7 lesser degree. How well a result satisfies a category queryaswill
8
na vary
Ka depending
21 on the
the services typically offered by the result entities in that market and the customs in wisof fro specific
the
Ra h G m I
market. za hu P
lam
It’s often difficult to define which businesses or chains belong in any one soft category, so you’ll have
to research the individual results provided to make your rating decisions. For instance, the query [ski
shop] is very specific and is associated with the more general Sporting Goods category.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
223
Query IP User and Viewport
r o m m
[ski shop] f la User and fresh viewport in Denver, Co
2 0 21 Ghu
,
28 awis h M
User Intent: The user neis looking
K z a for places that sell ski clothing 7andonequipment. Any store that
u
J by R a 8.9 day,
carries such itemsa is consider
y , 1 in primary intent. 5.17 Jun
ond 176.5 asna 6.5 e 2
M 95.
Is there a Navigational H Result for this Query? No 1 b 8,
78 . H asn y Ka 2021
ain wis fro
Ra h G m I
za hu P
lam
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
224
Results IP Ratings and Explanation
ro m m
f la Relevance Excellent
21 Ghu
① Meier Skis 8, 2 0
sh Mo
970 Yuma St, Suite 190 n e 2 Kawi za Name Accuracy 78 nCorrect
, Ju 1 by in Ra .95 day, J
Denver, CO 80204 a y .1Correct
nd 176.5 asna Address Accuracy 76 une
Mo Ski
Classification: 95. Equipment
.51 2
78.
H Ha by K 8, 20
Pin Accuracy Perfect
sna aw 21
in i fr
Ra sh G om I
za hu P
lam
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
225
Query ResultsIP Ratings and Explanation
ro m m
2 1 f hula
Is there a 0Navigational Result for this Query? No
, 2 h G
28 is M
u ne Kaw aza Relevance 7 ond Excellent
, J by R 8.9 ay,
a y 1 in 5 J
o nd 176.5 asna Name Accuracy.176. uCorrect
ne
M 95. 5 1 2
8. Riva's
H
Italian Restaurant H by 8, 20
7 as Ka 21
1117 Missouri St Address Accuracy naCorrect
in wish from
Ra
Houston, TX 77006 za Ghu IP
lam
Classification: Italian Pin Accuracy Perfect
226
Query Results
IP Ratings and Explanation
ro m m
Prada Houston f ula
2 0 21 GhGalleria Relevance Bad (User Intent)
5015 Westheimer,
8, sh Ste 2285A Mo
e 2 Kawi za 78 nda
Houston,
u n Texasa 77057
y, J 51 by in R
aClassification:
.95 y, J Correct
Name Accuracy .17 un
n d 6 . n a Accessories 6.5 e 2
Mo 95.17 Has 1 b 8,
78. H y K 202 – Postal Code
Address Accuracy asn Incorrect
ain awis 1 fro
Ra h G m I
Pin Accuracy za
Perfect hu P
lam
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
227
10.7.5. Category Query: Parking
IP
ro m m
"Parking" generally refers to: 21 f ula
0 Gh
2 8, 2 wish Mo
• Parking lots une Ka aza 78 nda
J y R .95 y, J
d ay, .51 b ain
• Parking garages .17 un
n 176 asn 6.5 e 2
• ParkingM decks
o
95. H 1
Ha by K 8, 20
78. sna aw 21
in i fr
Ra sh G om I
za hu P
Example lam
Query Results Ratings and Explanation
Type
Is there a Navigational Result for this Query? No
228
Example IP Results
Query m m Ratings and Explanation
Type f ro l a
2 021 Ghu
Is
8 there
, sh a Navigational Result for this Query?
Mo No
n e 2 Kawi za 7 n d
J u y Ra 8.9 ay,
ay, .51 b ain Relevance
5.1 Ju Excellent
d
n 176 asn 76 ne
o .51 28
M 95.
. H Rincon Center Garage Name Accuracy
H b , Correct
7 8 121 Spear St, San Francisco, CA asn y Ka 2021
ain wis fro
94105 Address Accuracy Ra Correct
h m
za Ghu IP
[parking] Classification: Parking lam
Pin Accuracy Perfect
User and
Paid vs. fresh
free viewport in This result is the parking garage for
San the Rincon Center. It’s a parking
Francisco, garage accessible to the public for a
CA fee. Free and paid parking are equally
relevant. There should be no relevance
demotion if the parking lot/garage
requires payment and the query does
not specifically ask for free parking.
User and
The query specifically requests free
Paid vs. fresh
parking, so the results should reflect
free viewport in
Santa the user’s request. This parking lot is
Clara, CA free and should be rated as Excellent.
229
Example IP Results
Query m m Ratings and Explanation
Type f ro l a
2 021 Ghu
Is
8 there
, sh a Navigational Result for this Query?
Mo No
n e 2 Kawi za 7 n d
J u y Ra 8.9 ay,
ay, .51 b ain Relevance
5.1 Ju Excellent
d
n 176 asn 76 ne
o .51 28
M 95.
. H Stevens Creek Parking Name Accuracy
H b , Correct
7 8 2899 Stevens Creek Blvd, San asn y Ka 2021
ain wis fro
Jose, CA 95050 Address Accuracy Ra Correct
h m
[parking] Classification: Parking za Ghu IP
Affiliate lam
Pin Accuracy Perfect
parking
that does User and
Fresh
not have a
Viewport
specific
in San
name Jose, CA This parking lot has no specific name,
but it is associated with a nearby
business, therefore the name is
Correct.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
230
Example IP Results
Query m m Ratings and Explanation
Type f ro l a
2 021 Ghu
Is
8 there
, sh a Navigational Result for this Query?
Mo No
n e 2 Kawi za 7 n d
J u y a 8.9 ay,
d ay, .51 b Parking
a i nR Relevance
5.1 Ju
76 ne
Excellent
o n 176 asSan n Francisco, CA United States .51 28
M 95. H Name Accuracy b , Correct
7 8. Classification: Parking H asn y Ka 2021
ain wis fro
Address Accuracy Ra Correct
h m
za Ghu IP
[parking] Pin Accuracy
lam
Perfect
User and
fresh
Airport This result refers to the parking lot of
viewport in
Parking San Francisco International Airport.
San
Francisco, The generic name “Parking” is
CA considered Correct. Pin must be
dropped on the SFO parking lot. This is
a POI without an expected address so
just a locality is appropriate and rated
Correct without a street number and
street name.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
231
IP
r o m m
10.8. Other Query Types 21 f hula
0 G
2 8, 2 wish Mo
Queries can sometimes u ne beKless
a obvious
a z a or even ambiguous. 7 n
8.9 day,
y , J by R
a 1 in 5.17 Jun
nd 176.5 asna 6.5 e 2
10.8.1. Routing o
M 95. Queries H 1 b 8,
78 . H asn y Ka 2021
When a query mentions two distinct locations that are not near each other, athe in user
wi was
fr likely looking
Ra sh G om I
for driving directions, so returning either of the two distinct locations used for thezaroute huis the
P best
lam
experience Search can offer. Each location should be rated Excellent for Relevance.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
233
10.8.2. Coordinate and “My Location” IP
ro m m Queries
f la
2 0 21 Ghu
8, sh Mo
n e 2 Kawi za 7 n
Note: Results forycoordinate
, u
J by Rand 8.9 day, of these, like “current
a ‘’my location” queries (or any variation
a .51 and n 5 Ju
location,” “where
o 6 asnai so on) are rated differently from the other
nd 1I 7am,” .17results
6 . ne described in these
M . 5 1 2
guidelines. Please
8. 9 read this section carefully.
5 H H by 8, 20
7 asn Ka 21
ain wis fro
Ra h G m I
za hu P
Pin and Relevance are rated separately using a 50m radius around the queried coordinates lam or the
user location (for “my location” queries):
• Relevance:
• A result that exists and is within the 50m radius is rated Excellent.
• A result that does not exist or is outside of the 50m radius is rated Bad.
• There will be no Navigational results.
• Pin Accuracy:
• A pin that falls within 50m radius is rated Perfect.
• A pin that falls outside the 50m radius is rated Wrong.
• Name and Address Accuracy:
• Rate the name and address accuracy according the regular guidelines.
The graphic below gives an overview. These concepts are explained further on the following pages.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
234
IP
ro m m
f la
2 0 21 Ghu
8, sh Moand Explanation
Query n e 2 Kawi za Pin Rating
78 nda
a y , Ju 1 by in Ra .95 y, J
nd 6.5 na .17 un
6.5 e 2
Mo 95.17 Has 1
78. Ha by K 8, 20
sna aw 21
in i fr
Ra sh G om I
za hu P
lam
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
235
Results IP Relevance Rating and Explanation
ro m m
0 2 1 f hula
G
2 8, 2 wish Mo
u ne Ka aza 7 n
8.9 day,
y , J by R
a 1
nd 176.5 asna
in Use an imaginary circle with a 50m
5.17 Jradius
un around the queried
o 6 . e
M 95. location to rate relevance. A result that5 1 has any part of its
2
78.
H Ha by K 8, 20
Perfect area within the circle is rated snaExcellent.
aw 21 f If a result
does not have any Perfect area inside the i ish rrate
n Racircle, om Bad.
za Ghu IP
lam
The Perfect area usually refers to the rooftop or section of the
rooftop, but can include the parcel for parks and other
features rated perfect for the parcel.
Note that the pin and result title do not need to match. For example, if a result for United Furniture
Club is returned, but the pin is placed at the queried coordinates or user location, the Relevance
Rating will still be Bad, but the pin rating will be Perfect even though it is far from United Furniture’s
location.
236
IP
r o m m
f la
2 0 21 Ghu
8, sh Mo
Query n e 2 Kawi Results
z a Ratings
7 nd and Explanation
u a 8
J
ayIs, there
y R
1 b aainNavigational . 95 ay, J
o
d
n 176 asn . 5 Result for this Query? .17 No u
6.5 ne 2
M 95. H 1 by 8, 2
78. dressbarn Relevance Ha Excellent
sna Kaw 021
5762 Hollister St in i fr
Name Accuracy Ra sh G om I
Correct
Houston, TX 77040 za hu P
lam
Classification: Women’s Clothing Incorrect – Street
Address Accuracy Number and Street
Additional info: Name
URL: [Link]
Phone: 1-713-331-0007 Pin Accuracy Approximate
[dressbarn] The result name and URL are pointing to a
dressbarn location. The address listed is
User and fresh associated with a business called Dots,
viewport in located in the same shopping center, that has
Houston, TX now closed. After researching the nearby
area, a dressbarn with the same phone
number as our result is found located within
the same shopping center as our result
address at 13256 Northwest Freeway,
Houston, TX 77040. The pin is located
within the shared parking lot of the shopping
mall. Because a business with the same name
and phone number is found in the immediate
surrounding area, we will consider the
address incorrect for this result.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
237
Query ResultsIP Ratings and Explanation
ro m m
f
Is there a 0Navigational la Result for this Query? No
2 21 Ghu
28 , is h M
u ne Kaw aza Relevance7 ond Excellent
, J by R 8.9 ay,
y
a .51 ain 5.17 JCorrect
u
ond Pottery
7 6 asn Barn Name Accuracy 6.5 ne 2
M 95. 1 1
H
78. 1350 Fashion Valley Rd, San Ha by K 8, 20
snIncorrect2 – Street
ain awis 1 fro
Diego, CA 92108 Address Accuracy Number Ra h and
Gh mStreet
Classification: Furniture Store Nameza ula IP
m
[furniture Additional info: Pin Accuracy Approximate
store] URL: [Link] The result name and URL point to a Pottery
Phone: 1-619-296-8014 Barn location. The address listed is
User and Fresh
San Diego, CA associated with a nearby business, Wells
Fargo Bank. After researching the nearby
area, a Pottery Barn with the same phone
number as our result is found at 7007 Friars
Road, San Diego, CA 92108, within the
Fashion Valley Mall. The pin lands on the
Fashion Valley Mall. Because a business with
the same name and phone number is found in
the immediate surrounding area, consider the
address incorrect for this result.
Is there a Navigational Result for this Query? No
The Lot Bar Relevance Excellent
2333 S St
Sacramento, CA 95816 Name Accuracy Incorrect
Classification: Dive Bar Address Accuracy Correct
238
Query Results IP Ratings and Explanation
r o m m
f
Is there a 0Navigational la Result for this Query? No
2 21 Ghu
,
28 awis h Mo
Holidayne KInn z a Business/POI
7 is
n closed/does not
u y
J NbHarbor R a 8.9 day, ☑
a 300
y , 1 i n Drive exist 5. J
nd 176.5 asna Beach, CA 90277 17 un
Mo [Link]
6.5 e 2
. H Relevance 1Excellent
b 8,
78 Classification: Hotels and Events H asn y Ka 2021
a wi fr
Use all the informationinprovided
Ra sh G ,om even
Additional Info: information that's not rated, za likehuURLIPand
lam
URL: [Link] phone number, to research the result.
holidayinn
Phone: 1-310-750-1149 In this case, research shows that the address
belongs to a Crowne Plaza Hotel, not a
Holiday Inn. Street imagery also shows that
[holiday inn] this building is a Crowne Plaza.
User and fresh The result phone number does not belong to
viewport in Santa any business and the given URL does not
Ana, CA point to any particular Holiday Inn.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
239
Query Results
IP Ratings and Explanation
ro m m
f la
21 Ghu
Is there,a20Navigational Result for this Query? No
2 8 wish Mo
ne a a 78 nda
, Ju by K Raz .95 y, J
d aSanta’s
y
. 5 1 aProfessional
i n Dog
Relevance .17 Excellent
u
o 1 7 6 asn
n Grooming 6.5 ne 2
M 95. 1
H
78. 603 Manley St, North Pole Ha by K 8, 20
sna aw 21
AK, 99705 in i fr
Name Accuracy Incorrect
Ra sh G om I
Classification: Pet Services za hu P
lam
240
Query ResultsIP Ratings and Explanation
ro m m
f
Is there a 0Navigational la Result for this Query? No
2 21 Ghu
28 , is h Mo
ne Kaw aza Business/POI
7 is
n closed/does not
u
J by 8.9 day, ☑
a y , 1 in
R exist 5.17 Jun
ond 176.5 asna 6.5 e 2
M 95. H Relevance 1Excellent
b 8,
. Shell H asn y Ka 2021
78
1221 S Main St, Wildwood, FL ain wis fro
34785 Ra h G m I
za hu P
Classification: Gas Station lam
Additional info:
URL: [Link]
Phone: 1-352-748-6199 There are two gas stations in the immediate
area:
241
IP
Query Results ro m m Ratings and Explanation
0 2 1 f hula
G
Is there 2 8,a2 Navigational
w i sh Result for this Query?Mo No
u ne Ka aza 7 nd
8.9 ay,
d y, J 51 by inInc
aDinosaur
R Business/POI [Link]
17closed/does
Ju not
n 8655 6 . n a 6 ne ☑
o
M 95. 1 7
H Jones
a s Rd exist . 5 1 2 8
78. Houston,TX77065 Ha by K , 20
Relevance a 21
sna Excellent
in wish from
Ra
Additional info: za Ghu IP
Research on the result information lamshows
Phone: 1-281-531-6500 that the address belongs to Trails at
Classification: n/a Corinthian Creek Apartments. The result
[dinosaur]
phone number belongs to a different
User and large apartment complex, Domain West
fresh viewport in Apartments. Finally, there is no evidence that
Texas the business Dinosaur Inc exists. Based on
the information listed, rate the result as
Closed/Does not exist.
242
11. Top Rating Tips IP
ro m m
f ula
Solutions to the most common 2 0 21rating
Gh dilemmas.
2 8, wish Mo
u ne Ka aza 7 n
8.9 day,
, J 1 by inwhen
11.1. What’s the arelevance query is business/POI name and.17address and the result is
y R 5 Ju
n d 6.5 sna n
only the address?
o
M 95.1 Ha 7 6 .51 28 e
. H b ,
7 8 asn y Ka 2021
When a user types in the name of a business or a POI along with its address, ainthey wiexpect
fr to see the
Ra sh G om I
business mentioned in the query as part of the result. If the result is the address alone za hand
ul does
P not
mention the business, the user cannot be certain that the query and the result refer to theamsame thing.
This is why the result’s relevance is Bad.
11.2. What’s the relevance when the query is a street name and the result is a single
business on that street?
A query for an entire street is very broad. When the result is just one business or one address on that
street, it is too specific to satisfy the broad intent of the query.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
243
Query Results
IP Ratings and Explanation
ro m m
Little Sheep f ula
2 0 21 Mongolian
Gh
Hot Pot Relevance Bad (User Intent)
190622Stevens
8 , is Creek Blvd
h Mo
ne Kaw Name Accuracy
78 nda Correct
Cupertino,
, u
J by CA,
R aza95014 .95 y, J
y
a .51 ain .17 unCorrect
nd Classification:
6 n Chinese Address Accuracy 6.5 e 2
M 95.17 Has
o
1
78. Ha by K 8, 20
Pin Accuracy snaPerfect
a 21
[Stevens in wish from
Ra
Creek Blvd] za Ghu IP
lam
The result is for a business on the street.
When the query is for a street, returning a
single business is too specific a result for the
broad query.
11.3. How do I know what the location intent is when user is outside/inside a fresh viewport?
When a viewport is fresh, the location intent for results depends on whether the user is inside or
outside the viewport:
• When a user is inside the viewport, that user’s location is the location intent
• When a user is outside the viewport, results are expected in or near the viewport, no matter
how near or far the user is from that viewport.
244
11.4. How do I know what the location intent is when user is outside/inside a stale viewport?
IP
ro m m
f la
2 0 21 Ghu
When a viewport is stale, 28the
, user’sh location is considered the location
Mo intent for the results whether
e a wis a
the user is inside or Joutside
u by K the
n aviewport
z 78 nda
y , R .95 y, J
d a .51 ain .17 un
on 176 asn 6.5 e 2
Viewport M 95. H User Location 1 b 8,
Intent
78 . H asn y Ka 2021
ain wis fro
Inside Viewport Ra h G m I
za user
When the viewport is stale, consider only the P
hu location as
lam
Outside location intent.
Stale Viewport
Use the stale viewport as location intent when the user
Missing
location is missing.
11.5. This full address result does not exist. How do I rate it?
An address type result needs to be associated with a building or officially assigned to a plot of land in
order to be useful to a user. Sometimes your research will show that a queried address simply does
not exist. In cases like, this you’ll see one of three types of results:
• The closest verified address (on the same street, in the same city and state): Rate
relevance as Excellent.
• The same address as the query address: Rate relevance as Excellent and address as
Incorrect – Address does not exist. The pin will be rated Can’t Verify.
• The queried street without a street number: Rate relevance as Acceptable.
When a queried address does not exist, the answer to the question “Is there a navigational result for
this query” will always be No.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
245
Query Results IP Ratings and Explanation
ro m m
2 1 f hula
Is there a 0Navigational Result for this Query? No
, 2 h G
28 awis St M
Relevance 7 ond Excellent
[2001 Duncan 1099 u ne Duncan
K z a
by n Ra St., San
y, J 51 Duncan
8.9 ay,
St, San nda1099 . a i Name Accuracy
5.1 Ju
76 n/a
Francisco]
o 7
1 Ha6
M [Link], s n 94131, CA .51 ne 28
78. Classification: n/a H by K , 20
Address Accuracy asnCorrect 2
ain awis 1 fro
Ra h G m I
Pin Accuracy Perfect za hu P
lam
If 2001 does not actually exist then selecting
1099, the closest number that does exist, is
considered correct. For a locale that uses the
rule of even numbers on one side of the street
and the odd numbers on the other, we need to
return the closest existing address on the same
side of the street as the query. If the rule of
odds and evens does not apply then the
closest numeric number will be considered
correct.
The pin has to be correctly dropped on the
address presented in the result.
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
246
Query Results IP Ratings and Explanation
ro m m
Duncan St21 f hula Relevance Acceptable (User Intent)
Duncan 2 , 20 San
8St, i
G
sh Francisco, Mo
94131,
w
ne Ka aza Name Accuracy 78 nda n/a
y , Ju byCA R .95 y, J
a .51 ain Address Accuracy.176. Correct
nd Classification:
6 n n/a un
o
M 95.1 Ha7 s 51 e 28
78. Ha by K , 20
Pin Accuracy snPerfect 2
ain awis 1 fro
Ra h G m I
The result returns only the street
za with
hu aPpin
la
dropped within the boundaries of the m street.
This result technically satisfies the user intent,
but this intent is unlikely, so relevance should
be rated Acceptable.
A pop-up window with a list of reasons for release will appear. You must choose one before you can
release the survey.
Note: If you change your mind and decide to rate the survey, click Cancel at the bottom left of the
pop-up window.
Reasons to Release
1. Adult Content
You are not comfortable rating queries and/or results that include businesses offering adult services
or entertainment, like strip clubs.
2. Technical Issue
247
P
3. Not Enough Time Allocated om I m
f r la
2 0 21 Ghu
Select this option if the Estimated
8, sh Rating Time is not sufficient to complete
Mo the task. Remember, the
n e 2 Kawi za n
Estimated Rating Time J u is the
y average
Ra time over multiple tasks. 7 d
8.9 ay,
d ay, .51 b ain 5.1 Ju
76 ne
o n 176 asn .51 28
4. Other M 95.
. H H b ,
7 8 asn y Ka 2021
ain wis fro
Issues not mentioned above that prevent you from rating. Ra h G m I
za hu P
lam
If you choose this option, you must leave a comment before you can release the
survey.
Do Not Release
These issues will not prevent rating and are not reasons to release surveys:
• Poor satellite image, including clouds over target area or lack of image detail
• You can zoom in and out on map, but not as much as you'd prefer
• Rating is too difficult
• Query does not appear to be related to maps
• Query or results are from outside your market
• Query or results in unexpected languages and scripts:
• If you see a query in an unexpected language or script, research it or use an online
translation tool to find out what it means, then rate it as usual.
• For results in an unexpected language or script see Result Name/Title in Unexpected
Language or Script and Language/Script Issues in Address
Mo IP
o m
78 nda 1 fr ulam
.95 y, J 2
20 sh Gh
.17 un 8, i
6.5 e 2 2
1 ne Kaw aza
Ha by K 8, 20 Ju y R
sna aw 21
fr day, .51 b ain
in i n 6 n
Ra sh G om I Mo 95.17 Has
za hu P 78.
lam
248