AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?
Paper
•
2407.15711
•
Published
•
9
id
stringlengths 64
64
| set
stringclasses 1
value | task
stringlengths 70
259
| answer
stringlengths 2
133
| gold_url
stringlengths 67
1.62k
| explanation
stringlengths 103
898
| metadata
stringlengths 82
146
| difficulty
stringclasses 2
values |
|---|---|---|---|---|---|---|---|
b36ef2d8f2643b80e74a44ce3403f674ecb2aed7fd36afeaa289061a59feef92
|
dev
|
Which gyms near Tompkins Square Park (<200m) have fitness classes before 7am?
|
CrossFit East River
Avea Pilates
|
https://beastriver.com/schedule
https://aveapilates.com/book-now-ev/
|
According to Google Mpas there are a few gyma near TSP, including, Body evolution, CrossFit EastRiver, Blink Fitness, and Flying Squirrel Studions. From looking at their schedules on the websites, only CrossFit East River and Avea Pilates has classes before 7 am.
|
{'is_task_duplicated': 'no', 'duplicated_task_id': nan, 'field_of_expertise': nan}
|
Hard
|
a9074997e698f912b9e751779ea19c1e92fa148404e90e0ae997acea3f9559b0
|
dev
|
What are hikes in Yellowstone that have been recommended by at least three different people with kids and are highly rated on TripAdvisor (an average from 4.5/5 from at least 50 reviews)?
|
Trout lake trail
Artist Point
Fountain Paint Pot
Lone Star Geyser
Storm Point Trail
|
https://www.tripadvisor.com/ShowUserReviews-g60999-d482189-r605491440-Trout_Lake_Trail-Yellowstone_National_Park_Wyoming.html
https://www.tripadvisor.com/ShowUserReviews-g60999-d482189-r503756308-Trout_Lake_Trail-Yellowstone_National_Park_Wyoming.html
https://www.tripadvisor.com/ShowUserReviews-g60999-d482189-r416511671-Trout_Lake_Trail-Yellowstone_National_Park_Wyoming.html
https://www.tripadvisor.com/Attraction_Review-g60999-d532065-Reviews-Artist_Point-Yellowstone_National_Park_Wyoming.html
https://www.tripadvisor.com/Attraction_Review-g60999-d4430877-Reviews-Fountain_Paint_Pot-Yellowstone_National_Park_Wyoming.html
https://www.tripadvisor.com/Attraction_Review-g60999-d140533-Reviews-Lone_Star_Geyser-Yellowstone_National_Park_Wyoming.html
https://www.tripadvisor.com/Attraction_Review-g60999-d536177-Reviews-Storm_Point_Trail-Yellowstone_National_Park_Wyoming.html
|
Trip advisor gives reviews and recommendations. It also allows filtering kid-friendly hikes. To find the reviews you need to the page of each trail. For example, Trout lake trail has many recommendatios from people with children and a rating of 4.5 form 50+ reviews
|
{'is_task_duplicated': 'no', 'duplicated_task_id': nan, 'field_of_expertise': nan}
|
Hard
|
2aa5dd83fbcd0dce9a3dd4592106e5b5edf738008d932e357d477bba80e59ccf
|
dev
|
Based on recent years (2020-2023), how likely am I to hit a rainy day (at least 0.5mm of precipitation) if I travel to Seattle during the first week of September? (provide the answer in percentage)
|
14.2
|
https://www.wunderground.com/history/monthly/us/wa/seatac/KSEA/date/2020-9
https://www.wunderground.com/history/monthly/us/wa/seatac/KSEA/date/2021-9
https://www.wunderground.com/history/monthly/us/wa/seatac/KSEA/date/2022-9
https://www.wunderground.com/history/monthly/us/wa/seatac/KSEA/date/2023-9
|
Based on recent data, there has been at least 0.5mm of rain on 4/28 during the first week of September.
|
{'is_task_duplicated': 'no', 'duplicated_task_id': nan, 'field_of_expertise': nan}
|
Medium
|
2ddae3b7a208e3c25f14d82d7a1faaaa1832fbf950b4dac345e755c4c361f294
|
dev
|
What's the lowest price a Single Family house was sold in Queen Anne in January 2023?
|
1010000
|
https://blue.kingcounty.com/Assessor/eRealProperty/Dashboard.aspx?ParcelNbr=2397100180
https://info.kingcounty.gov/assessor/esales/Residential.aspx
|
You need to first find the dataabase of historical prices (privided by the King County Gov Assessor) and then use their API to find historical prices
|
{'is_task_duplicated': 'no', 'duplicated_task_id': nan, 'field_of_expertise': nan}
|
Medium
|
797f7a5b65ca28b7e7156e7db1e9f117bd4a021de0cd512bfdbb0be897d89eab
|
dev
|
Which restaurants (not takeaway only) within 1 blocks of Washington Square Park have vegan mains for under $15?
|
Shanghai villa
|
https://order.mealkeyway.com/customer/release/index?mid=4e5259586b574d6b434253426e474956696d474a4c513d3d#/main
|
You can use google maps to find restaurants within a block of the park. Then, you need to verify they have vegan mains using the restaurants' sites.
|
{'is_task_duplicated': 'no', 'duplicated_task_id': nan, 'field_of_expertise': nan}
|
Hard
|
4e615af6f0348597b4133cc1ec5418bb3f35328e3d95e23a275027cee97b5e09
|
dev
|
Which paintball places in Cologne, Germany are within a 10 minute walk from a karting track?
|
Adrenalinpark Köln
|
https://adrenalinpark.de/koeln/
https://www.google.com/maps/dir/google+maps+adrenaline+park+cologne/Le-Mans-Karting+GmbH,+K%C3%B6hlstra%C3%9Fe,+Ehrenfeld,+%D7%92%D7%A8%D7%9E%D7%A0%D7%99%D7%94%E2%80%AD/@50.9764685,6.8992533,17z/data=!3m2!4b1!5s0x47bf30006fc2ef09:0x8d603f5a40e9685a!4m13!4m12!1m5!1m1!1s0x47bf30006247ccdd:0xf3e0f97ee533a48d!2m2!1d6.89767!2d50.97691!1m5!1m1!1s0x47bf3000a6faa543:0x436fd9e01af9ff92!2m2!1d6.8956868!2d50.9758872?entry=ttu
|
There are a few ways to answer this question, either using a map tool or getting to the Adrenalinpark website and finding the karting-paintball deal.
|
{'is_task_duplicated': 'no', 'duplicated_task_id': nan, 'field_of_expertise': nan}
|
Hard
|
c7afe00869f98cf363fd83677ac41757ed5e57f03eacc3d1304feb0a92084bd1
|
dev
|
What is the highest rated (according to IMDB) Daniel Craig movie that is less than 150 minutes and is available on Netflix (US)?
|
Glass Onion: A Knives Out Mystery
|
https://www.imdb.com/list/ls099527218/
https://www.whats-on-netflix.com/library/movies/
|
You can use IMDB to find a list of Daniel Craig movies sorted by their runtime. Then, use what's on netflix to find which ones are on Netflix
|
{'is_task_duplicated': 'no', 'duplicated_task_id': nan, 'field_of_expertise': nan}
|
Medium
|
57d9dc6935e8a40b02e7f8ec81768fe70e68a0c05f6866927c9fda38db38a486
|
dev
|
How much will I save by getting annual passes for my family (2 adults, 1 kid age 5, 1 kid age 2) for the Seattle Children Museum, compared to buying daily tickets, if we visit 4 times in a year?
|
45
|
https://seattlechildrensmuseum.org/visit/
https://seattlechildrensmuseum.org/visit/become-a-member/
|
You need to find the visit cost (240, since all members have to pay $14 for 16 entries) and the membership cost ($195 for foure people) on the different tabs, and then calculate the difference.
|
{'is_task_duplicated': 'no', 'duplicated_task_id': nan, 'field_of_expertise': nan}
|
Hard
|
748899d9d70c09beb3bd48ac8a3658bdcfd2f9114fe6dc4c4b8d2f9541ef4607
|
dev
|
How much does it cost to send an envelope with 1-week delivery from Rio de Janeiro to NYC with DHL, USPS, or Fedex? (Format your answers as a list of jsons with the keys "sender" and "price (usd)" for each option you find)
|
{"sender": "DHL", "price (usd)": "55-70"}
{"sender": "Fedex", "price (usd)": "62-95"}
{"sender": "USPS", "price (usd)": "73.4-78.15"}
|
https://www.fedex.com/en-us/online/rating.html#
https://www.dhl.com/us-en/home/get-a-quote/one-time-shipment-quote.html
https://pe.usps.com/text/dmm300/Notice123.htm?_gl=1*1ds6kt9*_gcl_au*NzI5MjgzNzAzLjE3MTA1ODE4MTA.*_ga*MjU1MjY1OTc5LjE3MTA1ODE4MTA.*_ga_3NXP3C8S9V*MTcxMTI2OTcxMS4zLjEuMTcxMTI3MDc4NS4wLjAuMA..#_c322
|
You need to access the DHL, Fedex, and USPS online calculators. For USPS, there is no online calculator, and you need to (1) find the shipping group (8 or 13), then (2) find the price for the group for 1 week envelope delivery
|
{'is_task_duplicated': 'no', 'duplicated_task_id': nan, 'field_of_expertise': nan}
|
Hard
|
9e31099fffa6a3891c94934fd4fc2f3f522d51c1904ff3561f3a10e4bf245821
|
dev
|
Which of the people in the monday.com C-suite did not have a C-suite position during the company's IPO?
|
Shiran Nawi, Yoni Osherov, Daniel Lereya
|
https://ir.monday.com/corporate-governance/management-team/default.aspx
https://www.crunchbase.com/person/eliran-glazer
|
Monday.com had its IPO on June 10th 2021. The Monday.com website includes information on all c-suite members, including when they were promoted to their current positions.
|
{'is_task_duplicated': 'no', 'duplicated_task_id': nan, 'field_of_expertise': nan}
|
Medium
|
291b53e665b4dd4365cde995042db4a6f6fecef3fe3a6f4482f23d61bd673918
|
dev
|
What is the link to the GFF3 file for beluga whales that was the most recent one on 20/10/2020?
|
https://ftp.ensembl.org/pub/release-101/gff3/delphinapterus_leucas/Delphinapterus_leucas.ASM228892v3.101.gff3.gz
|
https://ftp.ensembl.org/pub/release-101/gff3/delphinapterus_leucas/
|
This requires finding the historical gff3 files database (https://ftp.ensembl.org/pub/) then finding the correct version (release 101) and then finding the gff3 for a cetacea and understanding that the white one is a beluga.
|
{'is_task_duplicated': 'no', 'duplicated_task_id': nan, 'field_of_expertise': nan}
|
Hard
|
8fa42360185068216f2919935148d4e1ad28ddc18da0abd0f4bb0b6b6f84b127
|
dev
|
Which Vanguard ETF had the highest pct increase between 2013 and 2023: VGT, MGK, or VONG?
|
VGT
|
https://www.google.com/search?q=vanguard+vgt+price&sca_esv=f4dacfe81c780abe&rlz=1C5CHFA_enIL995IL995&sxsrf=ACQVn0-ZbEsAYbUpO3VrPr78izq7LisCig%3A1710965384413&ei=iEL7ZZ7oGLXji-gPkN6R-A4&ved=0ahUKEwiezNff0oOFAxW18QIHHRBvBO8Q4dUDCBA&uact=5&oq=vanguard+vgt+price&gs_lp=Egxnd3Mtd2l6LXNlcnAiEnZhbmd1YXJkIHZndCBwcmljZTIFEAAYgAQyBhAAGBYYHjIGEAAYFhgeMgYQABgWGB4yCxAAGIAEGIoFGIYDMgsQABiABBiKBRiGAzILEAAYgAQYigUYhgMyCxAAGIAEGIoFGIYDSPsQULABWIUQcAZ4AZABAZgBrwGgAfYKqgEDMC45uAEDyAEA-AEBmAINoALoCMICChAAGEcY1gQYsAPCAg0QABiABBiKBRhDGLADwgIZEC4YgAQYigUYQxjHARjRAxjIAxiwA9gBAcICChAAGIAEGIoFGEOYAwCIBgGQBgu6BgQIARgIkgcDNi43oAfpMw&sclient=gws-wiz-serpp
|
The way to answer this question is to find an online tool with historical ETF data and fine the prices for each ETF between 2013 and 2023.
|
{'is_task_duplicated': 'no', 'duplicated_task_id': nan, 'field_of_expertise': nan}
|
Medium
|
3af8028c2a59e28ca88baff0e6d91f2a9f170c5ef91003f1c8406755a2760ad4
|
dev
|
Which Magic: The Gathering Standard card (non-foil paper version released in its original set) that was banned at the same time as Oko, Thief of Crowns (including Oko, Crown of Thorns) had the highest price decrease from its all-time high to its all-time low?
|
Oko, Thief of Crowns
|
https://magic.wizards.com/en/news/announcements/november-18-2019-banned-and-restricted-announcement
https://www.mtggoldfish.com/price/Throne+of+Eldraine/Oko+Thief+of+Crowns#paper
https://www.mtggoldfish.com/price/Throne+of+Eldraine/Once+Upon+a+Time#paper
https://www.mtggoldfish.com/price/Core+Set+2020/Veil+of+Summer#paper
|
First, you need to find the cards that were banned when Oko, Thief of Crowns was banned in the standard format. Wizards.com has archives for card bannings. The website shows that three cards were banned in the Standard format on November 18, 2019: Oko, Thief of Crowns,
Once Upon a Time, and Veil of Summer. A website like Mtggoldfish has historic prices for cards. Enter the card name in the search box (make sure to click on the non-foil version and the original set, for instance, a quick Google search shows that Oko, Thief of Crowns, was first released in Throne of Eldraine. Navigate down the page, and you will see a tab that says tabletop or MTGO. Hit tabletop and look at the chart, which shows all-time high and all-time low. Oko has 67.61 and 11.90 respectively. The numbers for Once Upon a Time are 19.31 and 0.75 respectively, Veil of Summer had the numbers 13.30 and .30 respectively.
|
{'is_task_duplicated': 'yes', 'duplicated_task_id': '8fa42360185068216f2919935148d4e1ad28ddc18da0abd0f4bb0b6b6f84b127', 'field_of_expertise': nan}
|
Medium
|
6b06d186921b8b390c65aebd0d16f09f60a47d2f1288ebe36953f734e84c0a3c
|
dev
|
What's the smallest house (based on square footage) that has at least 2 beds and 2 baths and was sold in Prince Edward Island between June 1, 2022 and May 15 2024 according to Zillow?
|
1148 sqft
|
https://www.zillow.com/pe/sold/?searchQueryState=%7B%22pagination%22%3A%7B%7D%2C%22isMapVisible%22%3Atrue%2C%22mapBounds%22%3A%7B%22west%22%3A-65.1899688203125%2C%22east%22%3A-60.9162871796875%2C%22south%22%3A45.484546430628335%2C%22north%22%3A47.77380930534261%7D%2C%22mapZoom%22%3A8%2C%22regionSelection%22%3A%5B%7B%22regionId%22%3A404373%2C%22regionType%22%3A2%7D%5D%2C%22filterState%22%3A%7B%22sort%22%3A%7B%22value%22%3A%22globalrelevanceex%22%7D%2C%22fsba%22%3A%7B%22value%22%3Afalse%7D%2C%22fsbo%22%3A%7B%22value%22%3Afalse%7D%2C%22nc%22%3A%7B%22value%22%3Afalse%7D%2C%22cmsn%22%3A%7B%22value%22%3Afalse%7D%2C%22auc%22%3A%7B%22value%22%3Afalse%7D%2C%22fore%22%3A%7B%22value%22%3Afalse%7D%2C%22rs%22%3A%7B%22value%22%3Atrue%7D%2C%22beds%22%3A%7B%22min%22%3A2%2C%22max%22%3Anull%7D%2C%22baths%22%3A%7B%22min%22%3A2%2C%22max%22%3Anull%7D%2C%22tow%22%3A%7B%22value%22%3Afalse%7D%2C%22mf%22%3A%7B%22value%22%3Afalse%7D%2C%22con%22%3A%7B%22value%22%3Afalse%7D%2C%22land%22%3A%7B%22value%22%3Afalse%7D%2C%22apa%22%3A%7B%22value%22%3Afalse%7D%2C%22manu%22%3A%7B%22value%22%3Afalse%7D%2C%22apco%22%3A%7B%22value%22%3Afalse%7D%2C%22doz%22%3A%7B%22value%22%3A%2224m%22%7D%7D%2C%22isListVisible%22%3Atrue%7D
|
Zillow has a tool that will allow you to sort real estate sales. Search for sales in Prince Edward Island, then use the filters to filter the dates and only check the box for home type-houses, and filter the number of beds and baths.
|
{'is_task_duplicated': 'yes', 'duplicated_task_id': '2ddae3b7a208e3c25f14d82d7a1faaaa1832fbf950b4dac345e755c4c361f294', 'field_of_expertise': nan}
|
Hard
|
9bdca8677af1e25cb7b0c7992dc62670c3e58e4afcd5ae60bcaa2483556bba00
|
dev
|
What is the cheapest option to mail a DVD to Colombia from Hartford, Connecticut using FedEx, DHL, or USPS? (The answer should be a json object with the keys "sender" and "price (usd)")
|
{"sender": "USPS", "price (usd)": "41.75"}
|
https://postcalc.usps.com/Calculator/MailServices?country=10067&ccode=CO&oz=06101&omil=False&dz=57&dmil=False&retail=False&mdt=5%2F27%2F2024&mdz=23%3A59&m=12&dvi=%24%20500&ct0=True&hscode=False
https://www.dhl.com/us-en/home/get-a-quote/one-time-shipment-quote.html
https://www.fedex.com/en-us/online/rating.html#
|
You need to access the DHL, Fedex, and USPS online calculators. You can enter Connecticut and Colombia as the source and destination respectively. USPS has an option for $41.75, DHL has lowest for $146.93 and Fedex has lowest at $246.52.
|
{'is_task_duplicated': 'yes', 'duplicated_task_id': nan, 'field_of_expertise': nan}
|
Medium
|
557e78eceec08ca8b0da5f9fdaca6e1c7ec6140a8ce600983ee716327dab005e
|
dev
|
Which bar is closest to Mummers Museum in Philadelphia and is wheel chair accessible?
|
For Pete's Sake
|
https://www.google.com/maps/search/Bars+and+pubs/@39.933448,-75.157869,15z/data=!4m8!2m7!3m6!1sBars+and+pubs!2sMummers+Museum,+1100+S+2nd+St,+Philadelphia,+PA+19147!3s0x89c6c8a3c738dbeb:0x2f8eae1955320936!4m2!1d-75.1475477!2d39.9334836?entry=ttu
https://www.forpetessakepub.com/
https://www.tripadvisor.com/Restaurant_Review-g60795-d3452388-Reviews-For_Pete_s_Sake-Philadelphia_Pennsylvania.html
|
Google maps will show which bars are near Mummer's museum. Google maps does not mention if they are wheelchair accessible. The next step is to check the individual websites for nearby bars. If that doesn't mention anything, Tripadvisor can help.
|
{'is_task_duplicated': 'yes', 'duplicated_task_id': 'b36ef2d8f2643b80e74a44ce3403f674ecb2aed7fd36afeaa289061a59feef92', 'field_of_expertise': nan}
|
Hard
|
fb9ba3ab6a13d0adc677f993e90d54914a5cdf211305a1bba6bf16ec4ccb9b7c
|
dev
|
On which social media platform does Andrew Ng have the most followers?
|
Linkedin
|
https://x.com/AndrewYNg
www.linkedin.com/in/andrewyng?original_referer=https%3A%2F%2Fwww.google.com%2F
https://www.youtube.com/channel/UC2G7wfV7ZW88NixZPfT25kw
|
A Google search for Andrew Ng will bring up an Infobox on the right side that has links to all his social media profiles. LinkedIn has the most followers at 2 million.
|
{'is_task_duplicated': 'yes', 'duplicated_task_id': nan, 'field_of_expertise': nan}
|
Medium
|
52f7224e9c79431e7926afe317782711a0028750693e7456cde22ef6f4bd8bd5
|
dev
|
What is the highest rated (according to IMDB) Isabelle Adjani feature film that is less than 2 hours and is available on Vudu (now called Fandango at Home) to buy or rent?
|
Nosferatu the Vampyre
|
https://www.imdb.com/filmosearch/?explore=title_type&role=nm0000254&ref_=filmo_ref_typ&sort=user_rating,desc&mode=detail&page=1&title_type=movie
https://www.vudu.com/content/browse/details/Nosferatu-the-Vampyre/13834
https://www.justwatch.com/us/movie/nosferatu-the-vampyre
|
You can use IMDB to find a list of Isabelle Adjani movies. You can then sort the list by rating and check which ones are under two hours. The Tenant is the highest rated that is no Vudu, but it is over two hours. The next highest rated movie is Nosferatu the Vampyre. On Vudu.com you can use the search box to find Isabelle Adjani movies. Nosferatu the Vampyre is available. While Vudu.com is restricted access in some countries, there are other websites just as JustWatch that provide the information.
|
{'is_task_duplicated': 'yes', 'duplicated_task_id': 'c7afe00869f98cf363fd83677ac41757ed5e57f03eacc3d1304feb0a92084bd1', 'field_of_expertise': nan}
|
Medium
|
0ec4371851b96837b0a81b3dd3df401415061bb532fbafeb4609f3337c358508
|
dev
|
Which gyms (not including gymnastics centers) in West Virginia are within 5 miles (by car) of the Mothman Museum?
|
The Root Sports & Fitness Center
Muscle Headz Gym
|
https://www.google.com/maps/search/gym/@38.8382313,-82.1542828,15z/data=!4m7!2m6!3m5!2sMothman+Museum,+400+Main+St,+Point+Pleasant,+WV+25550!3s0x88489c64aa621717:0x698d671724e768!4m2!1d-82.1385314!2d38.8427256?entry=ttu
|
You can use Google maps to find the Mothman Museum and then search for nearby gyms. There are two gyms within 5 miles, The Root Sports & Fitness Center, and Muscle Headz Gym.
|
{'is_task_duplicated': 'yes', 'duplicated_task_id': '4e615af6f0348597b4133cc1ec5418bb3f35328e3d95e23a275027cee97b5e09', 'field_of_expertise': nan}
|
Hard
|
6f224e7730ed027cbac73aebb1aea7f954053082041b02b19f4ff126a0a8a208
|
dev
|
Which members of Fubo's Management Team joined the company during the same year Fubo's IPO happened?
|
Gina DiGioia
|
https://stockanalysis.com/ipos/2020/
https://www.marketscreener.com/insider/JOHN-JANEDIS-A04R2V/
https://ir.fubo.tv/governance/management-team/default.aspx
|
A site like stockanalysis.com shows historic IPO data. It shows that Fubo had it's IPO on October 8, 2020. Fubo's website has a section on the management team and tells of when they joined. Gina DiGioia joined in 2020 and worked elsewhere. John Janedis worked at TEGNA inc. in 2020 and only started in Fubo in 2022.
|
{'is_task_duplicated': 'yes', 'duplicated_task_id': '9e31099fffa6a3891c94934fd4fc2f3f522d51c1904ff3561f3a10e4bf245821', 'field_of_expertise': nan}
|
Hard
|
99da66d8af02491f98b98c56b26c709e773b5a2ad945fb280375951ba600de09
|
dev
|
How much will I save by getting annual passes for a group of 4 adults and 1 student for the Philadelphia Museum of Art, compared to buying daily tickets, if we visit 5 times in a year (all non-consecutive days)?
|
395
|
https://philamuseum.org/visit/admission
https://philamuseum.org/join/membership-levels-benefits
|
You need to find the visit cost (224) and the membership cost (130) on the different tabs, and then calculate the difference. The per visit cost is $30 per day x 4 adults is $120 per day for adults and the student cost per day is $14 so total daily cost is $120+14=$134 per day x 5 days= $670. We then compare that to the annual cost which is $250 per year for 4 adults (under the Keystone plan) and a student plan for the year is $25 so total cost is $250+$25= $275. So the difference in cost is $670 daily plans-$275 yearly plans= $395.
|
{'is_task_duplicated': 'yes', 'duplicated_task_id': '57d9dc6935e8a40b02e7f8ec81768fe70e68a0c05f6866927c9fda38db38a486', 'field_of_expertise': nan}
|
Medium
|
ccec2229ced20a4b0cb4897e3a99120a3017ea030903e01c9bda6b13d40b0b14
|
dev
|
What is the closest eatery to Harkness Memorial State Park that is still open at 11pm on Wednesdays?
|
McDonald's
|
https://www.google.com/maps/search/Restaurants/@41.34256,-72.2011721,13z/data=!4m8!2m7!3m6!1sRestaurants!2sHarkness+Memorial+State+Park,+275+Great+Neck+Rd,+Waterford,+CT+06385!3s0x89e60fed4482d099:0x85e7f417031aac36!4m2!1d-72.1168749!2d41.3065798?entry=ttu
https://www.mcdonalds.com/us/en-us/location/CT/WATERFORD/117-BOSTON-POST-RD/18361.html?cid=RF:YXT:GMB::Clicks
https://www.chinahousenewlondonct.com/
|
You can use google maps to find which eateries are closest to the park. Then, you need to verify their hours of operation by using the restaurants' sites. Osmino's Grill does not have a website but a Google search reveals they close at 10PM on Wednesday's. A Google search reveals that Tusker's is closed on Wednesday's. Chinahouse New London's website reveals they close at 10:45PM. Only McDonald's is still open at 11PM.
|
{'is_task_duplicated': 'yes', 'duplicated_task_id': '797f7a5b65ca28b7e7156e7db1e9f117bd4a021de0cd512bfdbb0be897d89eab', 'field_of_expertise': nan}
|
Medium
|
9baaa267c95f9d8b75741ee9169c50563d297cfa592c20deaffd30dbc5984c74
|
dev
|
Based on recent years (2020-2023), how likely am I to hit a day with a max temperature (in Fahrenheit) over 95 if I travel to Houston, Texas during June? (provide the answer in percentage)
|
31.67
|
https://www.wunderground.com/history/monthly/us/tx/houston/KHOU/date/2020-6
https://www.wunderground.com/history/monthly/us/tx/houston/KHOU/date/2021-6
https://www.wunderground.com/history/monthly/us/tx/houston/KHOU/date/2022-6
https://www.wunderground.com/history/monthly/us/tx/houston/KHOU/date/2023-6
|
A site like weather underground can be used to find historic weather data. Select Houston, Texas and set the filter to June for each month. 2020 is 1 day out of 30 with a temperature over 95. 2021 was 6 days out of 30. 2022 was 16/30. 2023 was 15 days out of 30. So add up all the days over 95 and divide by the total of days in those 4 months, so 38/120=31.67%
|
{'is_task_duplicated': 'yes', 'duplicated_task_id': '2aa5dd83fbcd0dce9a3dd4592106e5b5edf738008d932e357d477bba80e59ccf', 'field_of_expertise': nan}
|
Medium
|
6e3be83d1949fa52cba03fb1ce4b5b3bf7e37a83fd7d67694b10b2e439d90cf8
|
dev
|
Where can I take martial arts classes within a five-minute walk from the New York Stock Exchange after work (7-9 pm)?
|
Renzo Gracie Jiu-Jitsu Wall Street
|
https://www.renzograciewst.com/
https://www.google.com/maps/place/New+York+Stock+Exchange/@40.706881,-74.0138403,17z/data=!3m1!4b1!4m6!3m5!1s0x89c25a161980d8a1:0x9e5797d5a981701d!8m2!3d40.706877!4d-74.0112654!16zL20vMDVkcmg?entry=ttu
|
Check Google Maps for martial arts centers and find 3 in close vicinity, with Renzo Gracie Jiu-Jitsu being right inside the stock exchange and open until 9 pm.
|
{'is_task_duplicated': 'yes', 'duplicated_task_id': 'b36ef2d8f2643b80e74a44ce3403f674ecb2aed7fd36afeaa289061a59feef92', 'field_of_expertise': nan}
|
Hard
|
e2dc3a6b10b762e8aba7fa4d4e70f757f6d04dcbc8b56c48fc53fd9928d31d07
|
dev
|
Based on the last decade (2014-2023), what is the likelihood that it will snow on New Year’s Eve in Chicago? (Provide the answer in percentage.)
|
30
|
https://www.wunderground.com/history/daily/KMDW/date/2023-12-31
https://www.wunderground.com/history/daily/KMDW/date/2022-12-31
https://www.wunderground.com/history/daily/KMDW/date/2021-12-31
https://www.wunderground.com/history/daily/KMDW/date/2020-12-31
https://www.wunderground.com/history/daily/KMDW/date/2019-12-31
https://www.wunderground.com/history/daily/KMDW/date/2018-12-31
https://www.wunderground.com/history/daily/KMDW/date/2017-12-31
https://www.wunderground.com/history/daily/KMDW/date/2016-12-31
https://www.wunderground.com/history/daily/KMDW/date/2015-12-31
https://www.wunderground.com/history/daily/KMDW/date/2014-12-31
|
Searching historical data on Weather Underground’s website, it snowed on New Year’s Eve in 3 of the years from 2014-2023.
|
{'is_task_duplicated': 'yes', 'duplicated_task_id': '2aa5dd83fbcd0dce9a3dd4592106e5b5edf738008d932e357d477bba80e59ccf', 'field_of_expertise': nan}
|
Medium
|
f88066d274e265edd6cd9d61cd80a41accb3a14baf2297652fdd05cdf716d455
|
dev
|
What popular hiking trails to waterfalls in Yosemite National Park (more than 1,000 reviews on TripAdvisor) have been recommended to be fully accessible to wheelchairs by at least three different people and are highly rated (4.5/5 or more on average)?
|
Yosemite Falls
Bridalveil Fall
|
https://www.tripadvisor.com/Attraction_Review-g61000-d483476-Reviews-Yosemite_Falls-Yosemite_National_Park_California.html
https://www.tripadvisor.com/Attraction_Review-g61000-d139181-Reviews-Bridalveil_Fall-Yosemite_National_Park_California.html
|
Trip Advisor has Yosemite park reviews and recommendations. Each trail has a rating as well as reviews that can be searched for mention of wheelchairs. For the popular hikes, Mariposa has many reviews saying it can be accessed by wheelchairs (and some say the contrary) but it does not have a waterfall. For Mist trail, another popular hike, they are not enough reviews saying it is accessible by wheelchairs. Similarly for popular waterfalls, for Vernal Fall visitors say it is not accessible in the reviews.
|
{'is_task_duplicated': 'yes', 'duplicated_task_id': nan, 'field_of_expertise': nan}
|
Hard
|
e6bc98089608217e45b6956a46518fe3cce64a799b3ac43c6974c449ae14c408
|
dev
|
What's the highest price a high-rise apartment was sold for in Mission Bay, San Francisco, in 2021?
|
3080000
|
https://www.zillow.com/mission-bay-san-francisco-ca/sold/?searchQueryState=%7B%22isMapVisible%22%3Atrue%2C%22mapBounds%22%3A%7B%22north%22%3A37.782547358348246%2C%22south%22%3A37.760395726576725%2C%22east%22%3A-122.37628070623781%2C%22west%22%3A-122.40589229376222%7D%2C%22usersSearchTerm%22%3A%22940107%20Old%20Nassauville%20Rd%20Fernandina%20Beach%2C%20FL%2032034%22%2C%22filterState%22%3A%7B%22sort%22%3A%7B%22value%22%3A%22priced%22%7D%2C%22fsba%22%3A%7B%22value%22%3Afalse%7D%2C%22fsbo%22%3A%7B%22value%22%3Afalse%7D%2C%22nc%22%3A%7B%22value%22%3Afalse%7D%2C%22cmsn%22%3A%7B%22value%22%3Afalse%7D%2C%22auc%22%3A%7B%22value%22%3Afalse%7D%2C%22fore%22%3A%7B%22value%22%3Afalse%7D%2C%22rs%22%3A%7B%22value%22%3Atrue%7D%2C%22sf%22%3A%7B%22value%22%3Afalse%7D%2C%22tow%22%3A%7B%22value%22%3Afalse%7D%2C%22mf%22%3A%7B%22value%22%3Afalse%7D%2C%22land%22%3A%7B%22value%22%3Afalse%7D%2C%22ah%22%3A%7B%22value%22%3Atrue%7D%2C%22manu%22%3A%7B%22value%22%3Afalse%7D%2C%22doz%22%3A%7B%22value%22%3A%2236m%22%7D%7D%2C%22isListVisible%22%3Atrue%2C%22mapZoom%22%3A15%2C%22regionSelection%22%3A%5B%7B%22regionId%22%3A268305%2C%22regionType%22%3A8%7D%5D%2C%22pagination%22%3A%7B%7D%7D
https://www.zillow.com/homedetails/708-Long-Bridge-St-APT-1409-San-Francisco-CA-94158/241585411_zpid/
https://www.estately.com/CA/San_Francisco/sold/condo?order=price_desc
https://www.estately.com/listings/info/708-long-bridge--9
https://www.redfin.com/CA/San-Francisco/708-Long-Bridge-St-94158/unit-1409/home/109315380
https://www.redfin.com/neighborhood/1724/CA/San-Francisco/Mission-Bay/filter/sort=hi-price,property-type=condo,include=sold-3yr
|
Go to the Zillow Recent home sales link. Use the search filters to find the highest-priced apartment/condo sold in Mission Bay in 2021. Do the same with Redfin and Estately, which also track real estate transactions.
|
{'is_task_duplicated': 'yes', 'duplicated_task_id': '2ddae3b7a208e3c25f14d82d7a1faaaa1832fbf950b4dac345e755c4c361f294', 'field_of_expertise': nan}
|
Hard
|
8ad84bd6fe38481ba49e7ad1f6fbd43219a999074e5c6fc940003281f55ec65b
|
dev
|
Which supermarkets within 2 blocks of Lincoln Park in Chicago have ready-to-eat salad for under $15?
|
Potash Markets - Clark Street
|
https://www.google.com/search?q=Lincoln+Park+chicago+supermarkets
https://www.mercato.com/shop/potash-markets-on-clark?utm_source=0440.Potash_Markets_on_Clark&utm_medium=shopnow&keywords=salad
https://www.potashmarkets.com/
|
Use Google Maps to find supermarkets within 5 blocks of Lincoln park. Check the websites and/or Facebook pages to find which have ready-to-eat salads.
|
{'is_task_duplicated': 'yes', 'duplicated_task_id': '797f7a5b65ca28b7e7156e7db1e9f117bd4a021de0cd512bfdbb0be897d89eab', 'field_of_expertise': nan}
|
Hard
|
55f4258484c5b398956133128a50462a767da211f8f72aa5ac5bbffb9bcbba1a
|
dev
|
What is the worst rated series (according to Rotten Tomatoes) with more than 1 season that Ted Danson has starred in and is available on Amazon Prime Video (US)?
|
CSI: Cyber
|
https://www.rottentomatoes.com/celebrity/ted_danson
https://www.amazon.com/CSI-Cyber-Season-1/dp/B00TP1TPHO
|
Search for Ted Danson’s profile on the Rotten Tomatoes website and find a list of TV programs he has acted in. Find the worst rated and check the details to see if it has more than 1 season, if he is a principal character, and if it is available on Amazon Prime Video. Heist is his worst rated TV show but it is only one season. CSI: Cyber is available on Prime and has two seasons.
|
{'is_task_duplicated': 'yes', 'duplicated_task_id': 'c7afe00869f98cf363fd83677ac41757ed5e57f03eacc3d1304feb0a92084bd1', 'field_of_expertise': nan}
|
Hard
|
4dbedc5e1a0205e14b7ff3ba89bce3060dab15d0ada3b7e1351a6f2aa8287aec
|
dev
|
How much did I save by purchasing a season pass instead of daily tickets for California's Great America in San Jose, if I planned to visit once a month in June, July, August, and September during the summer of 2024?
|
$55
|
https://www.cagreatamerica.com/daily-tickets
https://www.cagreatamerica.com/season-passes
https://web.archive.org/web/20240315143604/https://www.cagreatamerica.com/daily-tickets
|
Visit California's Great America website to check ticket prices and calculate the difference between season pass (105) and daily tickets (40*4). You can also find the historical data with for 2024 with WebArchive.
|
{'is_task_duplicated': 'yes', 'duplicated_task_id': '57d9dc6935e8a40b02e7f8ec81768fe70e68a0c05f6866927c9fda38db38a486', 'field_of_expertise': nan}
|
Hard
|
929b45f34805280d77c61d1e093e3d4e551d77ddb6ecd73552b12b1af286388d
|
dev
|
The dog genome was first mapped in 2004 and has been updated several times since. What is the link to the files that were most relevant in May 2020?
|
ftp://ftp.broadinstitute.org/distribution/assemblies/mammals/dog/canFam3.1/
|
https://www.genome.gov/12511476/2004-advisory-dog-genome-assembled
https://www.broadinstitute.org/scientific-community/science/projects/mammals-models/dog/dog-genome-links
https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3953330/
|
Do a general internet search for dog genome. On the home page of the Dog Genome project website, find links to the latest data files.
|
{'is_task_duplicated': 'yes', 'duplicated_task_id': '291b53e665b4dd4365cde995042db4a6f6fecef3fe3a6f4482f23d61bd673918', 'field_of_expertise': nan}
|
Hard
|
cca4776df3c73e7f9430a2e624aafad056b14322a0b7ca6c0c22b7e7f3f0890a
|
dev
|
Which member of Apple’s Board of Directors did not hold C-suite positions at their companies when they joined the board?
|
Wanda Austin
Ronald D. Sugar
Sue Wagner
|
https://investor.apple.com/leadership-and-governance/default.aspx
https://www.apple.com/newsroom/2024/01/wanda-austin-to-join-apples-board-of-directors/
https://www.apple.com/newsroom/2014/07/17Sue-Wagner-Joins-Apple-s-Board-of-Directors/
https://www.apple.com/newsroom/2010/11/17Ronald-D-Sugar-Joins-Apples-Board-of-Directors/
|
Go to Apple’s investor relations website to see the list of BOD members. Then search Apple’s newsroom site for information on each board member.
|
{'is_task_duplicated': 'yes', 'duplicated_task_id': '9e31099fffa6a3891c94934fd4fc2f3f522d51c1904ff3561f3a10e4bf245821', 'field_of_expertise': nan}
|
Hard
|
efc0f3a47e9ed2ecdbcc037c2093865fe6e39f4d413a5d1ccdc7357160a4606b
|
dev
|
Which Fidelity international emerging markets equity mutual fund with $0 transaction fees had the lowest percentage increase between May 2019 to May 2024?
|
Fidelity® Emerging Markets Index Fund (FPADX)
|
https://fundresearch.fidelity.com/mutual-funds/summary/316146331
https://fundresearch.fidelity.com/fund-screener/results/table/overview/averageAnnualReturnsYear5/asc/1?assetClass=ISTK&category=CH%2CDP%2CEI%2CEM%2CES%2CFA%2CFB%2CFG%2CFQ%2CFR%2CFV%2CJS%2CLS%2CMQ%2CPJ%2CSW%2CWB%2CWG%2CWV&fidelityFundOnly=F&ntf=Y&order=assetClass%2Ccategory%2CfidelityFundOnly%2Cntf
https://fundresearch.fidelity.com/mutual-funds/summary/316146331
https://fundresearch.fidelity.com/mutual-funds/summary/315910869
https://fundresearch.fidelity.com/mutual-funds/summary/315910851
https://fundresearch.fidelity.com/mutual-funds/summary/31618H549
|
Go to the News & Research tab on Fidelity’s website, then choose Mutual Funds. Use the online tool to filter for zero transaction fee Fidelity international equity funds. There are four funs that were availalbe to buy in 2019 and FPADX had the lowest income in that range.
|
{'is_task_duplicated': 'yes', 'duplicated_task_id': '8fa42360185068216f2919935148d4e1ad28ddc18da0abd0f4bb0b6b6f84b127', 'field_of_expertise': nan}
|
Medium
|
Bibtex citation
@misc{yoran2024assistantbenchwebagentssolve,
title={AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?},
author={Ori Yoran and Samuel Joseph Amouyal and Chaitanya Malaviya and Ben Bogin and Ofir Press and Jonathan Berant},
year={2024},
eprint={2407.15711},
archivePrefix={arXiv},
primaryClass={cs.CL},
url={https://arxiv.org/abs/2407.15711},
}
- Downloads last month
- 3,381
Size of downloaded dataset files:
98.4 kB
Size of the auto-converted Parquet files:
61.3 kB
Number of rows:
214