Crawler Bench

InterroBot

Crawler/Analyzer · GUI/CLI

InterroBot provides the website crawler, search, and analysis you need to understand your website.

In their wordsinterro.bot
Version Tested
2.15.0 (released Oct 15, 2026)
Vendor
Pragmar
Platforms
Windows, macOS, and Linux
Interfaces
GUI/CLI (both included)
JavaScript Rendering
Yes
Type
Crawler/Analyzer
Test Machine
Mac mini (M1/Tahoe), 8 GB of RAM, macOS 26.6.2

Across the Test Sites

Tested in eight setups on four sites. Its best finish: InterroBot CLI (Turbo) on the Rust Book (remote server), 00:01.0, 1st of 22.

SetupRust Book (local)Rust Book (remote)GIMP 3.0 Manual (local)GIMP 3.0 Manual (remote)
InterroBotGUI · Default threads00:01.85th of 2200:02.35th of 2200:04.75th of 2200:08.96th of 22
InterroBot (JS)GUI · Default threads00:39.420th of 2200:39.620th of 2203:35.716th of 2203:44.216th of 22
InterroBot (Turbo JS)GUI · Turbo threads00:21.618th of 2200:21.518th of 2201:47.411th of 2201:53.211th of 22
InterroBot (Turbo)GUI · Turbo threads00:01.04th of 2200:01.73rd of 2200:03.94th of 2200:05.72nd of 22
InterroBot CLICLI · Default threads00:00.82nd of 2200:01.52nd of 2200:02.92nd of 2200:07.23rd of 22
InterroBot CLI (JS)CLI · Default threads00:39.319th of 2200:39.319th of 2203:39.217th of 2203:47.317th of 22
InterroBot CLI (Turbo JS)CLI · Turbo threads00:21.317th of 2200:20.917th of 2201:57.712th of 2202:01.912th of 22
InterroBot CLI (Turbo)CLI · Turbo threads00:00.93rd of 2200:01.01st of 2200:03.03rd of 2200:05.41st of 22

Site Crawls

Eight InterroBot setups on the Rust Book: 114 pages (176 files) served from a web server on the same Mac, replayed on one clock.

Filter Runs

Site
Server
Filters
Interface
Rendering
Price

Crawl Results

InterroBotFreeGUI · Default threads
00:01.811450114 / 50433 MB114 pages · 50 assets · 433 MB peak
InterroBot (JS)GUI · Default threads
00:39.411450114 / 50934 MB114 pages · 50 assets · 934 MB peak
InterroBot (Turbo JS)GUI · Turbo threads
00:21.611450114 / 501027 MB114 pages · 50 assets · 1027 MB peak
InterroBot (Turbo)GUI · Turbo threads
00:01.011450114 / 50433 MB114 pages · 50 assets · 433 MB peak
InterroBot CLIFreeCLI · Default threads
00:00.811450114 / 50146 MB114 pages · 50 assets · 146 MB peak
InterroBot CLI (JS)CLI · Default threads
00:39.311450114 / 50582 MB114 pages · 50 assets · 582 MB peak
InterroBot CLI (Turbo JS)CLI · Turbo threads
00:21.311450114 / 50771 MB114 pages · 50 assets · 771 MB peak
InterroBot CLI (Turbo)CLI · Turbo threads
00:00.911450114 / 5043.4 MB114 pages · 50 assets · 43.4 MB peak

Resource Usage

Watch in Realtime

Every crawl starts together at 0:07. Click a screen to enlarge it.

0:00.0 / 1:01.9
InterroBotReady
InterroBot (JS)Ready
InterroBot (Turbo JS)Ready
InterroBot (Turbo)Ready
InterroBot CLIReady
InterroBot CLI (JS)Ready
InterroBot CLI (Turbo JS)Ready
InterroBot CLI (Turbo)Ready

Setups

CrawlerVersionInterfaceThreadsSettings
InterroBot2.15.0GUIDefault threadsDefault settings
InterroBot (JS)2.15.0GUIDefault threadsJavaScript rendering on
InterroBot (Turbo JS)2.15.0GUITurbo threadsTurbo threads; JavaScript rendering on
InterroBot (Turbo)2.15.0GUITurbo threadsTurbo threads
InterroBot CLI2.15.0CLIDefault threadsDefault settings
InterroBot CLI (JS)2.15.0CLIDefault threadsJavaScript rendering on
InterroBot CLI (Turbo JS)2.15.0CLITurbo threadsTurbo threads; JavaScript rendering on
InterroBot CLI (Turbo)2.15.0CLITurbo threadsTurbo threads

How This Was Measured

Test Machine
  • Mac mini (M1/Tahoe)8 GB of RAM · macOS 26.6.2

Each crawler ran by itself. Crawl time, counts, memory, and CPU are captured consistently, per OS. See more on how it’s measured.

Sites
  • The Rust Book homepageRust Bookrust-book-local.crawlerbench.com114 HTML pages176 files
  • The GIMP 3.0 Manual homepageGIMP 3.0 Manualgimp-local.crawlerbench.com711 HTML pages2,616 files

Served from a local web server on the test machine.