Crawler Bench

InterroBot

Crawler/Analyzer · GUI/CLI

InterroBot provides the website crawler, search, and analysis you need to understand your website.

In their wordsinterro.bot
Version Tested
2.14.1 (released Sep 23, 2026)
Vendor
Pragmar
Platforms
Windows, macOS, and Linux
Interfaces
GUI/CLI (both included)
JavaScript Rendering
Yes
Type
Crawler/Analyzer
Test Machine
Mac mini (M1/Tahoe), 8 GB of RAM, macOS 26.6.2

Across the Test Sites

Tested in eight setups on four sites. Its best finish: InterroBot (Turbo) on the Rust Book (remote server), 00:01.6, 1st of 25.

InterroBotGUI · Default threads00:02.56th of 2500:03.15th of 2500:03.84th of 2500:08.76th of 24
InterroBot (JS)GUI · Default threads00:39.721st of 2500:44.623rd of 2503:39.116th of 2504:04.817th of 24
InterroBot (Turbo JS)GUI · Turbo threads00:22.218th of 2500:33.518th of 2501:52.211th of 2503:23.413th of 24
InterroBot (Turbo)GUI · Turbo threads00:01.73rd of 2500:01.61st of 2500:03.22nd of 2500:05.82nd of 24
InterroBot CLICLI · Default threads00:01.74th of 2500:02.54th of 2500:04.55th of 2500:08.13rd of 24
InterroBot CLI (JS)CLI · Default threads00:38.719th of 2500:43.121st of 2503:39.517th of 2504:04.216th of 24
InterroBot CLI (Turbo JS)CLI · Turbo threads00:20.617th of 2500:30.917th of 2501:55.612th of 2503:12.312th of 24
InterroBot CLI (Turbo)CLI · Turbo threads00:01.32nd of 2500:01.62nd of 2500:03.73rd of 2500:05.71st of 24

Site Crawls

Eight InterroBot setups on the Rust Book: 114 pages (176 files) served from a web server on the same Mac, replayed on one clock.

Filter Runs

Site
Server
Filters
Interface
Rendering
Price

Crawl Results

00:02.511449114 / 49486 MB114 pages · 49 assets · 486 MB peak
00:39.711449114 / 491068 MB114 pages · 49 assets · 1068 MB peak
00:22.211449114 / 491024 MB114 pages · 49 assets · 1024 MB peak
00:01.711449114 / 49430 MB114 pages · 49 assets · 430 MB peak
00:01.711449114 / 49172 MB114 pages · 49 assets · 172 MB peak
00:38.711449114 / 49879 MB114 pages · 49 assets · 879 MB peak
00:20.611449114 / 49829 MB114 pages · 49 assets · 829 MB peak
00:01.311449114 / 49196 MB114 pages · 49 assets · 196 MB peak

Resource Usage

Watch in Realtime

Every crawl starts together at 0:07. Click a screen to enlarge it.

0:00.0 / 1:02.1

Setups

InterroBot2.14.1GUIDefault threadsDefault settings
InterroBot (JS)2.14.1GUIDefault threadsJavaScript rendering on
InterroBot (Turbo JS)2.14.1GUITurbo threadsTurbo threads; JavaScript rendering on
InterroBot (Turbo)2.14.1GUITurbo threadsTurbo threads
InterroBot CLI2.14.1CLIDefault threadsDefault settings
InterroBot CLI (JS)2.14.1CLIDefault threadsJavaScript rendering on
InterroBot CLI (Turbo JS)2.14.1CLITurbo threadsTurbo threads; JavaScript rendering on
InterroBot CLI (Turbo)2.14.1CLITurbo threadsTurbo threads

How This Was Measured

Test Machine
  • Mac mini (M1/Tahoe)8 GB of RAM · macOS 26.6.2

Each crawler ran by itself. Crawl time, counts, memory, and CPU are captured consistently, per OS. See more on how it’s measured.

Sites
  • The Rust Book homepageRust Bookrust-book-local.crawlerbench.com114 HTML pages176 files
  • The GIMP 3.0 Manual homepageGIMP 3.0 Manualgimp-local.crawlerbench.com711 HTML pages2,616 files

Served from a local web server on the test machine.