Crawler Bench

Xenu's Link Sleuth

Crawler/Analyzer · GUI

Version Tested
1.3.8
Vendor
Tilman Hausherr
Platforms
Windows
Interfaces
GUI (graphical user interface)
JavaScript Rendering
No
Type
Crawler/Analyzer
Test Machine
Windows 10 (Hyper-V), 15.8 GB of RAM, Windows 10, running as a virtual machine

Across the Test Sites

Tested in one setup on four sites. Its best finish: Xenu's Link Sleuth on the Rust Book (local server), 00:02.0, 5th of 25.

Xenu's Link SleuthGUI · 30 threads00:02.05th of 2500:04.38th of 2500:08.68th of 2500:23.17th of 24

Site Crawls

One Xenu's Link Sleuth setup on the Rust Book: 114 pages (176 files) served from a web server on the same PC, replayed on one clock.

Filter Runs

Site
Server
Filters
Interface
Rendering
Price

Crawl Results

00:02.011561115 / 615.5 MB115 pages · 61 assets · 5.5 MB peak

Resource Usage

Watch in Realtime

Every crawl starts together at 0:07. Click a screen to enlarge it.

0:00.0 / 0:12.5

Setups

Xenu's Link Sleuth1.3.8GUI30 threadsDefault settings

How This Was Measured

Test Machine
  • Windows 10 (Hyper-V)15.8 GB of RAM · Windows 10 · virtual machine

Each crawler ran by itself. Crawl time, counts, memory, and CPU are captured consistently, per OS. See more on how it’s measured.

Sites
  • The Rust Book homepageRust Bookrust-book-local.crawlerbench.com114 HTML pages176 files
  • The GIMP 3.0 Manual homepageGIMP 3.0 Manualgimp-local.crawlerbench.com711 HTML pages2,616 files

Served from a local web server on the test machine.