Crawler Bench

Screaming Frog SEO Spider

Crawler/Analyzer · GUI/CLI

The Screaming Frog SEO Spider is a website crawler that audits your site for over 300 SEO issues to help improve both SEO, and UX.

In their wordswww.screamingfrog.co.uk/seo-spider
Version Tested
24.3.0 (released Jun 29, 2026)
Vendor
Screaming Frog
Platforms
Windows, macOS, and Linux
Interfaces
GUI/CLI (both included)
JavaScript Rendering
Yes
Type
Crawler/Analyzer
Test Machine
Mac mini (M1/Tahoe), 8 GB of RAM, macOS 26.6.2

Across the Test Sites

Tested in two setups on four sites. Its best finish: Screaming Frog on the Rust Book (remote server), 00:04.2, 6th of 25.

Screaming FrogGUI · Default threads00:04.37th of 2500:04.26th of 25Stopped at 500 URLs–
Screaming Frog CLICLI · Default threads00:05.39th of 2500:04.99th of 25Stopped at 500 URLsStopped at 500 URLs

Site Crawls

Two Screaming Frog SEO Spider setups on the Rust Book: 114 pages (176 files) served from a web server on the same Mac, replayed on one clock.

Filter Runs

Site
Server
Filters
Interface
Rendering
Price

Crawl Results

00:04.311548115 / 48969 MB115 pages · 48 assets · 969 MB peak
00:05.311548115 / 48675 MB115 pages · 48 assets · 675 MB peak

Resource Usage

Watch in Realtime

Every crawl starts together at 0:07. Click a screen to enlarge it.

0:00.0 / 0:16.5

Setups

Screaming Frog24.3.0GUIDefault threadsDefault settings
Screaming Frog CLI24.3.0CLIDefault threadsDefault settings

How This Was Measured

Test Machine
  • Mac mini (M1/Tahoe)8 GB of RAM · macOS 26.6.2

Each crawler ran by itself. Crawl time, counts, memory, and CPU are captured consistently, per OS. See more on how it’s measured.

Sites
  • The Rust Book homepageRust Bookrust-book-local.crawlerbench.com114 HTML pages176 files
  • The GIMP 3.0 Manual homepageGIMP 3.0 Manualgimp-local.crawlerbench.com711 HTML pages2,616 files

Served from a local web server on the test machine.