Crawler Bench

Screaming Frog SEO Spider

Crawler/Analyzer · GUI/CLI

The Screaming Frog SEO Spider is a website crawler that audits your site for over 300 SEO issues to help improve both SEO, and UX.

In their wordswww.screamingfrog.co.uk/seo-spider
Version Tested
24.3.0 (released Jun 29, 2026)
Vendor
Screaming Frog
Platforms
Windows, macOS, and Linux
Interfaces
GUI/CLI (both included)
JavaScript Rendering
Yes
Type
Crawler/Analyzer
Test Machine
Mac mini (M1/Tahoe), 8 GB of RAM, macOS 26.6.2

Across the Test Sites

Tested in two setups on four sites. Its best finish: Screaming Frog on the Rust Book (remote server), 00:05.0, 8th of 22.

SetupRust Book (local)Rust Book (remote)GIMP 3.0 Manual (local)GIMP 3.0 Manual (remote)
Screaming FrogGUI · Default threads00:05.18th of 2200:05.08th of 22Stopped at 500 URLsStopped at 500 URLs
Screaming Frog CLICLI · Default threads00:05.49th of 2200:05.39th of 22Stopped at 500 URLsStopped at 500 URLs

Site Crawls

Two Screaming Frog SEO Spider setups on the Rust Book: 114 pages (176 files) served from a web server on the same Mac, replayed on one clock.

Filter Runs

Site
Server
Filters
Interface
Rendering
Price

Crawl Results

Screaming FrogFreeGUI · Default threads
00:05.111548115 / 481299 MB115 pages · 48 assets · 1299 MB peak
Screaming Frog CLIFreeCLI · Default threads
00:05.411548115 / 48555 MB115 pages · 48 assets · 555 MB peak

Resource Usage

Watch in Realtime

Every crawl starts together at 0:07. Click a screen to enlarge it.

0:00.0 / 0:16.5
Screaming FrogReady
Screaming Frog CLIReady

Setups

CrawlerVersionInterfaceThreadsSettings
Screaming Frog24.3.0GUIDefault threadsDefault settings
Screaming Frog CLI24.3.0CLIDefault threadsDefault settings

How This Was Measured

Test Machine
  • Mac mini (M1/Tahoe)8 GB of RAM · macOS 26.6.2

Each crawler ran by itself. Crawl time, counts, memory, and CPU are captured consistently, per OS. See more on how it’s measured.

Sites
  • The Rust Book homepageRust Bookrust-book-local.crawlerbench.com114 HTML pages176 files
  • The GIMP 3.0 Manual homepageGIMP 3.0 Manualgimp-local.crawlerbench.com711 HTML pages2,616 files

Served from a local web server on the test machine.