Screaming Frog SEO Spider
Crawler/Analyzer · GUI/CLI
The Screaming Frog SEO Spider is a website crawler that audits your site for over 300 SEO issues to help improve both SEO, and UX.
- Version Tested
- 24.3.0 (released Jun 29, 2026)
- Vendor
- Screaming Frog
- Platforms
- Windows, macOS, and Linux
- Interfaces
- GUI/CLI (both included)
- JavaScript Rendering
- Yes
- Type
- Crawler/Analyzer
- Test Machine
- Mac mini (M1/Tahoe), 8 GB of RAM, macOS 26.6.2
Across the Test Sites
Tested in two setups on four sites. Its best finish: Screaming Frog on the Rust Book (remote server), 00:05.0, 8th of 22.
| Setup | Rust Book (local) | Rust Book (remote) | GIMP 3.0 Manual (local) | GIMP 3.0 Manual (remote) |
|---|---|---|---|---|
| Screaming FrogGUI · Default threads | 00:05.18th of 22 | 00:05.08th of 22 | Stopped at 500 URLs | Stopped at 500 URLs |
| Screaming Frog CLICLI · Default threads | 00:05.49th of 22 | 00:05.39th of 22 | Stopped at 500 URLs | Stopped at 500 URLs |
Site Crawls
Two Screaming Frog SEO Spider setups on the Rust Book: 114 pages (176 files) served from a web server on the same Mac, replayed on one clock.
Crawl Results
Screaming Frog
00:05.111548115 / 481299 MB115 pages · 48 assets · 1299 MB peak
Screaming Frog CLI
00:05.411548115 / 48555 MB115 pages · 48 assets · 555 MB peak
Resource Usage
Watch in Realtime
Every crawl starts together at 0:07. Click a screen to enlarge it.
0:00.0 / 0:16.5
Setups
| Crawler | Version | Interface | Threads | Settings |
|---|---|---|---|---|
| Screaming Frog | 24.3.0 | GUI | Default threads | Default settings |
| Screaming Frog CLI | 24.3.0 | CLI | Default threads | Default settings |
How This Was Measured
- Test Machine
Mac mini (M1/Tahoe)8 GB of RAM · macOS 26.6.2
Each crawler ran by itself. Crawl time, counts, memory, and CPU are captured consistently, per OS. See more on how it’s measured.
- Sites
Rust Bookrust-book-local.crawlerbench.com114 HTML pages176 files
GIMP 3.0 Manualgimp-local.crawlerbench.com711 HTML pages2,616 files
Served from a local web server on the test machine.