Query Screaming Frog crawl data directly from Python. LoadDocumentation Index
Fetch the complete documentation index at: https://mintlify.com/Amaculus/screaming-frog-api/llms.txt
Use this file to discover all available pages before exploring further.
.dbseospider, .seospider, CSV exports, DuckDB, or SQLite files and access all 628+ mapped GUI tabs without opening the Screaming Frog UI.
Installation
Install via pip and set up your Java runtime for Derby support
Quickstart
Load a crawl and run your first query in minutes
Loading Crawls
Load from .dbseospider, CSV exports, DuckDB, or live DB crawl IDs
API Reference
Full method signatures for the Crawl class and all view types
What you can do
Query pages and links
Filter by status code, URL prefix, rel attribute, and more
Access any GUI tab
Access all 628+ Screaming Frog tabs without exporting CSVs
DuckDB analytics
Fast analytics cache for large crawls with namespace support
Crawl diff
Compare two crawls to detect status, title, and redirect changes
Audit helpers
Broken links, orphan pages, indexability, title/meta audits
Chain analysis
Detect long redirect and canonical chains across your site
Supported crawl sources
| Source | Format | Backend |
|---|---|---|
| CSV export folder | ./exports/ | CSV |
| DB-mode crawl archive | ./crawl.dbseospider | Derby / DuckDB |
| Screaming Frog project | ./crawl.seospider | Derby / DuckDB / CSV |
| DuckDB analytics cache | ./crawl.duckdb | DuckDB |
| SQLite database | ./crawl.db | SQLite |
| Live DB crawl ID | UUID string | Derby / DuckDB |
Derby support requires a Java runtime (
java on your PATH or JAVA_HOME set). See Installation for setup details.