On February 3, 2020, Screaming Frog quietly released a of its SEO Spider. While the preceding months had introduced major feature overhauls—including PageSpeed Insights integration, custom extraction tools, and redirect chain reports in version 12.0—version 12.6 introduced a deceptively small but profoundly powerful addition: direct integration with the Ahrefs API .
Also in version 24.0, Screaming Frog launched its . This allows you to connect the SEO Spider with AI assistants like Claude and LM Studio. Using natural language, you can now ask the AI to run a crawl, analyze the data, create visualizations, or troubleshoot technical issues for you. It transforms Screaming Frog from a tool you operate into a teammate you direct. Screaming Frog SEO Spider 12.6
URL structures can be messy, but breadcrumb navigation usually reflects the intended logic. You can use Screaming Frog's feature to pull breadcrumb data from every page. After the crawl, you can export this data as a CSV and use a Python script to reconstruct the entire site as a visual tree model. This is far more accurate for enterprise SEOs than guessing hierarchy based on folders. On February 3, 2020, Screaming Frog quietly released
The SEO Spider offers two primary crawl modes: This allows you to connect the SEO Spider
Tracks heading structures to ensure proper content hierarchy.
