advertools - online marketing productivity and analysis tools

Open-Source Python Based SEO Web Crawler

The AI-native technical SEO crawler. Open-source MCP server for Claude / Cursor / Codex — 37 tools, 50+ checks, unlimited pages, WAF detection, ephemeral by design. Built on LibreCrawl. MIT.

R integration with Screaming Frog CLI

Free SEO crawler & website audit tool — a self-hosted, open-source SEO spider that crawls any website for technical SEO issues. Concurrent, CMS-aware (Shopify/WordPress/Webflow), XLSX export. A free alternative to Screaming Frog.

DJAI Academy community-built, free open-source technical SEO crawler and Screaming Frog alternative with JavaScript audits, reports, a local dashboard, and an MCP server for AI agents. Theoretical 100M+ URL architecture.

Local-first desktop SEO crawler. Audit your site on your own machine — no cloud, no accounts, no data leaves your computer.

Fastest site-base crawler with AJAX content rendered

Search Engine scraper with PHP

Python async SEO crawler — Core Web Vitals, OpenGraph, JSON-LD, security headers, DNS, Gemini AI fixes. 30+ checks per page.

media extraction crawler utility