Skip to content

Self-hosted alternatives to Screaming Frog SEO Spider

Screaming Frog SEO Spider is a desktop website crawler for Windows, macOS and Linux that audits a site for technical SEO issues. One listed app does its main job and runs in your own Cloudflare account.

Each answer comes from the app’s README and source code, compared with the features Screaming Frog SEO Spider describes on its own site.

  • OpenSEO Keyword Research with keyword volumes, CPC and intent, a search trend chart and SERP analysis

    Pay-as-you-go keyword research, rank tracking and site audits on your Cloudflare account, with an MCP server for agents

    Deploy
    CLI
    License
    MIT
    GitHub stars
    22.6k stars
    Last commit

Screaming Frog SEO Spider features, app by app

FeatureOpenSEO
Broken links, errors, redirectsYes
Titles, meta descriptions, headingsYes
Duplicate content detectionPartly
JavaScript renderingYes
XML sitemaps and robots.txt testingNo
Custom extraction (XPath, CSS, regex)No
GA, Search Console, PageSpeed integrationsPartly
Scheduled crawls, crawl comparisonNo

Pay-as-you-go keyword research, rank tracking and site audits on your Cloudflare account, with an MCP server for agents

What a Screaming Frog SEO Spider user would miss
It has no sitemap and robots.txt tools, custom extraction or scheduled crawls; it covers near-duplicate detection and integrated crawl data only in part; the crawler runs on Cloudflare Workers, and JavaScript-rendered audits need a Workers Paid plan according to the project docs.
What it adds
It runs as a web app in your Cloudflare account, so audits need no desktop software, and it also covers keyword research, rank tracking, backlinks and AI visibility.
  • Yes Broken links, errors, redirects. Broken links, 4xx and 5xx pages, redirect chains.
  • Yes Titles, meta descriptions, headings. Missing, duplicate, long and short titles and meta, H1 checks.
  • Partly Duplicate content detection. Duplicate titles, meta and identical text; no near-duplicates.
  • Yes JavaScript rendering. Optional JavaScript rendering, up to 1,000 pages.
  • No XML sitemaps and robots.txt testing. Reads sitemaps for discovery; no generator or robots tester.
  • No Custom extraction (XPath, CSS, regex). No custom extraction found.
  • Partly GA, Search Console, PageSpeed integrations. Search Console, GA4 and Lighthouse separate from crawl data.
  • No Scheduled crawls, crawl comparison. No scheduled audits or crawl comparison found.

Sources:github.com/every-app/open-seo#readmegithub.com/every-app/open-seo/blob/main/src/shared/audit-issues.ts