Thunderdome B2B SaaS AI Visibility Index

← All categories

September 2026 snapshot · 72 AI answers Leader emerging

SEO Crawlers & Site Audit: AI Visibility Ranking

Website crawling and technical SEO audit tools: crawl a site, find indexability and content issues, and track fixes. Right now, Screaming Frog is the brand AI assistants recommend most, with a Visibility Score of 74 and the #1 spot in 57% of answers. Head-to-head: Screaming Frog vs Ahrefs →

These rankings are measured from what the three models know from training, not a live web search. When the models DO search the web, see which sources they cite. Methodology.

Screaming Frog wins first pick; Ahrefs gets considered, not chosen.

Screaming Frog is the standout with a 57% first-pick rate despite only 79% mention share, meaning when it shows up it almost always leads the recommendation. Ahrefs is nearly as present at 76% mention share but converts that presence into a first pick just 6% of the time, which signals that the models treat it as context rather than conclusion. That gap between being remembered and being trusted enough to lead is the defining tension in this category.

AI-generated analysis of the September 2026 measurements.

# Brand Visibility Score Trend (3 mo) Mention rate Avg. position #1 pick rate Models
1 Screaming Frog
74
±4.3
Jul 2026: 71.7 · Aug 2026: 68.9 · Sep 2026: 73.6 flat 79% 1.7 57% ChatGPT #1 Claude #1 Gemini #1
2 Ahrefs
56
±3.8
Jul 2026: 54.3 · Aug 2026: 56.9 · Sep 2026: 55.8 flat 76% 3.7 6% ChatGPT #3 Claude #3 Gemini #2
3 Sitebulb
50
±5.7
Jul 2026: 42.6 · Aug 2026: 39.2 · Sep 2026: 50.3 ▲ 11 65% 3.3 3% ChatGPT #2 Claude #4 Gemini #3
4 Semrush
48
±3.3
Jul 2026: 45.4 · Aug 2026: 54.6 · Sep 2026: 48.3 ▼ 6 65% 3.6 7% ChatGPT #4 Claude #2 Gemini #5
5 Lumar
32
±4.4
Jul 2026: 29.2 · Aug 2026: 28.6 · Sep 2026: 32.1 flat 47% 4.2 6% ChatGPT #5 Claude #7 Gemini #4
6 Botify
20
±3.8
Jul 2026: 19.7 · Aug 2026: 21.7 · Sep 2026: 20.4 flat 31% 4.3 6% ChatGPT #8 Claude #6 Gemini #6
7 Google Search Console
15
±3.4
Jul 2026: 16.4 · Aug 2026: 14.3 · Sep 2026: 14.6 flat 24% 4.8 0% ChatGPT #10 Claude #5 Gemini #14
8 JetOctopus
14
±4.4
Jul 2026: 8.9 · Aug 2026: 7.8 · Sep 2026: 13.6 flat 24% 5.2 0% ChatGPT #6 Claude #13 Gemini #8
9 Oncrawl
13
±3.7
Jul 2026: 10.4 · Aug 2026: 10.4 · Sep 2026: 12.5 flat 21% 5.0 0% ChatGPT #7 Claude #10 Gemini #13
10 Firecrawl
12
±0.7
Jul 2026: 11.5 · Aug 2026: 10.8 · Sep 2026: 11.9 ▲ 1 13% 1.4 10% ChatGPT #9 Claude #8 Gemini #9
11 SE Ranking
8
±1.7
Jul 2026: 7.5 · Aug 2026: 9.9 · Sep 2026: 7.6 flat 17% 6.4 1% ChatGPT #11 Claude #12 Gemini #10
12 Apify
7
±2.9
Jul 2026: 6.5 · Aug 2026: 6.9 · Sep 2026: 7.4 flat 10% 3.4 0% ChatGPT #12 Claude #11 Gemini #15
13 Crawl4AI
7
±3
Jul 2026: 2.9 · Aug 2026: 3.2 · Sep 2026: 6.7 flat 8% 3.0 1% ChatGPT #14 Claude #9 Gemini #12
14 ContentKing
7
±1.7
Jul 2026: 9 · Aug 2026: 8.1 · Sep 2026: 6.5 flat 17% 7.3 0% ChatGPT #15 Claude #14 Gemini #7
15 Beam Us Up
6
±2
Jul 2026: 6.4 · Aug 2026: 7.6 · Sep 2026: 5.8 flat 8% 4.0 3% ChatGPT #13 Claude #15 Gemini #11

The ± under each score is the reliability band: how much the number would move if we re-ran the identical measurement. It is tight because each prompt is sampled multiple times. It is not the same as how much the ranking depends on which prompts we ask — a separate, wider figure shown on hover.

Just below the cutoff: Xenu Link Sleuth (4.6), Seobility (4), Netpeak Spider (3.9), Spider (3.6), Ubersuggest (3.5). 54 brands were scored in this category; the leaderboard shows the top 15.

Visibility Score: position-weighted presence across all measured answers, 0 to 100. A score of 100 means the brand was the first recommendation in every answer. Every point in a trend line is a live monthly measurement; there is no modeled or backfilled history. Full methodology.

Openness 26/100: the share of this category's recommendation weight not held by the leader.

Compare brands in SEO Crawlers & Site Audit head-to-head →  ·  Explore the prompt tree →

Get alerted on big movements

We rerun the index every month. Drop your email and pick what to watch in SEO Crawlers & Site Audit: the whole category or specific brands. Free, unsubscribe anytime.

Or watch specific brands:

Do the models agree?

Per-model Visibility Scores for the top 10. A long gray bar means the three assistants disagree about the brand. Hover a row for exact values.

ChatGPT Claude Gemini
0 25 50 75 100 Visibility Score · 0 = never mentioned, 100 = always the first recommendation Screaming Frog Ahrefs Sitebulb Semrush Lumar Botify Google Search Console JetOctopus Oncrawl Firecrawl

Where they land in the answer

When a brand is mentioned, where does it appear? Box shows the middle 50% of positions, the thick line is the median, whiskers are the extremes. Hover a row for the detail.

1 2 3 4 5 6 7 8 9 10 Position in the answer · 1 = the first product recommended Screaming Frog Ahrefs Sitebulb Semrush Lumar Botify Google Search Console JetOctopus Oncrawl Firecrawl

What each model recommends first

ChatGPT

gpt-5.4

1 Screaming Frog
82
2 Sitebulb
56
3 Ahrefs
53
4 Semrush
44
5 Lumar
35

Claude

claude-sonnet-4-6

1 Screaming Frog
85
2 Semrush
64
3 Ahrefs
63
4 Sitebulb
46
5 Google Search Console
28

Gemini

gemini-3-flash-preview

1 Screaming Frog
54
2 Ahrefs
52
3 Sitebulb
49
4 Lumar
43
5 Semrush
37

The questions we asked

Each model answered every prompt 3 times in September 2026. Prompts are brand-neutral so no vendor gets seeded into the question.

  1. Best overall
    What's the best SEO crawler for auditing a website? See who wins it →
  2. Use-case fit
    We need to run technical SEO audits across several client sites and track issues over time. What tool should we use? See who wins it →
  3. Top tools in 2026
    What are the top website crawling and site audit tools in 2026? See who wins it →
  4. Startup & small team
    Which site audit tool should a startup marketing team use? See who wins it →
  5. Enterprise pick
    Which website crawling and site audit platform should a large enterprise standardize on, considering security, compliance, and scale? See who wins it →
  6. Feature-led ask
    I want an API-first crawler I can wire into scripts and agents, with JS rendering and structured extraction. What do you recommend? See who wins it →
  7. If you could pick one
    If you could only pick one technical SEO audit tool, which one and why? See who wins it →
  8. Budget & alternatives
    What's a good affordable alternative to the big desktop SEO crawlers? See who wins it →