Website crawling and technical SEO audit tools: crawl a site, find indexability and content issues, and track fixes. Right now, Screaming Frog is the brand AI assistants recommend most, with a Visibility Score of 74 and the #1 spot in 57% of answers. Head-to-head: Screaming Frog vs Ahrefs →
These rankings are measured from what the three models know from training, not a live web search. When the models DO search the web, see which sources they cite. Methodology.
Screaming Frog wins first pick; Ahrefs gets considered, not chosen.
Screaming Frog is the standout with a 57% first-pick rate despite only 79% mention share, meaning when it shows up it almost always leads the recommendation. Ahrefs is nearly as present at 76% mention share but converts that presence into a first pick just 6% of the time, which signals that the models treat it as context rather than conclusion. That gap between being remembered and being trusted enough to lead is the defining tension in this category.
AI-generated analysis of the September 2026 measurements.
| # | Brand | Visibility Score | Trend (3 mo) | Mention rate | Avg. position | #1 pick rate | Models |
|---|---|---|---|---|---|---|---|
| 1 | | ±4.3 | flat | 79% | 1.7 | 57% | ChatGPT #1 Claude #1 Gemini #1 |
| 2 | | ±3.8 | flat | 76% | 3.7 | 6% | ChatGPT #3 Claude #3 Gemini #2 |
| 3 | | ±5.7 | ▲ 11 | 65% | 3.3 | 3% | ChatGPT #2 Claude #4 Gemini #3 |
| 4 | | ±3.3 | ▼ 6 | 65% | 3.6 | 7% | ChatGPT #4 Claude #2 Gemini #5 |
| 5 | | ±4.4 | flat | 47% | 4.2 | 6% | ChatGPT #5 Claude #7 Gemini #4 |
| 6 | | ±3.8 | flat | 31% | 4.3 | 6% | ChatGPT #8 Claude #6 Gemini #6 |
| 7 | | ±3.4 | flat | 24% | 4.8 | 0% | ChatGPT #10 Claude #5 Gemini #14 |
| 8 | | ±4.4 | flat | 24% | 5.2 | 0% | ChatGPT #6 Claude #13 Gemini #8 |
| 9 | | ±3.7 | flat | 21% | 5.0 | 0% | ChatGPT #7 Claude #10 Gemini #13 |
| 10 | | ±0.7 | ▲ 1 | 13% | 1.4 | 10% | ChatGPT #9 Claude #8 Gemini #9 |
| 11 | | ±1.7 | flat | 17% | 6.4 | 1% | ChatGPT #11 Claude #12 Gemini #10 |
| 12 | | ±2.9 | flat | 10% | 3.4 | 0% | ChatGPT #12 Claude #11 Gemini #15 |
| 13 | Crawl4AI | ±3 | flat | 8% | 3.0 | 1% | ChatGPT #14 Claude #9 Gemini #12 |
| 14 | | ±1.7 | flat | 17% | 7.3 | 0% | ChatGPT #15 Claude #14 Gemini #7 |
| 15 | | ±2 | flat | 8% | 4.0 | 3% | ChatGPT #13 Claude #15 Gemini #11 |
The ± under each score is the reliability band: how much the number would move if we re-ran the identical measurement. It is tight because each prompt is sampled multiple times. It is not the same as how much the ranking depends on which prompts we ask — a separate, wider figure shown on hover.
Just below the cutoff: Xenu Link Sleuth (4.6), Seobility (4), Netpeak Spider (3.9), Spider (3.6), Ubersuggest (3.5). 54 brands were scored in this category; the leaderboard shows the top 15.
Visibility Score: position-weighted presence across all measured answers, 0 to 100. A score of 100 means the brand was the first recommendation in every answer. Every point in a trend line is a live monthly measurement; there is no modeled or backfilled history. Full methodology.
Openness 26/100: the share of this category's recommendation weight not held by the leader.
Compare brands in SEO Crawlers & Site Audit head-to-head → · Explore the prompt tree →
We rerun the index every month. Drop your email and pick what to watch in SEO Crawlers & Site Audit: the whole category or specific brands. Free, unsubscribe anytime.
Per-model Visibility Scores for the top 10. A long gray bar means the three assistants disagree about the brand. Hover a row for exact values.
When a brand is mentioned, where does it appear? Box shows the middle 50% of positions, the thick line is the median, whiskers are the extremes. Hover a row for the detail.
gpt-5.4
claude-sonnet-4-6
gemini-3-flash-preview
Each model answered every prompt 3 times in September 2026. Prompts are brand-neutral so no vendor gets seeded into the question.