AI Bot Access Checker
See whether ChatGPT, Claude, Perplexity, Gemini, and 31 other AI crawlers can actually reach your website — per-agent response codes, robots.txt rules, and meta robots checks, all in one scan.
Fetching with 35 bot user-agents… (usually 15–40 seconds, longer for slower sites)
Examples:
go-seo.com
·
poyeyphotos.com
Analysis Results
| AI Bot | Status | HTTP Response | robots.txt | Meta/Headers | ms |
|---|
What is checked
- HTTP response code: fetched server-side with each bot's actual user-agent
- robots.txt rules: for each crawler's user-agent token
<meta name="robots">tag: from the response body per botX-Robots-TagHTTP header: when present, usually from a CDN- Response time: identifying any issues with delays or intentional throttling
Understanding status
- Allowed: HTTP 2xx/3xx — the server served the page to this bot
- Blocked: HTTP 4xx — access denied, likely a security rule for this bot
- Warning: HTTP 429 — rate-limited; the bot is probably allowed but throttled
What isn't checked
- Parsing and rendering: only the raw HTTP response is checked (no JavaScript execution)
- Anonymous agents: some AI tools don't identify themselves with a distinct user-agent
- Other security rules that block on different input combinations
Robots Meta column
- Shows
<meta name="robots">content parsed from each bot's actual HTTP response body - Common values from Yoast/Rank Math:
index, follow, max-image-preview:large - Blocked bots may see a firewall error page with
noindex, nofollow - If an
X-Robots-TagHTTP header is also present, it appears below in blue
Please note: this scan only tells you whether AI bots can technically reach your site. It doesn't tell you whether they understand your business once they arrive, or whether you're actually being cited in AI answers. That's a different (and honestly more important) question.
Want to know if AI is actually recommending you?
Reachability is step one. The real question is whether ChatGPT, Perplexity, and Google AI Overviews are citing your business when buyers ask for it — and if not, why. We track Share of Voice across AI platforms and can show you exactly where the gaps are.
Get a free GEO audit