# AI Crawler Policy Generator

> Source: https://go-seo.com/ai-crawler-policy-generator/  
> Last updated: October 25, 2026

The AI Crawler Policy Generator is a free tool from GO-SEO, Inc. that helps you declare how AI crawlers may use your website’s content. Choose one of four policies: disallow all, allow search only, allow search and AI input, or allow search, AI input, and AI training. Then target all crawlers or specific bots, including GPTBot (OpenAI), ClaudeBot (Anthropic), PerplexityBot, Google-Extended, and Meta AI.

The tool generates two outputs based on Cloudflare’s Content Signals specification: a Content-Signal block for your robots.txt file and a matching HTTP response header. As of May 2026, Google has said it will not honor the Content-Signal directive, and support among other AI crawlers varies, so treat the output as a declaration of intent rather than technical enforcement.

The tool is free, requires no signup, and runs in your browser.