What does agentics check?

Three dimensions in one report: (1) AI-agent readiness — robots.txt rules for GPTBot/ClaudeBot/PerplexityBot/GoogleExtended, llms.txt, JSON-LD coverage, OpenGraph, SSR vs JS-rendered content, .well-known/{mcp,ai-plugin,security.txt}, OpenAPI discovery, sitemap-depth analysis per template. (2) Email deliverability — SPF, DKIM, DMARC, MX, STARTTLS, DNSBL (Spamhaus ZEN), MTA-STS, TLS-RPT, BIMI, DNSSEC. (3) LLM grounding — does Claude, ChatGPT, and Gemini know your brand.

The basic technical audit (DNS, mail config, agent-readiness, SEO bones) is free. Pro signals — LLM grounding probes, MCP live-testing, force-refresh, permanent share URLs — are €2 for a single check or €9 for a 100-credit pack with no expiration.

How is this different from Cloudflare’s Agent Readiness Score?

Cloudflare’s tool (isitagentready.com) only scores agent-readiness signals. agentics additionally checks email deliverability, runs actual LLM grounding probes against Claude/ChatGPT/Gemini, and roundtrip-tests your MCP server using real OpenAI and Anthropic clients.

Do you store the domains I check?

Reports are cached server-side for 7 days to keep repeat checks cheap. Free reports expire after 24 hours of inactivity. Paid reports get a permanent shareable URL. We do not log domains for marketing.

Anthropic

ClaudeBot— crawlers from Anthropic

Crawler used to train Claude models.

ClaudeBot is Anthropic's primary crawler for gathering training data for the Claude model family. It honors robots.txt and supports the new Content-Signals directives Anthropic and Cloudflare pushed in 2025. Allow it to influence what Claude knows about your domain. Anthropic also operates Claude-Web / Claude-User for on-demand fetches at chat time.

Vendor

Anthropic

robots.txt snippets

Allow

User-agent: ClaudeBot
Allow: /

Disallow

User-agent: ClaudeBot
Disallow: /

FAQ

What is ClaudeBot?

What is the user-agent string for ClaudeBot?

ClaudeBot identifies itself with the user-agent token "ClaudeBot". You can match it in robots.txt with "User-Agent: ClaudeBot" and route nginx / log-analyzer rules against that token.

How do I allow ClaudeBot in robots.txt?

Add the following block to your /robots.txt — this explicitly grants ClaudeBot access: User-agent: ClaudeBot Allow: /

How do I block ClaudeBot in robots.txt?

Add the following block to your /robots.txt — note that well-behaved bots honor this, but not every crawler does: User-agent: ClaudeBot Disallow: /

How can I check whether my site is ready for ClaudeBot?

Run a free check at https://agentics.page — it audits whether your robots.txt allows the right bots, whether you publish llms.txt and JSON-LD structured data, whether your content is server-rendered, and whether ClaudeBot can actually consume your site.

Is your domain ready for ClaudeBot?

agentics checks whether your robots.txt allows the right bots, your llms.txt is in shape, your JSON-LD and SSR content are visible, and whether ClaudeBot can actually use your domain.

Run free check →

Related agents

GPTBotOpenAI

Crawls the web for training ChatGPT models.

OAI-SearchBotOpenAI

Indexes pages for ChatGPT Search results.

anthropic-aiAnthropic

Legacy user-agent still used in places.

Google-ExtendedGoogle

Opt-out token for Bard/Gemini training data. Does not affect Search ranking.