Anthropic · Training

anthropic-ai

Identify anthropic-ai by its user agent. Check request identity, review robots.txt controls and track visits in Aiola Analytics.

Key facts

User-agent token: anthropic-ai
Training: Scraped for model training or dataset development.
No IP verification is published for anthropic-ai; treat the token as a claim.

What anthropic-ai is

Anthropic's current crawler documentation lists ClaudeBot, Claude-User, and Claude-SearchBot. It does not list anthropic-ai.

In Aiola's taxonomy, Training means scraped for model training or dataset development.

anthropic-ai user agent

Look for the match token inside the complete HTTP User-Agent header. Tokens can be spoofed, so use the network checks below for authentication.

Example User-Agent (unverified)
anthropic-ai/1.0; +https://www.anthropic.com
Case-insensitive match token
anthropic-ai

Official IP ranges

Anthropic has not published official IP ranges that Aiola successfully fetched for anthropic-ai. Aiola does not list cloud-provider ranges or community guesses as if they authenticated this crawler.

Verify a anthropic-ai request

No IP authentication method is documented in this record for anthropic-ai. Its user-agent token is a claim, not proof of identity.

Use the exact header token for classification and apply your own access controls. Check the vendor documentation for any newly published IP, token or header verification method.

Control anthropic-ai with robots.txt

Anthropic documents crawler controls for this bot family. Robots.txt can direct cooperative crawling, but it cannot prove that a request is authentic.

Allow anthropic-ai
User-agent: anthropic-ai
Allow: /
Block anthropic-ai
User-agent: anthropic-ai
Disallow: /

Read official crawler documentation

Aiola Analytics

See every anthropic-ai visit on your site

Aiola tracks 70 AI, search and link-preview crawlers next to your human traffic. See when anthropic-ai arrives, which pages it requests and how that changes over time. Hosted Analytics needs Pro or a trial.

Aiola Analytics showing AI crawler visits by bot and page

Common questions

Build, ship and fix in one app

Errors, user feedback, GitHub and analytics live next to your coding agents in one desktop app. Every issue becomes a task an agent can take.