Anthropic · Indexing

Claude-SearchBot

Identify Claude-SearchBot by its user agent. Check request identity, review robots.txt controls and track visits in Aiola Analytics.

Download AiolaAI crawler directory

Key facts

User-agent token: Claude-SearchBot
Indexing: Crawled for AI or search indexing.
Anthropic publishes official IP ranges; verify requests against them.

What Claude-SearchBot is

Claude-SearchBot crawls content to improve Claude search results. Anthropic says its three documented bots honor robots.txt and share a published IP list.

In Aiola's taxonomy, Indexing means crawled for ai or search indexing.

Claude-SearchBot user agent

Look for the match token inside the complete HTTP User-Agent header. Tokens can be spoofed, so use the network checks below for authentication.

Example User-Agent (unverified)
Claude-SearchBot/1.0
Case-insensitive match token
Claude-SearchBot

Official IP ranges

Anthropic publishes an official IP range list. This cached snapshot contains 14 CIDR prefixes, last fetched 2026-10-23. Open the live source

Official IP range snapshot
136.79.143.251/32
136.83.20.215/32
216.73.216.0/22
34.152.124.140/32
34.153.21.190/32
34.162.111.78/32
34.162.153.71/32
34.162.191.81/32
34.162.230.222/32
34.162.244.71/32
34.162.27.34/32
34.162.86.102/32
34.162.90.102/32
34.186.252.4/32

Verify a Claude-SearchBot request

For Claude-SearchBot, compare the source IP from your trusted edge or server against Anthropic’s current published prefixes.

Test one CIDR in Python (replace REQUEST_IP)
python3 -c 'import ipaddress; print(ipaddress.ip_address("REQUEST_IP") in ipaddress.ip_network("136.79.143.251/32"))'

Test every current prefix in the vendor feed and re-fetch it regularly. This cached snapshot is evidence of publication, not a permanent firewall list.

Control Claude-SearchBot with robots.txt

Anthropic documents crawler controls for this bot family. Robots.txt can direct cooperative crawling, but it cannot prove that a request is authentic.

Allow Claude-SearchBot
User-agent: Claude-SearchBot
Allow: /
Block Claude-SearchBot
User-agent: Claude-SearchBot
Disallow: /

Read official crawler documentation

Aiola Analytics

See every Claude-SearchBot visit on your site

Aiola tracks 70 AI, search and link-preview crawlers next to your human traffic. See when Claude-SearchBot arrives, which pages it requests and how that changes over time. Hosted Analytics needs Pro or a trial.

Download AiolaSet up bot tracking
Aiola Analytics showing AI crawler visits by bot and page

Common questions

Build, ship and fix in one app

Errors, user feedback, GitHub and analytics live next to your coding agents in one desktop app. Every issue becomes a task an agent can take.

Download Aiola