xAI · Indexing
xAI-SearchBot
Identify xAI-SearchBot by its user agent. Check request identity, review robots.txt controls and track visits in Aiola Analytics.
Key facts
xAI-SearchBotWhat xAI-SearchBot is
xAI-SearchBot discovers pages for xAI search retrieval used by Grok. Aiola classifies it as indexing because it supports a searchable retrieval index.
In Aiola's taxonomy, Indexing means crawled for ai or search indexing.
xAI-SearchBot user agent
Look for the match token inside the complete HTTP User-Agent header. Tokens can be spoofed, so use the network checks below for authentication.
xAI-SearchBotxAI-SearchBotOfficial IP ranges
xAI has not published official IP ranges that Aiola successfully fetched for xAI-SearchBot. Aiola does not list cloud-provider ranges or community guesses as if they authenticated this crawler.
Verify a xAI-SearchBot request
No IP authentication method is documented in this record for xAI-SearchBot. Its user-agent token is a claim, not proof of identity.
Use the exact header token for classification and apply your own access controls. Check the vendor documentation for any newly published IP, token or header verification method.
Control xAI-SearchBot with robots.txt
xAI does not provide crawler documentation that Aiola could confidently verify for this token. The rules below express your preference, but vendor compliance is unconfirmed.
User-agent: xAI-SearchBot
Allow: /User-agent: xAI-SearchBot
Disallow: /No official crawler documentation URL is listed because Aiola could not verify one confidently.
Aiola Analytics
See every xAI-SearchBot visit on your site
Aiola tracks 70 AI, search and link-preview crawlers next to your human traffic. See when xAI-SearchBot arrives, which pages it requests and how that changes over time. Hosted Analytics needs Pro or a trial.
Common questions
Build, ship and fix in one app
Errors, user feedback, GitHub and analytics live next to your coding agents in one desktop app. Every issue becomes a task an agent can take.