Meta · AI answers

meta-externalfetcher

Identify meta-externalfetcher by its user agent. Check request identity, review robots.txt controls and track visits in Aiola Analytics.

Key facts

User-agent token: meta-externalfetcher
AI answers: Fetched to answer a user's question now.
No IP verification is published for meta-externalfetcher; treat the token as a claim.

What meta-externalfetcher is

meta-externalfetcher retrieves individual links at a user's request and supports agentic AI tasks. Meta says it may bypass robots.txt.

In Aiola's taxonomy, AI answers means fetched to answer a user's question now.

meta-externalfetcher user agent

Look for the match token inside the complete HTTP User-Agent header. Tokens can be spoofed, so use the network checks below for authentication.

Full example User-Agent
meta-externalfetcher/1.1 (+/documentation/sharing/webmasters/web-crawlers)
Case-insensitive match token
meta-externalfetcher

Official IP ranges

Meta's network is identified here as AS32934. ASN ownership is a useful signal, not a bot-specific allowlist; combine it with the User-Agent and request behavior.

Verify a meta-externalfetcher request

For meta-externalfetcher, check AS32934 network ownership alongside the user-agent token and request behavior. An ASN cannot authenticate one bot.

Network ownership covers more than this crawler identity. Use your own request controls and review the vendor documentation before allowing traffic.

Control meta-externalfetcher with robots.txt

meta-externalfetcher is user-triggered. Meta's controls may differ from automated crawling, so do not assume a robots.txt block is an authentication boundary.

Allow meta-externalfetcher
User-agent: meta-externalfetcher
Allow: /
Block meta-externalfetcher
User-agent: meta-externalfetcher
Disallow: /

Read official crawler documentation

Aiola Analytics

See every meta-externalfetcher visit on your site

Aiola tracks 70 AI, search and link-preview crawlers next to your human traffic. See when meta-externalfetcher arrives, which pages it requests and how that changes over time. Hosted Analytics needs Pro or a trial.

Aiola Analytics showing AI crawler visits by bot and page

Common questions

Build, ship and fix in one app

Errors, user feedback, GitHub and analytics live next to your coding agents in one desktop app. Every issue becomes a task an agent can take.