Apple · Training
Applebot-Extended
This robots.txt token controls content use. It has no separate HTTP user agent or crawler visits.
Key facts
Applebot-ExtendedWhat Applebot-Extended is
Applebot-Extended is a robots.txt data-use control that does not crawl webpages and has no separate HTTP User-Agent or IP feed. It controls foundation-model training use of Applebot-crawled data while leaving search inclusion available.
In Aiola's taxonomy, Training means scraped for model training or dataset development.
Applebot-Extended robots.txt token
This robots.txt token controls content use. It has no separate HTTP user agent or crawler visits.
Applebot-ExtendedOfficial IP ranges
This robots.txt token controls content use. It has no separate HTTP user agent or crawler visits.
Request verification for Applebot-Extended
This robots.txt token controls content use. It has no separate HTTP user agent or crawler visits.
Control Applebot-Extended with robots.txt
Apple documents this token for robots.txt rules. This robots.txt token controls content use.
User-agent: Applebot-Extended
Allow: /User-agent: Applebot-Extended
Disallow: /Aiola Analytics
Track AI crawler visits on your site
This robots.txt token controls content use. It has no separate HTTP user agent or crawler visits.
Common questions
Build, ship and fix in one app
Errors, user feedback, GitHub and analytics live next to your coding agents in one desktop app. Every issue becomes a task an agent can take.