What is Applebot-Extended?
Apple says Applebot-Extended does not crawl webpages. It is only used to decide how data crawled by Applebot may be used.
Disallowing it opts your site out of training Apple's general-purpose foundation models, which power generative AI features across Apple Intelligence, Services and Developer Tools.
- Robots.txt token:
Applebot-Extended - Purpose: Robots.txt control token
- Feeds: Apple foundation model training
Who runs Applebot-Extended?
Applebot-Extended is run by Apple. Everything on this page comes from Apple's own documentation: Apple: About Applebot. We last checked it on 21 October 2026.
Apple uses one other token, each with its own robots.txt group:
- Applebot: AI search & answers (Siri, Spotlight and Safari search and answers)
How to allow Applebot-Extended in robots.txt
Applebot-Extended is allowed unless a rule blocks it, which means Apple may use your content for Apple foundation model training. To state it explicitly:
User-agent: Applebot-Extended
Allow: /
Disallow: /admin/A named group replaces your User-agent: * group for Applebot-Extended, so copy in any private folders you still want blocked, like /admin/ above.
How to block Applebot-Extended in robots.txt
User-agent: Applebot-Extended
Disallow: /Opts your content out of Apple's foundation model training. Siri, Spotlight and Safari search are unaffected.
To block one folder only, list just that path:
User-agent: Applebot-Extended
Disallow: /premium/Things to know about Applebot-Extended
- Apple says pages that disallow Applebot-Extended can still be included in search results.
- Apple says Applebot-Extended rules aren't considered in ranking for Search.
- Don't block Applebot to opt out of training; that also removes you from Siri and Spotlight search.
- robots.txt only grants permission. A CDN or firewall can still block Applebot-Extended even when your rules allow it.
Check every AI crawler at once
The checker above tests Applebot-Extended and every other AI crawler on this list against your live robots.txt. The full AI Crawler Checker explains how to read the results. For help beyond robots.txt, see technical SEO, AI search optimisation and GEO services.
AI search & answers
- OAI-SearchBot (OpenAI): ChatGPT search answers
- Claude-SearchBot (Anthropic): Claude's search results
- PerplexityBot (Perplexity): Perplexity's search results and citations
- Googlebot (Google): Google Search, including AI Overviews and AI Mode
- Applebot (Apple): Siri, Spotlight and Safari search and answers
- Bingbot (Microsoft): Bing search and Microsoft Copilot answers
User-requested fetch
- ChatGPT-User (OpenAI): pages ChatGPT opens when a user asks
- Claude-User (Anthropic): pages Claude opens when a user asks
- Perplexity-User (Perplexity): pages Perplexity opens when a user asks
Model training
- GPTBot (OpenAI): training data for OpenAI's foundation models
- ClaudeBot (Anthropic): training data for Anthropic's models
- Meta-ExternalAgent (Meta): training data for Meta's foundation AI models
- CCBot (Common Crawl): Common Crawl's open web archive, widely used as AI training data
- Amazonbot (Amazon): Amazon products and services, including Amazon AI models
Robots.txt control token
- Google-Extended (Google): Gemini model training and grounding
FAQ
Applebot-Extended questions
No. Apple says it doesn't crawl webpages. Applebot does the crawling, and Applebot-Extended controls how that data may be used.
No. Apple says those pages can still appear in search results, and Applebot-Extended rules aren't used for ranking.
Training of Apple's general-purpose foundation models, which power generative AI features across Apple Intelligence, Services and Developer Tools.
No. Blocking Applebot removes you from Siri and Spotlight search. Disallowing Applebot-Extended alone is enough to opt out of training.
Done for you
Want us to fix it for you?
Send us the task. Senior marketers fix what the AI Crawler Checker found and make the rest of your site easy for Google and AI answers to understand.
