What is Amazonbot?
Amazon says Amazonbot is used to improve its products and services and to give customers more accurate information, and that its data may be used to train Amazon AI models.
Amazon runs separate agents for other jobs: Amzn-SearchBot for search experiences such as Alexa, and Amzn-User for user-initiated fetches. Neither crawls for generative AI training.
- Robots.txt token:
Amazonbot - Purpose: Model training
- Feeds: Amazon products and services, including Amazon AI models
Who runs Amazonbot?
Amazonbot is run by Amazon. Everything on this page comes from Amazon's own documentation: Amazon: About Amazonbot. We last checked it on 21 October 2026.
How to allow Amazonbot in robots.txt
Amazonbot is allowed unless a rule blocks it. If your * group blocks it, give it its own group:
User-agent: Amazonbot
Allow: /
Disallow: /admin/A named group replaces your User-agent: * group for Amazonbot, so copy in any private folders you still want blocked, like /admin/ above.
How to block Amazonbot in robots.txt
User-agent: Amazonbot
Disallow: /Stops Amazonbot crawling the blocked pages, including for Amazon AI model training. Amzn-SearchBot has its own token.
To block one folder only, list just that path:
User-agent: Amazonbot
Disallow: /orders/Things to know about Amazonbot
- Amazonbot doesn't support Crawl-delay; use Allow and Disallow rules to control it.
- Amazon may use a cached copy of robots.txt up to 30 days old, and it treats a robots.txt it can't fetch as if none exists.
- Amazonbot respects rel=nofollow links and the noarchive, noindex and none robots meta tags.
- robots.txt only grants permission. A CDN or firewall can still block Amazonbot even when your rules allow it.
Check every AI crawler at once
The checker above tests Amazonbot and every other AI crawler on this list against your live robots.txt. The full AI Crawler Checker explains how to read the results. For help beyond robots.txt, see technical SEO, AI search optimisation and GEO services.
AI search & answers
- OAI-SearchBot (OpenAI): ChatGPT search answers
- Claude-SearchBot (Anthropic): Claude's search results
- PerplexityBot (Perplexity): Perplexity's search results and citations
- Googlebot (Google): Google Search, including AI Overviews and AI Mode
- Applebot (Apple): Siri, Spotlight and Safari search and answers
- Bingbot (Microsoft): Bing search and Microsoft Copilot answers
User-requested fetch
- ChatGPT-User (OpenAI): pages ChatGPT opens when a user asks
- Claude-User (Anthropic): pages Claude opens when a user asks
- Perplexity-User (Perplexity): pages Perplexity opens when a user asks
Model training
- GPTBot (OpenAI): training data for OpenAI's foundation models
- ClaudeBot (Anthropic): training data for Anthropic's models
- Meta-ExternalAgent (Meta): training data for Meta's foundation AI models
- CCBot (Common Crawl): Common Crawl's open web archive, widely used as AI training data
Robots.txt control token
- Google-Extended (Google): Gemini model training and grounding
- Applebot-Extended (Apple): Apple foundation model training
FAQ
Amazonbot questions
No. Amazon says Crawl-delay isn't supported. Use Allow and Disallow rules instead.
Amazon says changes usually take about 24 hours, though it may use a cached copy of robots.txt for up to 30 days.
Not necessarily. Amazon uses a separate agent, Amzn-SearchBot, for search experiences such as Alexa, with its own robots.txt token.
Yes. Amazon says it respects the noarchive, noindex and none robots meta tags and rel=nofollow links.
Done for you
Want us to fix it for you?
Send us the task. Senior marketers fix what the AI Crawler Checker found and make the rest of your site easy for Google and AI answers to understand.
