Google-Extended: Google's AI training token
A product token, not a crawler: Googlebot reads the rule for it.
- Free, no account.
- A few seconds.
- Nothing is stored.
Google-Extended at a glance
Everything Google documents about it, with links to the source.
- Operator
- Type
- AI training
- Used for
- Gemini and Vertex AI training; no effect on Search or AI Overviews
- Obeys robots.txt
- Google-Extended is a product token, not a crawler, so it never visits your site itself. Google's main crawler reads the rule for it and honours it.
- robots.txt token
Google-Extended- User-agent string
- None. It is a token another crawler reads, so it never appears in your logs.
- IP addresses
- Not applicable.
How to block Google-Extended
Collects text that may be used to train AI models. Blocking it keeps your pages out of future training data. AI answers can still cite you through the search crawlers.
Block the whole site
Add this group to robots.txt at the root of your site.
User-agent: Google-Extended Disallow: /
Block only some paths
List the paths; everything else stays open to Google-Extended.
User-agent: Google-Extended Disallow: /private/ Disallow: /drafts/
Other crawlers from Google
Each has its own token, and blocking one leaves the others untouched.
Frequently asked questions
A product token, not a crawler: Googlebot reads the rule for it. It controls whether content Google crawls may be used to train future Gemini models and for grounding in Gemini apps and Vertex AI. It does not affect Google Search, including AI Overviews and AI Mode.
Google-Extended is a product token, not a crawler, so it never visits your site itself. Google's main crawler reads the rule for it and honours it.
Add a group for its token to robots.txt at the root of your site: "User-agent: Google-Extended" followed by "Disallow: /". To close only part of the site, list those paths instead of "/".
No. Google-Extended is a training crawler: blocking it keeps your pages out of data that may train Google's models. AI answers that cite pages come from search crawlers, which have their own tokens, so blocking Google-Extended alone does not remove you from them.
Checked against Google's documentation on 29 September 2026.
Next: see whether AI recommends you
Letting the right crawlers in is the first step. AskWatch shows what ChatGPT, Perplexity, Gemini and Google AI answer when buyers ask about your category, and who they name.
- Free, no credit card.
- Report in minutes, link sent to your email.