Google-Extended
Google-Extended is a robots.txt control token — not a separate crawler — that tells Google whether content its crawlers fetch may be used to train future Gemini models and to ground answers in Gemini Apps and Vertex AI. Google states it does not affect inclusion or ranking in Google Search.
Google-Extended in Practice
A frequent misreading is that Google-Extended is a bot you’ll find in your logs. It isn’t: Googlebot does the fetching, and the token only governs how that already-crawled content is used downstream, so it never appears as a user agent. Another is that blocking it removes a site from AI Overviews or AI Mode. Google’s documentation says it has no effect on Search inclusion, and those features run through Googlebot and snippet controls rather than this token ([PPC Land](https://ppc.land/google-extended/); [Search Engine Journal](https://www.searchenginejournal.com/google-updates-gemini-vertex-ai-user-agent-documentation/545409/)).
How to Verify Your Google-Extended Setting
Because Google-Extended generates no log entries, there is no traffic to measure; the only verification is reading your robots.txt to confirm the token is allowed or disallowed as intended. The effect, if any, shows up indirectly in whether Gemini cites your pages.
Why Google-Extended Matters
One rule covers both training and grounding, so disallowing Google-Extended to keep content out of training also forgoes grounding in Gemini Apps and Vertex AI ([PPC Land](https://ppc.land/google-extended/)). That makes it a real trade-off: it’s the cleanest “no Gemini training, keep my Search traffic” lever, but it also narrows one route to Gemini citations.
Terms Related to Google-Extended
Grounding (AI) ·
GPTBot ·
robots.txt for AI Crawlers
LLM Visibility
FAQ
Will blocking Google-Extended hurt my Google rankings?
According to Google, no — it is not a ranking signal and doesn’t affect inclusion in Google Search. Blocking Googlebot itself, by contrast, would remove you from the index.
