Definition
Google-Extended is a control that lets a site opt out of having its content used to train and ground some of Google's AI models, set through robots.txt, without affecting normal Google Search crawling.
On this page
At a glance
- Categories Technical
- Related fields SEO, Technical
- Difficulty Intermediate
How Google-Extended Works
It is a separate token you can allow or disallow in robots.txt. Blocking Google-Extended tells Google not to use your content for certain AI training and grounding purposes, while regular Googlebot keeps crawling for Search as usual. It exists so publishers can draw a line between being in Search and feeding AI features.
Why Google-Extended Matters
It is a deliberate tradeoff. Blocking it protects content from some AI use but can also reduce your presence in Google's AI answers. Most brands chasing AI visibility leave it open. The point is to make the choice on purpose, not by accident.
Frequently Asked Questions
-
Does blocking Google-Extended remove me from Google Search?
No. Regular Search crawling is unaffected. It only governs certain AI training and grounding uses.
-
Should I block it?
Only if you have a specific reason to keep content out of Google's AI. For visibility, blocking it usually works against you.