TL;DR
Google-Extended, the robots.txt token introduced in September 2023, controls only Gemini app grounding and model training—it has zero effect on AI Overviews or AI Mode, which are governed solely by standard Googlebot and snippet directives. The three surfaces (Gemini app/API, AI Overviews, AI Mode) run on related models but have completely different triggers, retrieval methods, and personalization rules, making a single “Gemini visibility” metric meaningless.
For example, AI Overviews appear automatically per-query inside Search, while AI Mode requires a user to actively select a separate tab and runs multiple sub-searches per answer. The article’s core verdict: measure each surface independently using its specific crawl-control and citation behavior, or your GEO actions will target the wrong pipeline.
Gemini brand visibility is the measured rate at which a brand, product, or entity is named, described, or cited when Google's generative AI systems answer a question about it. That definition only becomes useful once you split "Google's generative AI systems" into the three separate pipelines it actually refers to: the standalone Gemini app and API, AI Overviews embedded inside regular Google Search results, and AI Mode, Google's distinct conversational search tab. They run on related models, but they are different products with different triggers, different crawl-and-grounding rules, and different personalization behavior. Measuring "Gemini visibility" as one number, sampled from one surface, is the most common error in this category — and it's why so much GEO advice for Google recommends actions that don't actually touch the surface being discussed.
This piece defines each surface against Google's own documentation, explains the two crawler-control systems that govern them (which are not interchangeable), covers where the Knowledge Graph fits in, and lays out a repeatable measurement process.
Quick Answer
- If you're trying to prevent your content from appearing in AI Overviews → block Googlebot (via robots.txt or nosnippet), because Google states AI Overviews are governed by standard Googlebot and snippet directives, not by Google-Extended.
- If you're trying to prevent your content from being used for Gemini app or API grounding → block Google-Extended in robots.txt, because Google's documentation says that token controls grounding with Google Search and Gemini model training, with zero effect on Search-side AI features.
- If you're measuring brand visibility in AI Mode → measure citations from the separate AI Mode tab independently, because AI Mode runs query fan-out (multiple sub-searches) and synthesizes responses differently from AI Overviews, with different personalization and citation behavior.
- If you're optimizing your site for AI Overviews or AI Mode → focus on standard SEO fundamentals (crawlability, clear factual content), because Google explicitly states you do not need special markup or AI-specific files to appear in these features.
- If you're trying to control how your site appears in the Gemini app versus AI Overviews → use two different control mechanisms (Google-Extended for Gemini, Googlebot for AI Overviews), because the article confirms that the two crawler tokens govern completely separate surfaces and are not interchangeable.
Three surfaces, one company, different pipelines
Direct answer: AI Overviews are the AI-generated summary boxes that sit above the traditional blue-link results on a standard Google Search query. Google rolled these out broadly in the US at Google I/O in May 2024, describing them as able to "help with increasingly complex questions" by letting a custom Gemini model reason across a query in one pass rather than forcing multiple searches (Google I/O 2024 announcement). Users don't opt in; Google decides per-query whether an overview is worth generating, and it appears automatically within the same results page (Google Search Help: AI Overviews).
AI Mode is a separate tab a user has to actively select, built for multi-step, conversational queries. Rather than one search producing one summary, AI Mode runs several related background searches — commonly described as query fan-out — and synthesizes them into a single response, with the option to keep asking follow-ups in the same thread. Google's own support documentation notes users can move from an AI Overview into a deeper AI Mode conversation by selecting "Show more," confirming these are linked but distinct surfaces rather than one feature with two names.
The Gemini app and Gemini API are a different product entirely — not embedded in Search, but a standalone assistant (and, via the API, a model developers call directly). When it needs current information, it can use a tool called Grounding with Google Search, which lets the model run and cite live search results rather than answering purely from training data. Google's developer documentation is explicit that this connects "the Gemini model to real-time web content" and returns inline citation annotations for the exact spans of text it grounded (Gemini API: Grounding with Google Search). As of the Gemini 3 generation, this is billed per search query the model actually executes, not per prompt — a model can run several grounding searches inside one answer.
| Gemini app / API | AI Overviews | AI Mode | |
|---|---|---|---|
| Where it lives | Standalone app, or called via API | Inline, inside normal Search results | Separate tab in Search |
| Trigger | User opens the app, or a developer calls the API | Automatic, per-query, no opt-in | User actively selects it |
| Retrieval | Optional "Grounding with Google Search" tool, on demand | Built into Search, always available to the feature | Query fan-out — multiple sub-searches synthesized into one answer |
| Personalization | Can draw on Gmail, Photos, YouTube, and Search history via opt-in Connected Apps, plus chat memory | Google states it uses search interactions and feedback to improve the experience; account activity and location still shape results | Explicitly personalizes using signed-in account activity, sometimes with a "Based on your Google activity" label |
| Crawl control that applies | Google-Extended (robots.txt token) | Standard Googlebot / robots.txt, plus snippet controls like nosnippet | Standard Googlebot / robots.txt, plus snippet controls |
| Citations shown to user | Inline citation markers tied to specific text spans, when grounded | Source links/chips beneath the summary | Source links, closer to standard SERP link behavior |
Sources: Gemini API grounding docs, Gemini Apps Privacy Hub, Personal Intelligence announcement, Google Search Central: AI Features and Your Website.
Two crawler controls that people conflate
Direct answer: This is the part that trips up most brand-visibility work: there are two separate control systems, and they don't govern the same surfaces.
Googlebot / standard robots.txt governs whether a page can be crawled and indexed for Search at all — including AI Overviews and AI Mode, since Google is explicit that "AI is built into Search and integral to how Search functions," so the same crawling rules that control regular ranking also control eligibility for these AI features (Google Search Central: AI Features and Your Website). If you want finer control over what a snippet or overview can quote from your page, Google's own guidance points to the nosnippet and data-nosnippet directives, not to any AI-specific file.
Google-Extended is a separate robots.txt product token, introduced in September 2023, that has no crawler of its own — crawling still happens through normal Google user agents, and the token acts purely as a downstream usage signal. Disallowing it opts a site out of three specific uses: future Gemini model training, grounding inside the Gemini app, and grounding with Google Search on Vertex AI (Vertex AI grounding documentation confirms grounding "does not use web pages that have disallowed Google-Extended"). Google states directly that this token "won't impact how your site ranks or appears in Google Search," including AI Overviews and AI Mode (Google: Our approach to website controls for Search AI features).
In practice: blocking Googlebot removes a page from AI Overviews and AI Mode (and regular Search). Blocking Google-Extended does neither of those — it only removes the page from Gemini app/API grounding and Gemini training eligibility. Getting this backwards is a common, costly mistake: a site that disallows Google-Extended thinking it will stop appearing in AI Overviews will keep appearing there, unchanged, because Search-side AI features never read that token.
Separately, Google's own optimization guidance is blunt that neither surface requires new markup: "You don't need to create new machine readable files, AI text files, or markup to appear in these features. There's also no special schema.org structured data that you need to add" (Google's Guide to Optimizing for Generative AI Features on Google Search). Standard SEO fundamentals — crawlability, clear factual content, working infrastructure — are what Google says still matter.
Where the Knowledge Graph fits in
Direct answer: The Knowledge Graph is Google's structured entity database — the thing behind knowledge panels, and one of the signals that helps any Google system, including AI ones, disambiguate "this specific company" from a similarly named one. It isn't a separate AI-visibility lever; it's an entity-legibility layer that other systems draw on.
Google's Organization schema documentation lists no required properties but recommends adding as many relevant ones as possible — name, address, telephone, url, logo, and sameAs links to verified social and reference profiles — placed on the homepage, since that's the page Google associates with the brand as a whole (Google Search Central: Organization structured data). Independent guides consistently point to a second, often-skipped step: a Wikidata entry, since a meaningful share of Knowledge Graph data is sourced from Wikidata rather than Wikipedia, and Wikidata's notability bar is far lower than Wikipedia's. None of this is fast — estimates for actually earning a knowledge panel and Knowledge Graph inclusion range from roughly three months to two years, and it depends on independent, authoritative mentions accumulating over time, not on a markup change alone.
A measurement process
- Split tracking by surface. Keep separate logs for Gemini app/API, AI Overviews, and AI Mode. Never average a "visibility score" across them — they draw on different retrieval mechanisms and different personalization inputs.
- Build a fixed, disclosed prompt panel per category. Include direct brand questions, "best X for Y" comparison questions, and problem-first questions a real buyer would ask. Publish the exact prompt list alongside any score you report — an undisclosed prompt set makes a visibility number unrepeatable.
- Run the panel on a consistent cadence and defined account state, and note whether it was run signed in or signed out. An independent study covered by Search Engine Journal found 76 people running the identical signed-out query at the same time got 62 different result sets, with differences unexplained by location or timing alone (Search Engine Journal: Google Shows Personalized Search Results When Logged Out) — a single sampled run is a snapshot, not ground truth.
- Log full response text, not just presence/absence, and record citations and mentions as separate fields. Being named in the prose of an answer is a different event from being linked as a cited source, and the two behave differently by surface.
- Audit crawl and grounding eligibility separately. Confirm Googlebot access for Search-surface visibility (AI Overviews, AI Mode); confirm the Google-Extended token's state if the goal includes Gemini app/API grounding or training eligibility. Don't assume one setting controls both.
- Check entity legibility: Organization schema on the homepage, a Wikidata item, a claimed Google Business Profile, and consistent name/address/phone details across all of them. This doesn't buy a citation, but it reduces the odds of being misidentified or omitted for ambiguity reasons.
- Audit content for direct-answer structure. Pages that state the specific fact, price, comparison, or claim plainly — rather than building up to it — are what Google's own SEO fundamentals guidance still points to as the baseline for extraction-friendly content.
- Track competitor share within the same panel, not just self-presence. "Not mentioned" is only informative relative to who was mentioned in that slot instead.
- Re-run on schedule and log deltas against actual site changes — schema added, a page published, the Google-Extended token flipped — so a shift in visibility can be tied to a plausible cause rather than guessed at after the fact.
What this doesn't guarantee
Direct answer: There is no official API for "how often does my brand appear in Gemini/AI Overviews" — every measurement above is sampled prompting, and Google has confirmed personalization (search history, connected apps, chat memory, location, sign-in state) can change what different users see for an identical query. A sampled score is directional, not a census.
Being crawlable and Knowledge-Graph-legible does not guarantee a mention. Google states plainly that no special markup is required to appear in AI features, which cuts both ways: adding it doesn't earn placement either. Placement is algorithmic and Google controls it end to end.
Allowing Google-Extended does not get a site into AI Overviews or AI Mode, and disallowing it does not remove a site from them — that token only touches Gemini app/API grounding and training eligibility, a narrower scope than most brand-visibility checklists imply.
Citation is not traffic. Broader research on AI Overview citation patterns has found that even the most frequently cited domains see real audience erosion — one widely cited analysis noted Wikipedia's own pageviews falling even as it remained among the most-referenced sources across AI answers, and a separate Ahrefs-based analysis found only 38% of AI Overview citations now come from pages that also rank in the traditional top 10, down sharply from three-quarters of citations a year earlier, meaning ranking well and being cited well are no longer the same exercise (Search Engine Journal: Google AI Overview Citations From Top-Ranking Pages Drop Sharply).
Entity recognition is slow. Knowledge Graph inclusion realistically runs on a timeline of months, sometimes years, tied to accumulating independent, authoritative mentions — not something a single content sprint changes.
Where nqzai fits
This kind of measurement is tedious to run by hand at any real cadence: a disclosed prompt panel has to be run consistently across surfaces, mentions and citations logged separately, competitor share tracked in the same panel, and crawl/schema/entity signals cross-referenced against whatever changed on the site — all before a single trustworthy visibility number exists. nqzai's tooling is built to run that loop on a schedule rather than as a one-off audit: executing a fixed prompt set, distinguishing a bare mention from an actual citation, tracking share against named competitors, and surfacing which site-side change (a schema fix, a new page, a crawl-control flip) lines up with a visibility shift — so an owner gets one coherent before/after view instead of stitching together separate exports from separate checks.
FAQ
Does disallowing Google-Extended remove my site from AI Overviews or AI Mode?
No. Google-Extended only controls Gemini app/API grounding and future Gemini model training eligibility. AI Overviews and AI Mode run inside Search and are governed by standard Googlebot crawling rules instead.
Do I need an llms.txt file or special AI markup to be visible in Gemini or AI Overviews?
No — Google's own optimization guidance states no new machine-readable files, AI-specific text files, or special schema.org markup are needed to appear in Google Search's AI features.
Can two people ask Gemini or AI Mode the same question and get different answers?
Yes. Google confirms Gemini app responses can be shaped by opted-in Connected Apps (Gmail, Photos, YouTube, Search history) and by chat memory, and AI Mode responses can carry a "based on your Google activity" personalization when the user is signed in.
Does a Google Business Profile guarantee Knowledge Graph inclusion?
No. It's one signal among several — schema markup, Wikidata, business profile, and independent authoritative mentions — that improves eligibility. Google controls final inclusion algorithmically, and it isn't fast.
Is a citation in an AI Overview the same as organic ranking?
Not anymore in practice. Recent analysis found only a minority of AI Overview citations now come from pages that also rank in the traditional top 10, a sharp drop from the prior year, meaning citation-worthy content and top-10-ranking content have diverged.
How often should a brand visibility panel be re-run?
At minimum weekly, and ideally whenever the prompt panel's underlying category questions or the site's own schema/content/crawl settings change — a single snapshot from one date, one account state, is not representative given how much these answers vary by personalization and time.



