Skip to content
Primetra
All agents

Agent reference · Search crawler

Googlebot

Google's search crawler, which also feeds AI Overviews and AI Mode. Verified against Google's crawler list. Google-Extended is a robots.txt switch, never a visitor.

Vendor
Google
Agent type
Search crawlerIndex pages so an AI assistant can find and cite them when people ask.
Can be verified by
Published addressesThe vendor publishes where this agent runs from, so a visit can be checked against that list.
How sure we are
DocumentedThe vendor's own documentation describes this agent.
Last reviewed
Vendor documentation
developers.google.com (opens in a new tab)

Tokens to look for

User-Agent tokens

Appear in the User-Agent header of its requests.

  • Googlebot

robots.txt tokens

Use these names in robots.txt to allow or block it.

  • Google-Extended

Check a visitor claiming to be Googlebot

We've filled in its token. Paste the full User-Agent from your logs and the address it came from for a real answer.

Paste the full User-Agent header from your logs. A single token such as GPTBot works too.

Optional

IPv4 or IPv6, as your logs show it. Used only for this check and never stored. Without it, a claim can only come back as can't be verified.

What this means for your site

Googlebot decides whether an AI assistant can find your pages and cite them. If it can't read your site, the assistant answers about your category without you.

See whether AI agents can find your product, use it and, soon, pay for it.

Run the free agent-readiness check