Skip to content
Primetra
All agents

Agent reference · Search crawler

Claude-SearchBot

Anthropic's search crawler. An IP on Anthropic's list proves it; one off the list stays unproven (the list is not promised complete).

Vendor
Anthropic
Agent type
Search crawlerIndex pages so an AI assistant can find and cite them when people ask.
Can be verified by
Published addressesThe vendor publishes where this agent runs from, so a visit can be checked against that list.
How sure we are
DocumentedThe vendor's own documentation describes this agent.
Last reviewed
Vendor documentation
support.claude.com (opens in a new tab)

Tokens to look for

User-Agent tokens

Appear in the User-Agent header of its requests.

  • Claude-SearchBot

robots.txt tokens

No robots.txt token is documented for it.

Check a visitor claiming to be Claude-SearchBot

We've filled in its token. Paste the full User-Agent from your logs and the address it came from for a real answer.

Paste the full User-Agent header from your logs. A single token such as GPTBot works too.

Optional

IPv4 or IPv6, as your logs show it. Used only for this check and never stored. Without it, a claim can only come back as can't be verified.

What this means for your site

Claude-SearchBot decides whether an AI assistant can find your pages and cite them. If it can't read your site, the assistant answers about your category without you.

See whether AI agents can find your product, use it and, soon, pay for it.

Run the free agent-readiness check