VerisoulAgent Atlas
All agents

xAI's Grok bots

From xAI

Type: AI crawlersSignedDetection guide
Verisoul ResearchUpdated 4 min read

xAI publishes no crawler identity for Grok's web fetches, while its Grok Bot agent is the one xAI product that signs.

How to detect xAI's Grok bots

xAI's Grok search fetchers can't be detected by user agent or IP list, because xAI publishes no crawler documentation, no user agent token, no IP ranges and no robots.txt policy for them. Grok Bot, xAI's separate computer-use agent launched Aug 11, 2026, is the exception, since Verisoul verifies its requests by signature. Verisoul names the agent as grok_bot through its signature, device and behavior, while the search fetchers are not named and are flagged through bot score instead.

Detection method
SignedThe agent signs its requests, so its identity is verified cryptographically. Verisoul names it only in some setups; other sessions are flagged through bot score.
Signals that identify it
  • CryptographicA signed request verified cryptographically
  • DeviceCloud-hosted browser with a virtual machine device profile
  • BehavioralAutomated clicks, typing and page flow instead of a person's

Grok fetches web pages to answer questions, to run DeepSearch research reports that launched with Grok 3 in Feb 2025, and to summarize links people paste. Users trigger it on grok.com, in the X app and through the xAI API. Unlike OpenAI, Anthropic, Google, Perplexity and Meta, xAI has published no crawler page for these fetches, so there is no official token, IP list or robots.txt statement to check against.

Names like GrokBot, xAI-SearchBot, Grok-DeepSearch and GrokAgent circulate in third-party bot lists, but xAI has never confirmed them. The one documented xAI product that acts on websites is Grok Bot, an always-on agent that launched on Aug 11, 2026 and works inside web apps for a person, and it is easy to confuse with the unconfirmed GrokBot crawler name.

How Grok's bots show up on your site

Grok's search fetches carry no declared identity, so to your server they look like ordinary browser or HTTP-client requests from networks xAI does not publish. Observed fetches have used Go-http-client or outdated Chrome and iPhone user agents from datacenter proxies, and a single Grok prompt can fan out into a burst of requests across many residential and mobile IPs with rotating browser user agents. Grok Bot is different. Each member gets a cloud VM with a browser, and its traffic leaves through shared static egress IPs that xAI gives customers on request, with an option to route through the user's own desktop. xAI's docs say the Bot should hand CAPTCHAs and blocks back to the person rather than work around them.

CheckWhat Grok's bots do
User agentNo confirmed token for search fetches
Web Bot Auth signatureGrok Bot signs, search fetches don't
IP rangesNone public, Grok Bot ranges on request
robots.txtNo policy published by xAI

Why Grok's fetchers are hard to detect

With no token, no IP list and no robots.txt policy, there is nothing to match on, which means a Disallow rule for a Grok name is a preference at best. A single request from Grok's fetchers can look like any visitor, and the burst pattern across residential IPs looks a lot like proxy-based scraping, so detection has to come from the browser and the pattern of the session rather than from the request headers. Cloudflare Radar publishes no separate traffic share for Grok's fetchers, which makes their volume hard to size from outside.

Grok Bot is the easier half, because a signed request can be checked against xAI's key, and its cloud browser carries a virtual machine device profile that a real person's laptop doesn't. Cloudflare Radar's bot directory has an entry for Grok Bot, which lets Cloudflare customers allow or block it by name.

How Verisoul detects Grok Bot

Verisoul names Grok Bot by verifying its signature, which is the strongest kind of agent identification because it can't be borrowed. We back that with the session itself, where a cloud-hosted browser with a virtual machine device profile and automated clicks, typing and page flow confirm it is the agent and not the person. Grok's unnamed search fetchers don't get an agent name, while Verisoul still flags them as automated through bot score.

API response
"agent": {
  "id": "grok_bot",
  "name": "Grok Bot",
  "provider": "xAI",
  "type": "ai_assistant",
  "detection_method": "signed",
  "detection_signals": [
    "cryptographic",
    "behavioral"
  ]
}
  • id is grok_bot, the stable value to write rules against for xAI's agent
  • type is ai_assistant, because Grok Bot acts on sites for a real person
  • detection_method is signed, meaning the request's signature was verified cryptographically
  • detection_signals lists cryptographic (the signature), device (a cloud VM browser) and behavioral (automated page flow)

See the Grok Bot entry in Agent Atlas and the AI agent detection docs for the full response format.

  1. 01Person assigns Grok Bot a task
  2. 02Grok Bot's cloud browser opens your site
  3. 03It sends a signed request
  4. 04Your page sees a cloud VM browser
How xAI's Grok bots reaches your site

How to detect Grok's bots step by step

  1. Turn on Verisoul and read the agent object in the API response
  2. Write a rule for grok_bot on sign-up, payouts and account changes
  3. Rate limit or block unnamed sessions with a high bot score on content you protect
  4. Ask xAI for Grok Bot's egress ranges if you need an allowlist

Should you block Grok's bots?

Grok Bot works for a real person, so many teams let it browse and send it to review at sign-up, payouts and account changes. Grok's unnamed search fetchers are a scraping question for content sites, so rate limit or block them by bot score where it matters.

How xAI's Grok bots shows up in the Atlas

Verisoul returns these Atlas entries for xAI's Grok bots sessions it can name.

Questions about xAI's Grok bots

What is Grok's user agent?

xAI hasn't published one for Grok's web fetches. Third-party lists show names like GrokBot, xAI-SearchBot and Grok-DeepSearch, but xAI has never confirmed them.

Can you block Grok with robots.txt?

Not reliably. xAI publishes no robots.txt policy for its fetchers, so a Disallow rule for a Grok name is only a preference.

Does xAI publish IP ranges for its crawler?

No. There is no public IP list for Grok's search fetches, and egress ranges for Grok Bot are available only from xAI account teams.

What is the difference between Grok Bot and GrokBot?

Grok Bot is xAI's computer-use agent, launched Aug 11, 2026, which Verisoul verifies by its signature. GrokBot is a crawler name from third-party lists that xAI has never confirmed.

Sources

  1. Grok Bot security FAQ, xAI
  2. Grok Bot documentation, xAI
  3. Introducing Grok Bot, xAI
  4. Grok Bot, Cloudflare Radar bot directory
  5. The age of agents: cryptographically recognizing agent traffic, Cloudflare
  6. Web Bot Auth architecture, IETF draft