OpenAI · AI search indexing
OAI-SearchBot
- Operator
- OpenAI
- Purpose
- AI search indexing
- Verification
- Published IP ranges
- Follows robots.txt
- Operator says it follows robots.txt
01Identify and verify
How it shows up in your logs
User-agent contains
OAI-SearchBot
Matching is case-insensitive. Anyone can send this string, so a match alone says only what the request claims to be.
Is it really OAI-SearchBot?
Plumb checks the request IP against the operator's published ranges.
Range checked: openai:searchbot
Signing keys: openai.com
02Publishers
How major publishers treat it
30%of 319 publishers on the leaderboard block
OAI-SearchBot outright (95). 157 more close some sections. 117 name it explicitly in their robots.txt.03robots.txt
A rule you can paste
The group names OAI-SearchBot exactly. A group for a different token from the same company does not cover it.
# OAI-SearchBot (OpenAI) User-agent: OAI-SearchBot Disallow: /
04Same operator
OpenAI's other agents
- GPTBotModel training
- ChatGPT-UserUser-triggered fetch