← AI agent directory

Yahoo · Search engine

Yahoo Slurp

Operator
Yahoo
Purpose
Search engine (Plumb's classification)
Verification
None
Follows robots.txt
Not documented

01Identify and verify

How it shows up in your logs

User-agent contains

  • Slurp

Matching is case-insensitive. Anyone can send this string, so a match alone says only what the request claims to be.

Is it really Yahoo Slurp?

The operator publishes no ranges or keys, so any request using this name is unverified.

02Publishers

How major publishers treat it

The leaderboard does not grade Slurp yet, so there is no publisher figure for it.

03robots.txt

A rule you can paste

The group names Slurp exactly. A group for a different token from the same company does not cover it.

Yahoo does not document whether this agent follows robots.txt. Plumb can tell you whether it does on your site.

# Yahoo Slurp (Yahoo)
User-agent: Slurp
Disallow: /
Yahoo Slurp (Yahoo): what it is and how to block it · Plumb