← AI agent directory

Semrush · SEO tool

SemrushBot

Operator
Semrush
Purpose
SEO tool
Verification
None
Follows robots.txt
Operator says it follows robots.txt

Operator documentation: https://www.semrush.com/bot/

01Identify and verify

How it shows up in your logs

User-agent contains

  • SemrushBot

Matching is case-insensitive. Anyone can send this string, so a match alone says only what the request claims to be.

Is it really SemrushBot?

The operator publishes no ranges or keys, so any request using this name is unverified.

02Publishers

How major publishers treat it

The leaderboard does not grade SemrushBot yet, so there is no publisher figure for it.

03robots.txt

A rule you can paste

The group names SemrushBot exactly. A group for a different token from the same company does not cover it.

# SemrushBot (Semrush)
User-agent: SemrushBot
Disallow: /

04Same operator

Semrush's other agents

SemrushBot (Semrush): what it is and how to block it · Plumb