Semrush · SEO tool
SemrushBot
- Operator
- Semrush
- Purpose
- SEO tool
- Verification
- None
- Follows robots.txt
- Operator says it follows robots.txt
01Identify and verify
How it shows up in your logs
User-agent contains
SemrushBot
Matching is case-insensitive. Anyone can send this string, so a match alone says only what the request claims to be.
Is it really SemrushBot?
The operator publishes no ranges or keys, so any request using this name is unverified.
02Publishers
How major publishers treat it
The leaderboard does not grade SemrushBot yet, so there is no publisher figure for it.
03robots.txt
A rule you can paste
The group names SemrushBot exactly. A group for a different token from the same company does not cover it.
# SemrushBot (Semrush) User-agent: SemrushBot Disallow: /
04Same operator
Semrush's other agents
- SiteAuditBotSEO tool