Webz.io · Model training
Omgilibot
- Operator
- Webz.io
- Purpose
- Model training (Plumb's classification)
- Verification
- None
- Follows robots.txt
- Not documented
01Identify and verify
How it shows up in your logs
User-agent contains
Omgilibotomgili
Matching is case-insensitive. Anyone can send this string, so a match alone says only what the request claims to be.
Is it really Omgilibot?
The operator publishes no ranges or keys, so any request using this name is unverified.
02Publishers
How major publishers treat it
The leaderboard does not grade omgili yet, so there is no publisher figure for it.
03robots.txt
A rule you can paste
The group names omgili and omgilibot exactly. A group for a different token from the same company does not cover it.
Webz.io does not document whether this agent follows robots.txt. Plumb can tell you whether it does on your site.
# Omgilibot (Webz.io) User-agent: omgili User-agent: omgilibot Disallow: /
04Same operator
Webz.io's other agents
- Webz.ioModel training