ByteDance · Model training
TikTokSpider
- Operator
- ByteDance
- Purpose
- Model training (Plumb's classification)
- Verification
- None
- Follows robots.txt
- Not documented
01Identify and verify
How it shows up in your logs
User-agent contains
TikTokSpider
Matching is case-insensitive. Anyone can send this string, so a match alone says only what the request claims to be.
Is it really TikTokSpider?
The operator publishes no ranges or keys, so any request using this name is unverified.
Bytespider publishes no ranges.
02Publishers
How major publishers treat it
Its robots.txt token is not documented, so the leaderboard cannot grade it.
03robots.txt
robots.txt token not documented
ByteDance does not document a robots.txt token for TikTokSpider, and the leaderboard does not grade one, so Plumb offers no rule to paste. A guessed name would match nothing and block nothing. To stop it, block its user agent at your CDN or firewall.
04Same operator
ByteDance's other agents
- BytespiderModel training