techaro.lol / anubis
Weighs the soul of incoming HTTP requests to stop AI crawlers
fork atom

chore(robots.txt): don't block CCBot

Signed-off-by: Xe Iaso <me@xeiaso.net>

Xe Iaso 845095c3 2f1e78cc

options
unified split
Changed files
-1
web
static
robots.txt
-1
web/static/robots.txt
··· 9 User-agent: bedrockbot 10 User-agent: Brightbot 1.0 11 User-agent: Bytespider 12 - User-agent: CCBot 13 User-agent: ChatGPT-User 14 User-agent: Claude-SearchBot 15 User-agent: Claude-User
··· 9 User-agent: bedrockbot 10 User-agent: Brightbot 1.0 11 User-agent: Bytespider 12 User-agent: ChatGPT-User 13 User-agent: Claude-SearchBot 14 User-agent: Claude-User