Weighs the soul of incoming HTTP requests to stop AI crawlers

chore(robots.txt): don't block CCBot

Signed-off-by: Xe Iaso <me@xeiaso.net>

Xe Iaso 845095c3 2f1e78cc

Changed files
-1
web
static
-1
web/static/robots.txt
··· 9 9 User-agent: bedrockbot 10 10 User-agent: Brightbot 1.0 11 11 User-agent: Bytespider 12 - User-agent: CCBot 13 12 User-agent: ChatGPT-User 14 13 User-agent: Claude-SearchBot 15 14 User-agent: Claude-User