caddy: X-Robots-Tag noindex,nofollow on /home2 + /home3 (HTTP-level, for non-JS crawlers)
Per Codex audit — the JS <meta robots> isn't seen by bots that don't run JS. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
This commit is contained in:
@@ -58,6 +58,11 @@ upbeatbytes.com {
|
||||
root * /srv/sites/upbeatbytes
|
||||
|
||||
# Hidden in-progress prototypes — keep crawlers out at the HTTP level (the JS
|
||||
# <meta robots> isn't seen by non-JS bots since the static shell is generic).
|
||||
@hidden path /home2 /home3
|
||||
header @hidden X-Robots-Tag "noindex, nofollow"
|
||||
|
||||
# Content-hashed assets never change for a given URL — cache them forever.
|
||||
@immutable path /_app/immutable/*
|
||||
header @immutable Cache-Control "public, max-age=31536000, immutable"
|
||||
|
||||
|
||||
Reference in New Issue
Block a user