diff options
| author | yyamashita <yyamashita@mosquit.one> | 2026-05-14 23:29:56 +0900 |
|---|---|---|
| committer | yyamashita <yyamashita@mosquit.one> | 2026-05-14 23:30:17 +0900 |
| commit | 3a005f23696ad17d02582ec0e2d972620b999ab1 (patch) | |
| tree | c3935dfa6bb446f02717e5783a5c886b1bfe7901 /Deploy.md | |
| parent | 05f78805dd4516b44d6724229628d8f6402c8a0e (diff) | |
Add crawler bypass header to skip X-Robots-Tag
Requests with X-Crawler-Access header and the correct token
will have the X-Robots-Tag response header removed, allowing
trusted crawlers to index the site.
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Diffstat (limited to 'Deploy.md')
0 files changed, 0 insertions, 0 deletions