Technical SEO
How to Block AI Crawlers on Docusaurus Sites in 2026
Docusaurus makes blocking AI crawlers easy — one file in static/robots.txt does the job. But the baseUrl trap catches most docs sites: rules filed under a project subpath carry no force. This guide shows the exact setup, which bots to block, and how to verify it.
Rahul Sharma
11 min