Jekyll robots.txt
Articles about "Jekyll robots.txt"
2 articles found
Technical SEO
How to Block AI Crawlers on GitHub Pages: Robots.txt Guide for Static Sites
Block AI training crawlers on GitHub Pages with a single robots.txt file. Learn where the file must live, which bots to block, and what static hosting cannot do.
Technical SEO
How to Block AI Crawlers on Jekyll Sites in 2026
Jekyll sites are static, so blocking AI crawlers means using robots.txt, _config.yml, and your host's server rules. This guide explains all three.