Articles about "user fetcher"

PerplexityBot builds the index behind Perplexity citations and honors robots.txt. Perplexity-User fetches pages for people's questions and generally ignores it. Blocking the wrong one costs you traffic.