Robots.txt

A file at the root of your site that tells search engine crawlers which pages they can and can't access. Used to prevent indexing of admin areas, draft content, and other non-public pages.

Want this explained for your business?

Send us a message. We'll walk through what it means for you: no commitment, no sales pitch.

Send us a message