About this tool
Build a robots.txt file by choosing a default rule, listing paths to block and adding your sitemap URL. Download it and upload it to the root of your site.
Frequently asked questions
Where does robots.txt go?
At the root of your domain, for example example.com/robots.txt.
Does Disallow hide a page from Google?
Not always. A blocked page can still be listed if other sites link to it. Use a noindex tag to keep a page out of results.