Robots.txt Generator
Build a valid robots.txt file with allow/disallow rules and a sitemap reference — instantly, in your browser.
Runs in your browser
Private & secure
Build a valid robots.txt file — allow everything, or block specific paths, with an optional sitemap reference. Everything runs entirely in your browser.
How it works
List the paths you want to block (one per line, like /admin/), or check “Allow all” to generate a robots.txt that permits every crawler. Add your sitemap URL to include a Sitemap line. Copy the result into a file named robots.txt at your site’s root.
FAQs
Does this test my live robots.txt against real crawlers?
No — this generates syntax, it doesn’t simulate a crawl against your actual site. Use Google Search Console’s robots.txt report to check how Googlebot actually reads your live file.
Is my data sent anywhere?
No. The file is generated entirely in your browser.