Robots.txt Generator

Create a robots.txt file to control how search engines crawl your website

Custom rules
Crawl control
Download file
SEO best practices
4.7/5
55,000+ users
Free No Sign-up Instant
Configuration
Select which bot this rule applies to.
/
/
Generated robots.txt