Robots.txt Generator
Control search engine crawling with a custom robots.txt file
One path per line
Generated Robots.txt