SMART
WORKZ
Toggle navigation
Home
SEO Tools
Complete SEO Audit
SEO Analyzer
Competitor Analysis
SERP Simulator
Broken Link Checker
Meta Tags Generator
Keyword Research
Backlink Checker
Sitemap Generator
Robots.txt Generator
Schema Generator
Technical
Page Speed Analyzer
Security Headers
SSL Checker
DNS Lookup
WHOIS Lookup
HTTP Headers
Redirect Checker
Website Status
Mobile-Friendly Test
Compression Test
Technology Detector
Social Media
Social Preview
Hashtag Generator
Caption Generator
Bio Generator
Post Scheduler
Engagement Calculator
Username Checker
Image Sizes Guide
Content
Keyword Density
Readability Checker
Word Counter
Plagiarism Checker
Branding
Brand Name Generator
Tagline Generator
Brand Voice Analyzer
Competitor Brand Analyzer
QR Code Generator
Brand Kit Generator
UI/UX
Color Contrast Checker
Palette Generator
Auto Color Scheme Generator
Color Theory Guide
Font Pairing
Logo Guidelines
Logo Tester
AI Tools
AI
Solver Pro AI
AI Caption Generator
AI Hashtag Generator
Home
Tools
Robots.txt Generator
Robots.txt Generator
Create a robots.txt file to control how search engines crawl your website.
Configuration
User Agent
All Robots (*)
Googlebot
Bingbot
Yandex
Yahoo Slurp
Select which bot this rule applies to.
Default Access
Allow All
Disallow All
Optimization Delay (Crawl-delay)
None
5 Seconds
10 Seconds
20 Seconds
60 Seconds
Sitemap URL
Restricted Directories
/
/
Add
Generate File
Generated robots.txt
Copy
User-agent: * Disallow: /cgi-bin/