Hapfinds
Porduct
Pricing
Blog
Contact
Robots.txt Generator
Free Usage:
0 / 10
used today. Upgrade Pro for unlimited generations and batch operations.
Remove Block
Disallow Paths (One per line)
/admin/ /private/ /tmp /login/ /user/
Allow Paths (One per line)
/
Sitemap URL (Optional)
Remove Block
Disallow Paths (One per line)
/archive/ /temp/
Allow Paths (One per line)
/public/
Sitemap URL (Optional)
Remove Block
Disallow Paths (One per line)
/archive/ /private/
Allow Paths (One per line)
/public/
Sitemap URL (Optional)
Remove Block
Disallow Paths (One per line)
/archive/
Allow Paths (One per line)
Sitemap URL (Optional)
+ Add User-agent Block
Import/Export (Pro)
Generated Robots.txt
Copy to Clipboard
Generate & Count Usage