robots.txt Generator
Generate robots.txt files with allow/disallow rules and sitemap references
Use * to match all crawlers, or specify bots like Googlebot.
Disallow Paths
Allow Paths
No explicit allow overrides added.
Use * to match all crawlers, or specify bots like Googlebot.
Disallow Paths
No blocked routes added.
Allow Paths
Embedded Sitemaps
Generated robots.txt