Robots.txt Generator

Build a robots.txt with rules per user-agent.

Processed locally in your browser. Nothing you add is uploaded.

More Web tools

• URL Parser: Break a URL down into its parts and query params.
• UTM Builder: Build or strip UTM tracking parameters on a link.
• Open Graph Generator: Generate Open Graph and Twitter Card meta tags.
• Sitemap Generator: Turn a list of URLs into a sitemap.xml.

All 92 tools