🤖 Robots.txt Generator

Create a clean robots.txt file with sitemap, crawl delay, allow/disallow rules, and common bot presets.

Robots Rules

Ctrl+Enter GenerateEsc Clear

User-agent

Crawl Delay Optional

Disallow Paths One Per Line

Example: /private/ blocks that folder. Use / to block all crawling.

Allow Paths One Per Line Optional

Sitemap URL Optional

Quick Presets

Privacy note: robots.txt is generated locally in your browser. Nothing is uploaded.

Generated robots.txt

Ready

0Lines

0Rules

—Status