SEO & Crawler Management
Free Robots.txt Generator & Crawler Directive Builder
Generate search engine crawler rules for Google, Bing, and web indexing bots following the Robots Exclusion Protocol (RFC 9309).
Advertisement
Sponsored Space
Presets:
Advertisement
Sponsored Space
robots.txt (plaintext)
# robots.txt generated by GenStack Tools (https://genstack.tools)
# Date: 2026-11-03
User-agent: *
Allow: /
Disallow: /admin/
Disallow: /api/
Disallow: /private/
Sitemap: https://mywebsite.com/sitemap.xml