Convert tools

robots.txt Generator

Generate one User-agent group with Allow, Disallow and an optional sitemap. Rules do not provide access control.

Convert in your browser · No sign-up

Generate one User-agent group with Allow, Disallow and an optional sitemap. Rules do not provide access control.

Up to 100,000 UTF-16 units per input and 1,000,000 per result. See the supported formats and examples below.

How to use

  1. Generate one User-agent group with Allow, Disallow and an optional sitemap. Rules do not provide access control.
  2. Choose the options, then run the tool.
  3. Check the result, then copy or download it.

Example

User-agent: *
Disallow: /admin/
Allow: /admin/public/

Details and limitations

Generate one User-agent group with Allow, Disallow and an optional sitemap. Rules do not provide access control.

Processing stays in your browser.

FAQ

Supported inputs and limits

Generate one User-agent group with Allow, Disallow and an optional sitemap. Rules do not provide access control.

Format references

Tool page updated: