robots.txt Generator

Generate one User-agent group with Allow, Disallow and an optional sitemap. Rules do not provide access control.

Up to 100,000 UTF-16 units per input and 1,000,000 per result. See the supported formats and examples below.