>_ Robots.txt Generator

Generate a robots.txt file to control search engine crawling and indexing of your website.

Sitemap URL (optional): Crawl rules:

Block AI crawlers (GPTBot, CCBot, ChatGPT)

Crawl-delay (seconds):

FAQ

What is robots.txt?

A text file placed at the root of your website that tells search engine crawlers which pages they can or cannot access.

Where does robots.txt go?

It must be placed at the root of your domain: https://example.com/robots.txt