Where should robots.txt be placed?
It must be available at the domain root, for example https://example.com/robots.txt.
Technical SEO
Free robots.txt generator
Free robots.txt generator for Google, Bing, Ahrefs and AI crawlers.
0 EUR No account Local processing
How to use free robots.txt generator
Enter your information, generate the result, then copy it into your project. The core tool stays free and usable without creating an account.
Need a custom tool?
I can build a calculator, generator or checker tailored to your SEO acquisition.
Contact meFAQ
Is robots.txt enough to prevent indexing?
No. Sensitive pages also need noindex metadata or authentication.