What does Robots.txt Generator do?
Create a basic robots.txt with sitemap location. The workspace keeps the input and result together, making it easy to check the change before you use it elsewhere.
For example, you can create a basic robots.txt with sitemap location before asking a search engine to recrawl an updated page.
What you can control
Robots.txt Generator gives you direct control over block /admin.
How to use Robots.txt Generator
- 1
Enter the site URL you want Robots.txt Generator to process.
- 2
Set block /admin to match the result you need.
- 3
Run Robots.txt Generator, check the answer against your inputs, and copy the result if you need it elsewhere.
Tips for a better result
- Save the original page metadata before replacing it with the Robots.txt Generator output.
- Change one setting at a time—especially block /admin—so differences are easier to compare.
- Compare the generated markup with the visible page and test it after publishing.
Frequently asked questions
Is my input private when I use Robots.txt Generator?+
Robots.txt Generator creates or checks the markup in this browser. Draft page details are not stored in a 247888 account.
What should I check after using Robots.txt Generator?+
Compare the generated markup with the visible page and test it after publishing.