Robots.txt Validator und Test
Robots.txt Validator
Paste the complete content of your robots.txt to check for errors.
Enter URL paths (with leading /) to check if they are blocked or allowed.
Enter a domain to fetch and analyze its robots.txt.
Paste the complete content of your robots.txt to check for errors.
Enter URL paths (with leading /) to check if they are blocked or allowed.
Enter a domain to fetch and analyze its robots.txt.
Weitere Tools, die du mal testen solltest
