Robots.txt Tester
Fetch a site's robots.txt and check whether a specific URL is allowed for a user-agent. Google's longest-match-wins rule resolution, fully local.
Enter a page URL and user-agent to test it against the site's robots.txt.
Fetch a site's robots.txt and check whether a specific URL is allowed for a user-agent. Google's longest-match-wins rule resolution, fully local.