Robots.txt Tester
Test whether a specific URL is allowed for a given user-agent.
How to use
- Fetch or paste robots.txt.
- Enter a user-agent and path.
- See the matching rule and verdict.
Frequently asked questions
- Is the Robots.txt Tester free to use?
- Yes. The Robots.txt Tester is 100% free, requires no signup or API key, and runs entirely in your browser.
- Does the Robots.txt Tester send my data to a server?
- No. All processing happens client-side in your browser — your input never leaves your device.
- How do I use the Robots.txt Tester?
- Fetch or paste robots.txt. Enter a user-agent and path. See the matching rule and verdict.
Related Technical SEO tools
- Redirect Chain CheckerTrace every hop in a URL's redirect chain with status codes for each step.
- XML Sitemap ValidatorValidate an XML sitemap for syntax, size, duplicates and protocol compliance.
- SSL Certificate CheckerCheck a domain's SSL certificate, issuer and expiry date.
- Mobile-Friendly AnalyzerCheck viewport, font sizes, fixed widths and other mobile-friendliness signals.
- Crawlability CheckerSee whether crawlers can reach a page based on robots.txt and meta directives.
- Indexability AuditAudit a page for noindex, canonical, title, description and other index signals.
Looking for more? Browse all free SEO tools or read the latest SEO guides.