Robots.txt Evaluator Payload
Simulate crawling arrays against arbitrary robots files parsing standard rule cascades resolving offline.
Crawler Input Simulator
Evaluation Verdict
Blocked
Rule Match: /admin/
Line Target: Line 2
Simulate crawling arrays against arbitrary robots files parsing standard rule cascades resolving offline.