Free local tool

Robots.txt Tester

Inspect ROBOTS.TXT in your browser. Runs in your browser. Files do not leave your device.

Cost
Free
Files
No upload
Runtime
Browser-local
Input
ROBOTS.TXT
Output
CRAWL-RULES
  1. 1Add input
  2. 2Run tool
  3. 3Download or copy

Runs in your browser. Files do not leave your device.

Robots.txt Tester

Paste text, run the tool locally, and copy the result.

Details

How this works

What it does

Inspect ROBOTS.TXT in your browser. Runs in your browser. Files do not leave your device.

Privacy

Runs in your browser. Files do not leave your device.

Input

Use ROBOTS.TXT. The result is CRAWL-RULES.