robotstxt (Q100982): Difference between revisions
From MaRDI portal
Swh import (talk | contribs) SWHID from Software Heritage |
m rollbackEdits.php mass rollback Tag: Rollback |
||||||||||||||
| Property / Software Heritage ID | |||||||||||||||
| Property / Software Heritage ID: swh:1:snp:896bdf5f160a8b42a71730ed147308b09470b372 / rank | |||||||||||||||
| Property / Software Heritage ID: swh:1:snp:896bdf5f160a8b42a71730ed147308b09470b372 / qualifier | |||||||||||||||
| Property / Software Heritage ID: swh:1:snp:896bdf5f160a8b42a71730ed147308b09470b372 / qualifier | |||||||||||||||
| |||||||||||||||
Revision as of 14:18, 25 January 2024
A 'robots.txt' Parser and 'Webbot'/'Spider'/'Crawler' Permissions Checker
| Language | Label | Description | Also known as |
|---|---|---|---|
| English | robotstxt |
A 'robots.txt' Parser and 'Webbot'/'Spider'/'Crawler' Permissions Checker |
Statements
3 September 2020
0 references
