robotstxt (Q100982): Difference between revisions
From MaRDI portal
Changed label, description and/or aliases in en, and other parts |
Swh import (talk | contribs) SWHID from Software Heritage |
||||||||||||||
Property / Software Heritage ID | |||||||||||||||
Property / Software Heritage ID: swh:1:snp:896bdf5f160a8b42a71730ed147308b09470b372 / rank | |||||||||||||||
Normal rank | |||||||||||||||
Property / Software Heritage ID: swh:1:snp:896bdf5f160a8b42a71730ed147308b09470b372 / qualifier | |||||||||||||||
Property / Software Heritage ID: swh:1:snp:896bdf5f160a8b42a71730ed147308b09470b372 / qualifier | |||||||||||||||
point in time: +2021-01-10T13:18:46Z
|
Revision as of 22:40, 15 October 2023
A 'robots.txt' Parser and 'Webbot'/'Spider'/'Crawler' Permissions Checker
Language | Label | Description | Also known as |
---|---|---|---|
English | robotstxt |
A 'robots.txt' Parser and 'Webbot'/'Spider'/'Crawler' Permissions Checker |
Statements
3 September 2020
0 references
+2021-01-10T13:18:46Z
0 references