robotstxt (Q100982): Difference between revisions

From MaRDI portal
Importer (talk | contribs)
Changed label, description and/or aliases in en, and other parts
Swh import (talk | contribs)
SWHID from Software Heritage
Property / Software Heritage ID
 
Property / Software Heritage ID: swh:1:snp:896bdf5f160a8b42a71730ed147308b09470b372 / rank
 
Normal rank
Property / Software Heritage ID: swh:1:snp:896bdf5f160a8b42a71730ed147308b09470b372 / qualifier
 
Property / Software Heritage ID: swh:1:snp:896bdf5f160a8b42a71730ed147308b09470b372 / qualifier
 
point in time: +2021-01-10T13:18:46Z
Timestamp+2021-01-10T13:18:46Z
Timezone+00:00
CalendarGregorian
Precision1 second
Before0
After0

Revision as of 22:40, 15 October 2023

A 'robots.txt' Parser and 'Webbot'/'Spider'/'Crawler' Permissions Checker
Language Label Description Also known as
English
robotstxt
A 'robots.txt' Parser and 'Webbot'/'Spider'/'Crawler' Permissions Checker

    Statements