robotstxt (Q100982): Difference between revisions

From MaRDI portal
RedirectionBot (talk | contribs)
Removed claims
RedirectionBot (talk | contribs)
Changed an Item
Property / imports
 
Property / imports: stringr / rank
 
Normal rank
Property / imports
 
Property / imports: httr / rank
 
Normal rank
Property / imports
 
Property / imports: future / rank
 
Normal rank
Property / imports
 
Property / imports: future.apply / rank
 
Normal rank
Property / imports
 
Property / imports: magrittr / rank
 
Normal rank
Property / programmed in
 
Property / programmed in: R / rank
 
Normal rank
Property / depends on software
 
Property / depends on software: R / rank
 
Normal rank

Revision as of 15:19, 9 February 2024

A 'robots.txt' Parser and 'Webbot'/'Spider'/'Crawler' Permissions Checker
Language Label Description Also known as
English
robotstxt
A 'robots.txt' Parser and 'Webbot'/'Spider'/'Crawler' Permissions Checker

    Statements

    0 references
    3 September 2020
    0 references
    0.7.13
    3 September 2020
    0 references
    0 references
    0 references
    0 references
    0 references
    0 references
    0 references
    0 references
    0 references
    0 references
    0 references
    0 references
    0 references