robotstxt (Q100982): Difference between revisions

From MaRDI portal
Importer (talk | contribs)
Created a new Item
 
Added link to MaRDI item.
 
(6 intermediate revisions by 4 users not shown)
description / endescription / en
 
A 'robots.txt' Parser and 'Webbot'/'Spider'/'Crawler' Permissions Checker
Property / programmed in
 
Property / programmed in: R / rank
Normal rank
 
Property / last update
 
3 September 2020
Timestamp+2020-09-03T00:00:00Z
Timezone+00:00
CalendarGregorian
Precision1 day
Before0
After0
Property / last update: 3 September 2020 / rank
 
Normal rank
Property / software version identifier
 
0.7.13
Property / software version identifier: 0.7.13 / rank
 
Normal rank
Property / software version identifier: 0.7.13 / qualifier
 
publication date: 3 September 2020
Timestamp+2020-09-03T00:00:00Z
Timezone+00:00
CalendarGregorian
Precision1 day
Before0
After0
Property / author
 
Property / author: Peter Meissner / rank
 
Normal rank
Property / author
 
Property / author: Kun Ren / rank
 
Normal rank
Property / maintained by
 
Property / maintained by: Peter Meissner / rank
 
Normal rank
Property / copyright license
 
Property / copyright license: MIT license / rank
 
Normal rank
Property / copyright license
 
Property / copyright license: File License / rank
 
Normal rank
Property / copyright license: File License / qualifier
 
Property / imports
 
Property / imports: spiderbar / rank
 
Normal rank
Property / imports: spiderbar / qualifier
 
Property / imports
 
Property / imports: utils / rank
 
Normal rank
Property / imports
 
Property / imports: stringr / rank
 
Normal rank
Property / imports
 
Property / imports: httr / rank
 
Normal rank
Property / imports
 
Property / imports: future / rank
 
Normal rank
Property / imports
 
Property / imports: future.apply / rank
 
Normal rank
Property / imports
 
Property / imports: magrittr / rank
 
Normal rank
Property / CRAN project
 
Property / CRAN project: robotstxt / rank
 
Normal rank
Property / programmed in
 
Property / programmed in: R / rank
 
Normal rank
Property / depends on software
 
Property / depends on software: R / rank
 
Normal rank
Property / MaRDI profile type
 
Property / MaRDI profile type: MaRDI software profile / rank
 
Normal rank
links / mardi / namelinks / mardi / name
 

Latest revision as of 19:56, 12 March 2024

A 'robots.txt' Parser and 'Webbot'/'Spider'/'Crawler' Permissions Checker
Language Label Description Also known as
English
robotstxt
A 'robots.txt' Parser and 'Webbot'/'Spider'/'Crawler' Permissions Checker

    Statements

    0 references
    3 September 2020
    0 references
    0.7.13
    3 September 2020
    0 references
    0 references
    0 references
    0 references
    0 references
    0 references
    0 references
    0 references
    0 references
    0 references
    0 references
    0 references
    0 references