robotstxt (Q100982): Difference between revisions
From MaRDI portal
m rollbackEdits.php mass rollback Tag: Rollback |
Added link to MaRDI item. |
||
(3 intermediate revisions by 2 users not shown) | |||
Property / programmed in | |||
Property / programmed in: R / rank | |||
Property / depends on software | |||
Property / depends on software: R / rank | |||
Property / depends on software: R / qualifier | |||
Property / imports | |||
Property / imports: stringr / rank | |||
Property / imports: stringr / qualifier | |||
Property / imports | |||
Property / imports: httr / rank | |||
Property / imports: httr / qualifier | |||
Property / imports | |||
Property / imports: future / rank | |||
Property / imports: future / qualifier | |||
Property / imports | |||
Property / imports: future.apply / rank | |||
Property / imports: future.apply / qualifier | |||
Property / imports | |||
Property / imports: magrittr / rank | |||
Property / imports | |||
Property / imports: stringr / rank | |||
Normal rank | |||
Property / imports | |||
Property / imports: httr / rank | |||
Normal rank | |||
Property / imports | |||
Property / imports: future / rank | |||
Normal rank | |||
Property / imports | |||
Property / imports: future.apply / rank | |||
Normal rank | |||
Property / imports | |||
Property / imports: magrittr / rank | |||
Normal rank | |||
Property / programmed in | |||
Property / programmed in: R / rank | |||
Normal rank | |||
Property / depends on software | |||
Property / depends on software: R / rank | |||
Normal rank | |||
Property / MaRDI profile type | |||
Property / MaRDI profile type: MaRDI software profile / rank | |||
Normal rank | |||
links / mardi / name | links / mardi / name | ||
Latest revision as of 19:56, 12 March 2024
A 'robots.txt' Parser and 'Webbot'/'Spider'/'Crawler' Permissions Checker
Language | Label | Description | Also known as |
---|---|---|---|
English | robotstxt |
A 'robots.txt' Parser and 'Webbot'/'Spider'/'Crawler' Permissions Checker |
Statements
3 September 2020
0 references