spiderbar
From MaRDI portal
Software:76407
Parse and Test Robots Exclusion Protocol Files and Rules
Last update: 11 February 2023
Software version identifier: 0.2.5
Copyright license: MIT license, File License
Parse and Test Robots Exclusion Protocol Files and Rules
Last update: 11 February 2023
Software version identifier: 0.2.5
Copyright license: MIT license, File License