Name : rh-perl530-perl-WWW-RobotRules
| |
Version : 6.02
| Vendor : CentOS
|
Release : 25.el7
| Date : 2020-04-04 21:41:17
|
Group : Unspecified
| Source RPM : rh-perl530-perl-WWW-RobotRules-6.02-25.el7.src.rpm
|
Size : 0.02 MB
| |
Packager : CBS < cbs_centos_org>
| |
Summary : Database of robots.txt-derived permissions
|
Description :
This module parses /robots.txt files as specified in \"A Standard for Robot Exclusion\", at < http://www.robotstxt.org/wc/norobots.html>. Webmasters can use the /robots.txt file to forbid conforming robots from accessing parts of their web site.
|
RPM found in directory: /vol/rzm7/linux-centos-vault/7.8.2003/sclo/x86_64/rh/Packages/r |