| Name : perl-WWW-RobotRules
| |
| Version : 6.02
| Vendor : CentOS
|
| Release : 5.el7
| Date : 2014-06-10 06:08:40
|
| Group : Development/Libraries
| Source RPM : perl-WWW-RobotRules-6.02-5.el7.src.rpm
|
| Size : 0.03 MB
| |
| Packager : CentOS BuildSystem < http://bugs_centos_org>
| |
| Summary : Database of robots.txt-derived permissions
|
Description :
This module parses /robots.txt files as specified in \"A Standard for Robot
Exclusion\", at < http://www.robotstxt.org/wc/norobots.html>. Webmasters can
use the /robots.txt file to forbid conforming robots from accessing parts
of their web site.
|
RPM found in directory: /vol/rzm7/linux-centos-vault/altarch/7.8.2003/os/i386/Packages |
