| Name : perl-WWW-RobotRules
| |
| Version : 6.02
| Vendor : Red Hat, Inc_
|
| Release : 5.el7
| Date : 2013-12-29 14:16:50
|
| Group : Development/Libraries
| Source RPM : perl-WWW-RobotRules-6.02-5.el7.src.rpm
|
| Size : 0.03 MB
| |
| Packager : Red Hat, Inc_ < http://bugzilla_redhat_com/bugzilla>
| |
| Summary : Database of robots.txt-derived permissions
|
Description :
This module parses /robots.txt files as specified in \"A Standard for Robot
Exclusion\", at < http://www.robotstxt.org/wc/norobots.html>. Webmasters can
use the /robots.txt file to forbid conforming robots from accessing parts
of their web site.
|
RPM found in directory: /packages/linux-pbone/ftp5.gwdg.de/pub/opensuse/repositories/home:/matthewdva:/build:/RedHat:/RHEL-7/standard/noarch |
