Name : perl-WWW-RobotRules
| |
Version : 6.01
| Vendor : Fedora Project
|
Release : 3.fc16
| Date : 2011-07-24 13:46:34
|
Group : Development/Libraries
| Source RPM : perl-WWW-RobotRules-6.01-3.fc16.src.rpm
|
Size : 0.03 MB
| |
Packager : Fedora Project
| |
Summary : Database of robots.txt-derived permissions
|
Description :
This module parses /robots.txt files as specified in \"A Standard for Robot Exclusion\", at < http://www.robotstxt.org/wc/norobots.html>. Webmasters can use the /robots.txt file to forbid conforming robots from accessing parts of their web site.
|
RPM found in directory: /packages/linux-pbone/archive.fedoraproject.org/fedora/linux/releases/16/Everything/i386/os/Packages |