Name : perl-WWW-RobotRules
| |
Version : 6.02
| Vendor : Red Hat, Inc_
|
Release : 30.el9
| Date : 2021-08-10 16:11:32
|
Group : Unspecified
| Source RPM : perl-WWW-RobotRules-6.02-30.el9.src.rpm
|
Size : 0.02 MB
| |
Packager : Red Hat, Inc_ < http://bugzilla_redhat_com/bugzilla>
| |
Summary : Database of robots.txt-derived permissions
|
Description :
This module parses /robots.txt files as specified in \"A Standard for Robot Exclusion\", at < https://www.robotstxt.org/robotstxt.html>. Webmasters can use the /robots.txt file to forbid conforming robots from accessing parts of their web site.
|
RPM found in directory: /vol/rzm1/linux-rhel/rhel/rhel-9-beta/appstream/aarch64/Packages |