blob: e238bd180b3ccf9c551e5a7e328c93668268165b (
plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
|
# HOW TO EDIT THIS FILE:
# The handy ruler below makes it easier to edit a package description. Line
# up the first '|' above the ':' following the base package name, and the '|' on
# the right side marks the last column you can put a character in. You must make
# exactly 11 lines for the formatting to be correct. It's also customary to
# leave one space after the ':'.
# |----------------------------------------------------------|
perl-www-robotrules: perl-www-robotrules (DB of robots.txt-derived perms)
perl-www-robotrules:
perl-www-robotrules: This perl module parses /robots.txt files as specified
perl-www-robotrules: in "A Standard for Robot Exclusion". Webmasters can use
perl-www-robotrules: the /robots.txt file to forbid conforming robots from
perl-www-robotrules: accessing parts of their web site
perl-www-robotrules:
perl-www-robotrules: http://search.cpan.org/dist/WWW-RobotRules/
perl-www-robotrules:
perl-www-robotrules:
perl-www-robotrules:
|
