- Name: perl-WWW-RobotRules-Parser
- Version: 0.04001
- Release: 1
- Epoch: 0
- Group: Development/Languages/Perl
- License: GPLv1 or Artistic
- Url: http://search.cpan.org/dist/WWW-RobotRules-Parser/
- Summary: WWW::RobotRules::Parser - parse robots.txt
- Architecture: noarch
- Size: 6881
- Distribution: PLD
- Vendor:
- Packager:
Description:
WWW::RobotRules::Parser allows you to simply parse robots.txt files as
described in <http://www.robotstxt.org/wc/norobots.html>. Unlike
WWW::RobotRules (which is very cool), this module does not take into
consideration your user agent name when parsing. It just parses the
structure and returns a hash containing the whole set of rules. You
can then use this to do whatever you like with it.
- OptFlags: -O2 -fno-strict-aliasing -fwrapv -march=x86-64
- Cookie:
- Buildhost: ymir-builder
Sources packages:
Other version of this rpm:
