The Perl Toolchain Summit needs more sponsors. If your company depends on Perl, please support this very important event.

Modules

database of robots.txt-derived permissions
Persistent RobotRules

Provides

in lib/WWW/RobotRules.pm