Modules

database of robots.txt-derived permissions
Persistent RobotRules

Provides

in lib/WWW/RobotRules.pm