Daisuke Maki
and 1 contributors

NAME

Gungho::Component::RobotRules::Storage - RobotRules Storage Base Class

METHODS

storage

Holds the actual storage backend

get_rule

Gets a rule for a particular URL

put_rule

Stores a rule for a particular URL

get_pending_robots_txt

Returns a list of requests that were waiting for that particular robots.txt information

push_pending_robots_txt

Adds a request to the list of requests waiting for a particular robots.txt information