++ed by:
ROZCOVO PAVELSR DUNCS

3 PAUSE users
1 non-PAUSE user.

Author image Keita Sugama

Modules

A web crawling framework for Perl
Single crawler job
Crawler queue base class
Crawler queue with memory
Crawler queue with Mysql [EXPERIMENTAL]
Scraper utitlities
Crawler specific featured user agent