The Perl Toolchain Summit needs more sponsors. If your company depends on Perl, please support this very important event.

Changes for version 0.24 - 2019-08-16

  • Fixed a bug where wrong schemas in links would not be omitted.

Modules

A web crawling framework for Perl
Single crawler job
Crawler queue base class
Crawler queue with memory
Crawler queue with Mysql [EXPERIMENTAL]
Scraper utitlities
Crawler specific featured user agent