Changes for version 0.07 - 2015-01-26

  • Removed additional_props on job class.
  • Renamed discover method to browse.
  • Removed peeping attribute in favor of peeping_port.
  • Improved error event API.
  • Added a feature for auto stop crawling when queue get empty.
  • Improved checkbot example.
  • Improved tests.
  • Improved documents.

Documentation

A web crawling framework for Perl

Modules

A web crawling framework for Perl
Single crawler job
Mojo::UserAgent sub class for userinfo storage