The London Perl and Raku Workshop takes place on 26th Oct 2024. If your company depends on Perl, please consider sponsoring and/or attending.

Changes for version 1.08_01

  • Add clear() call to the DNS cache on startup. On systems with prolonged process life time, it's likely that the DNS cache is holding bad data, so we might as well reinitialize.
  • add tools/ and custom Makefile.PL
  • Fix so that shutdown_broker state kills alarms.
    • Try to work with servers that send 400/408 upon too many connections (the sysadmins must hate me) by gracefully reducing the number of HTTP fetchers upon encountering those return status


Learn How To Write Crawlers With Xango


Event Based High Performance Web Crawler Framework
Broker HTTP Requests (Deprecated)
Base Class for Xango Broker
Xango's Pull-Crawler
Xango's Push-Crawler
Global Xango Config
Xango Job