The Perl Toolchain Summit needs more sponsors. If your company depends on Perl, please support this very important event.

Changes for version 0.05

  • Gungho->new has been deprecated in favor of a simple call to ->run()
  • Gungho::Inline->new has been deprecated
  • Fix SKIP_DECODED_CONTENT handling by properly specifying a package. POE workaround should now work.
  • Gungho::Engine::POE will set FollowRedirect to 1 by default.

Documentation

An Extensible, High-Performance Web Crawler Framework

Modules

Yet Another High Performance Web Crawler Framework
Base Class For Various Gungho Objects
Component Base Class For Gungho
Base Class For WWW Authentication
Add Basic Auth To Gungho
Base Class To Throttle Requests
Throttle By Number Of Requests
Data::Throttler Based Throttling
Base Class For Gungho Engine
Gungho Engine Using Danga::Socket
POE Engine For Gungho
Base Class For Gungho Handlers
A Handler That Does Nothing
Inline Your Providers And Handlers
Gungho Log Class
Gungho Plugin Base Class
Keep Track Of Time To Finish Request
Base Class For Gungho Prividers
Provide Requests From A Simple File
An In-Memory, Simple Provider
Specify requests in YAML format
A Gungho Request Object
HTTP specific utilities

Provides

in lib/Gungho/Engine/Danga/Socket.pm
in lib/Gungho/Inline.pm
in lib/Gungho/Inline.pm
in lib/Gungho/Engine/POE.pm