The Perl Toolchain Summit needs more sponsors. If your company depends on Perl, please support this very important event.
 / 
Gungho-0.03
River stage one • 1 direct dependent • 1 total dependent
++

Changes for version 0.03

  • Add simple examples at examples directory
  • Add Danga::Socket engine -- this is a pretty crude implementation
  • Add documentation.
  • Fix G::Request's ID generation
  • Change pushback_request()'s signature to include a $c

Changes for version 0.02_05

  • Provider::Simple wasn't exactly prepared for the new code path. Fixed, and tested with Plagger

Changes for version 0.02_04

  • Throttle::Domain was actually checking for URL, not domains.

Changes for version 0.02_03

  • Packaging blunder. Add dep files for Throttle components

Changes for version 0.02_02

  • Add a gungho script
  • Add throttling. You can now throttle your requests by domain or simply by the number of requests in a specific amount of time. Providers are now expected to handle "pushback" of requests when a request has been throttled.
  • Internal change: Code path to send requests has changed from Gungho.pm doing the control to Provider doing the control

Changes for version 0.02_01

  • Add experimental component system >>> NOTE <<< This is still subject to change *widely*
  • Add Gungho->has_feature(X)
  • Add WWW Authentication component -- now you can authenticate your requests via Basic authentication
  • Fix Gungho::Request->clone()
  • Gungho::Provider::Simple respects the is_running() flag

Documentation

gungho
An Extensible, High-Performance Web Crawler Framework

Modules

Gungho
Yet Another High Performance Web Crawler Framework
Gungho::Base
Base Class For Various Gungho Objects
Gungho::Component
Component Base Class For Gungho
Gungho::Component::Authentication
Base Class For WWW Authentication
Gungho::Component::Authentication::Basic
Add Basic Auth To Gungho
Gungho::Component::Throttle
Base Class To Throttle Requests
Gungho::Component::Throttle::Domain
Throttle By Domain
Gungho::Component::Throttle::Simple
Throttle By Number Of Requests
Gungho::Component::Throttle::Throttler
Data::Throttler Based Throttling
Gungho::Engine
Base Class For Gungho Engine
Gungho::Engine::Danga::Socket
Gungho Engine Using Danga::Socket
Gungho::Engine::POE
POE Engine For Gungho
Gungho::Exception
Gungho::Handler
Base Class For Gungho Handlers
Gungho::Handler::Null
A Handler That Does Nothing
Gungho::Log
Gungho Log Class
Gungho::Plugin
Gungho Plugin Base Class
Gungho::Plugin::RequestTimer
Keep Track Of Time To Finish Request
Gungho::Provider
Base Class For Gungho Prividers
Gungho::Provider::File::Simple
Provide Requests From A Simple File
Gungho::Provider::Simple
An In-Memory, Simple Provider
Gungho::Request
A Gungho Request Object
Gungho::Request::http
HTTP specific utilities

Provides

Gungho::Engine::Danga::Socket::Impl
in lib/Gungho/Engine/Danga/Socket.pm

Examples

Other files