The Perl Toolchain Summit needs more sponsors. If your company depends on Perl, please support this very important event.
 / 
Gungho-0.09005_03
River stage one • 1 direct dependent • 1 total dependent
++

Changes for version 0.09005_03

  • General
    • Implement a $c->shutdown, and Engnie/Provider/Handler->stop that will stop the entire system
    • Ahem, *do* index the Japanese documentation (but change the names)
  • Provider::Inline
    • Backwards Incompatible Change *
      • Provider::Inline will no longer dispatch your requests merely by placing them in $p->requests. You need to call send_request() yourself
  • RobotRules
    • Deprecate usage of "module: RobotoRules::Storage::XXXX". Now you don't have to type that much. Just say "module: XXXX". This will break your old code! Beware!
  • Apoptosis
    • Call shutdown() instead of setting is_running

Changes for version 0.09005_02

  • General
    • Tweak deps
    • Don't index Japanese documentation
    • Fix 02_config.t to check for contents rather than entire structure. Seems like some YAML versions reads in the '---' in the beginning of the YAML document
    • Add Gungho::Base::mk_virtual_methods()
    • Fix a bunch of typos in Japanese docs
  • RobotRules::Storage
    • Explicitly state methods that should be virtual methods.

Changes for version 0.09005_01

  • General
    • Migrate hooks to Event::Notify. This breaks the input parameter list. Now you receive the event name as the first argument
    • Add a TODO.pod
  • Engine::POE
    • Implement a shutdown state.
    • Make it callable from stop()
  • Engine
    • Refactor handle_response to Engine.pm
  • Throttle
    • Changed send_request() to return 1 on success, 0 otherwise.
  • RobotRules
    • DB_File storage now dies if the call to tie() fails
  • Log::Dispatch
    • Clarify in document that log config should be specified with "config" key.
    • Backport changes from ja docs

Documentation

Gungho.ja
高性能Webクローラーフレームワーク
Gungho::Component.ja
Gunghoコンポーネント親クラス
Gungho::Component::Authentication.ja
Gungho認証親クラス
Gungho::Component::Authentication::Basic.ja
GunghoでBasic認証を行う
Gungho::Component::BlockPrivateIP.ja
内部IPアドレスに解決するリクエストを拒否する
Gungho::Component::Cache.ja
キャッシュ機能を組み込む
Gungho::Component::RobotRules.ja
robots.txtの処理を行う
Gungho::Component::RobotRules::Rule
robots.txtルール
Gungho::Component::RobotRules::Storage.ja
robots.txtストレージ
Gungho::Component::RobotRules::Storage::DB_File.ja
robots.txt情報をDB_Fileに格納する
Gungho::Component::RobotsMETA.ja
ページ内のRobotsMETAをパースする
Gungho::Component::Throttle.ja
スロットリング用ベースクラス
Gungho::Component::Throttle::Domain.ja
ドメイン／ホスト毎にスロットリング
Gungho::Component::Throttle::Simple.ja
リクエスト総数でスロットル
Gungho::Engine::POE.ja
Gungho用POEエンジン
Gungho::Log::Dispatch.ja
Gunghoログモジュール
Gungho::Manual::Basics.ja
Gunghoの基本
Gungho::Manual::FAQ.ja
Gungho FAQ
Gungho::Manuall::Install.ja
インストール
Gungho::Manual::Intro.ja
高性能クローラーフレームワーク
Gungho::Manual::Tutorial.ja
Gunghoチュートリアル
Gungho::Plugin::Apoptosis.ja
プロセスが停止する時間を指定
Gungho::Plugin::RequestLog.ja
リクエスト履歴をログする
Gungho::Request.ja
Gunghoリクエストオブジェクト
Gungho::Response.ja
Gunghoレスポンス オブジェクト
Gungho::Manual::FAQ
Gungho FAQ
Gungho::Manual::TOD
TODO Items
gungho
An Extensible, High-Performance Web Crawler Framework

Modules

Gungho
Yet Another High Performance Web Crawler Framework
Gungho::Base
Base Class For Various Gungho Objects
Gungho::Base::Class
Base For Classes That Won't Be Instantiated
Gungho::Component
Component Base Class For Gungho
Gungho::Component::Authentication
Base Class For WWW Authentication
Gungho::Component::Authentication::Basic
Add Basic Auth To Gungho
Gungho::Component::BlockPrivateIP
Block Requests With Private IP Address
Gungho::Component::Cache
Use Cache In Your App
Gungho::Component::Core
Gungho Core Methods
Gungho::Component::RobotRules
Respect robots.txt
Gungho::Component::RobotRules::Rule
A Rule Object
Gungho::Component::RobotRules::Storage
RobotRules Storage Base Class
Gungho::Component::RobotRules::Storage::Cache
Cache Storage For RobotRules
Gungho::Component::RobotRules::Storage::DB_File
DB_File Storage For RobotRules
Gungho::Component::RobotsMETA
Automatically Parse Robots META
Gungho::Component::Scraper
Web::Scraper From Within Gungho
Gungho::Component::Setup
Routines To Setup Gungho
Gungho::Component::Throttle
Base Class To Throttle Requests
Gungho::Component::Throttle::Domain
Throttle By Domain
Gungho::Component::Throttle::Simple
Throttle By Number Of Requests
Gungho::Component::Throttle::Throttler
Data::Throttler Based Throttling
Gungho::Engine
Base Class For Gungho Engine
Gungho::Engine::Danga::Socket
Gungho Engine Using Danga::Socket
Gungho::Engine::IO::Async
IO::Async Engine
Gungho::Engine::POE
POE Engine For Gungho
Gungho::Exception
Gungho Exceptions
Gungho::Handler
Base Class For Gungho Handlers
Gungho::Handler::FileWriter::Simple
Write Out Fetched Contents To File
Gungho::Handler::Inline
Inline Handler
Gungho::Handler::Null
A Handler That Does Nothing
Gungho::Inline
Inline Your Providers And Handlers (Deprecated)
Gungho::Log
Log Base Class For Gungho
Gungho::Log::Dispatch
Log::Dispatch-Based Log For Gungho
Gungho::Log::Simple
Simple Gungho Log Class
Gungho::Plugin
Gungho Plugin Base Class
Gungho::Plugin::Apoptosis
Stop Execution In Long-Running Processes
Gungho::Plugin::RequestLog
Log Requests
Gungho::Plugin::RequestTimer
Keep Track Of Time To Finish Request
Gungho::Plugin::Statistics
Gather Crawler Statistics
Gungho::Plugin::Statistics::Format::XML
Format Statistics As XML
Gungho::Plugin::Statistics::Storage::SQLite
Gungho::Provider
Base Class For Gungho Prividers
Gungho::Provider::File::Simple
Provide Requests From A Simple File
Gungho::Provider::Inline
Inline Provider
Gungho::Provider::Simple
An In-Memory, Simple Provider
Gungho::Provider::YAML
Specify requests in YAML format
Gungho::Request
A Gungho Request Object
Gungho::Request::http
HTTP specific utilities
Gungho::Response
Gungho HTTP Response Object
Gungho::Util
Gungho General Utilities

Provides

Gungho::Engine::IO::Async::Impl::Select
in lib/Gungho/Engine/IO/Async.pm
Gungho::Plugin::Apoptosis::Time
in lib/Gungho/Plugin/Apoptosis.pm

Examples

Other files