The Perl Toolchain Summit needs more sponsors. If your company depends on Perl, please support this very important event.

Changes for version 0.113160 - 2011-11-12

  • Use Any::Moose instead of Moose. This allows users to choose between Moose and Mouse. Is compile and start up actually faster this way? As per request from Steve Caldwell @ Campus Explorer.
  • Pass @INC to sub-process perl processes while doing testing (so we test with the new version, not installed version, of Hadoop::Streaming)
  • Improve pod in Hadoop::Streaming by including an example of using jar command and hadoop -archives flag.

Modules

Contains Mapper, Combiner and Reducer roles to simplify writing Hadoop Streaming jobs
Simplify writing Hadoop Streaming jobs. Combiner follows the same interface as Reducer. Requires a combine() function which will be called for each line of combiner data. Combiners are run on the same machine as the mapper as a pre-reduce reduction step.
Simplify writing Hadoop Streaming Mapper jobs. Write a map() function and let this role handle the Stream interface.
Simplify writing Hadoop Streaming jobs. Write a reduce() function and let this role handle the Stream interface. This Reducer roll provides an iterator over the multiple values for a given key.
Parse input stream for reducer
Collects values for each key together with an iterator interface
Role providing access to values for a given key.
Role to provide emit, counter, and status interaction with Hadoop::Streaming.
Role to require has_next and next