The Perl Toolchain Summit needs more sponsors. If your company depends on Perl, please support this very important event.
 / 
MCE-1.499_003
River stage three • 21 direct dependents • 313 total dependents
103 ++
/ MCE

NAME

MCE - Many-core Engine for Perl. Provides parallel processing capabilities.

VERSION

This document describes MCE version 1.499_003

DESCRIPTION

Many-core Engine (MCE) for Perl helps enable a new level of performance by maximizing all available cores. MCE spawns a pool of workers and therefore does not fork a new process per each element of data. Instead, MCE follows a bank queuing model. Imagine the line being the data and bank-tellers the parallel workers. MCE enhances that model by adding the ability to chunk the next n elements from the input stream to the next available worker.

Chunking and input data are optional in MCE. One can simply use MCE to have many workers run in parallel.

CORE MODULES

The core engine is made up of 3 modules. New to the 1.5 release is the inclusion of the gather and time interval features. In addition, the core has a faster IPC engine when compared to prior releases.

MCE::Core

Provides the core API for Many-core Engine.

MCE::Signal

Temporary directory creation/cleanup & signal handling.

MCE::Util

Public and private utility functions.

MCE ADDONS

MCE::Queue

Provides a hybrid queuing implementation for MCE supporting normal queues and priority queues in a single module. This module exchanges data via the core engine to enable queues to work for both children (spawned via fork) and threads.

MCE::Subs

Exports funtions mapped directly to MCE's methods, e.g. mce_wid. The module allows 3 options, e.g. :manager, :worker, :getter.

MCE MODELS

MCE 1.5 introduces 5 models for even more automation behind the scene. The models configure MCE, spawn plus shutdown workers automatically.

The models take Many-core Engine to a new level for ease of use.

MCE::Flow

A parallel flow model for building creative applications. This makes use of User Tasks in MCE. The author has full control when utilizing this model.

MCE::Grep

Provides a parallel grep implementation similar to the native grep function.

MCE::Loop

Provides a parallel loop utilizing MCE for building creative loops.

MCE::Map

Provides a parallel map model similar to the native map function.

MCE::Stream

Provides an efficient parallel implementation for chaining multiple maps and greps together through the use of User Tasks and MCE::Queue.

EXAMPLES

A place-holder for examples included with the distribution.

MCE::Examples

REQUIREMENTS

Perl 5.8.0 or later. PDL::IO::Storable is required in scripts running PDL and using MCE for parallelization.

SOURCE

The source is hosted at http://code.google.com/p/many-core-engine-perl/

AUTHOR

Mario E. Roy, <marioeroy AT gmail DOT com>

COPYRIGHT AND LICENSE

Copyright (C) 2012-2013 by Mario E. Roy

This program is free software; you can redistribute it and/or modify it under the terms of either: the GNU General Public License as published by the Free Software Foundation; or the Artistic License.

See http://dev.perl.org/licenses/ for more information.