NAME

PDL::Algorithm::Center - Various methods of finding the center of a sample

VERSION

version 0.07

DESCRIPTION

PDL::Algorithm::Center is a collection of algorithms which specialize in centering datasets.

SUBROUTINES

See "TYPES" for information on the types used in the subroutine descriptions.

sigma_clip

  $results = sigma_clip(
      center      => Optional [ Center | CodeRef ],
      clip        => Optional [PositiveNum],
      coords      => Optional [Coords],
      dtol        => PositiveNum,
      iterlim     => Optional [PositiveInt],
      log         => Optional [Bool | CodeRef],
      mask        => Optional [ Undef | Piddle_min1D_ne ],
      save_mask   => Optional [Bool],
      save_weight => Optional [Bool],
      nsigma      => PositiveNum,
      weight      => Optional [ Undef | Piddle_min1D_ne ],
  );

Center a dataset by iteratively excluding data outside of a radius equal to a specified number of standard deviations. The dataset may be specified as a list of coordinates and optional weights, or as a weight piddle of shape NxM (e.g., an image). If only the weight piddle is provided, it is converted internally into a list of coordinates with associated weights.

To operate on a subset of the input data, specify the mask option.

A PDL::Algorithm::Center::Failure::parameter exception will be thrown if there is a parameter error.

The center of a data set is determined by:

clipping (ignoring) the data whose distance to the current center is greater than a specified number of standard deviations
calculating a new center by performing a (weighted) centroid of the remaining data
calculating the standard deviation of the distance from the remaining data to the center
repeat step 1 until either a convergence tolerance has been met or the iteration limit has been exceeded

The initial center may be explicitly specified, or may be calculated by performing a (weighted) centroid of the data.

The initial standard deviation is calculated using the initial center and either the entire dataset, or from a clipped region about the initial center.

Options

The following options are available:

center => ArrayRef | Piddle1D_ne | coderef

The initial center. It may be

An array of length N

The array may contain undefined values for each dimension for which the center should be determined by finding the mean of the values in that dimension.
A piddle with shape N (or something that can be coerced into one, see "TYPES"),
A coderef which will return the center as a piddle with shape N. The subroutine is called as
```
  &$center( $coords, $mask, $weight, $total_weight );
```
with

$coords

A piddle with shape NxM containing M coordinates with dimension N

$mask

A piddle with shape M, essentially a flattened copy of the initial $mask option to "iterate".

$weight

A piddle with shape M, essentially a copy of the initial $weight option to "iterate".

$total_weight

A scalar which is the sum of $mask * $weight

clip => positive number

Optional. The clipping radius used to determine the initial standard deviation.

coords => Coords

Optional. The coordinates to center. coords is a piddle of shape NxM (or anything which can be coerced into it, see "TYPES") where N is the number of dimensions in the data and M is the number of data elements.

weight may be specified with coords to indicate weighted data.

mask may be specified to indicate that a subset of the coordinates should be operated on.

coords is useful if the data cube is not fully populated; for dense data, use weight instead.

dtol => positive number

Optional. If specified iteration will cease when successive centers are closer than the specified distance.

iterlim => positive integer

Optional. The maximum number of iterations to run. Defaults to 10.

log => boolean|coderef

Optional.

If log is true (and not a coderef), a default logger which outputs to STDOUT will be used.

If a coderef it will be called before the first iteration and at the end of each iteration. It is passed a copy of the current iteration's results object; see "Sigma Clip Iteration Results".

mask => piddle

Optional. This is a piddle which specifies which coordinates to include in the calculations. Its values are either 0 or 1, where values of 1 indicate coordinates to be included. It defaults to a piddle of all 1's.

When used with coords, mask must be a piddle of shape M, where M is the number of data elements in coords.

If coords is not specified, mask should have the same shape as weight.

save_mask => boolean

If true, the mask used in the final iteration will be returned in the iteration result object.

save_weight => boolean

If true, the weights used in the final iteration will be returned in the iteration result object.

nsigma => scalar

The size of the clipping radius, in units of the standard deviation.

weight => piddle

Optional. Data weights. When used with coords, weight must be a piddle of shape M, where M is the number of data elements in coords. If coords is not specified, weight is a piddle of shape NxM, where N is the number of dimensions in the data and M is the number of data elements.

It defaults to a piddle of all 1's.

Sigma Clip Results

sigma_clip returns an object which includes all of the attributes from the final iteration object (See "Sigma Clip Iterations" ), with the following additional attributes/methods:

iterations => arrayref: An array of results objects for each iteration.
success => boolean: True if the iteration converged, false otherwise.
error => error object: If convergence has failed, this will contain an error object describing the failure. See "Errors".
mask => piddle: If the $save_mask option is true, this will be the final inclusion mask.
weight => piddle: If the $save_weight option is true, this will be the final weights.

Sigma Clip Iterations

The results for each iteration are stored in an object with the following attributes/methods:

center => piddle|undef: A 1D piddle containing the derived center. The value for the last iteration will be undefined if all of the elements have been clipped.
iter => integer: The iteration index. An index of 0 indicates the values determined before the iterative loop was entered, and reflects the initial clipping and mask exclusion.
nelem => integer: The number of data elements used in the center.
total_weight => number: The combined weight of the data elements used to determine the center.
sigma => number|undef: The standard deviation of the clipped data. The value for the last iteration will be undefined if all of the elements have been clipped.
clip => number|undef: The clipping radius. This will be undefined for the first iteration if the clip option was not specified.
dist => number: Optional. The distance between the previous and current centers. This is defined only if the dtol option was passed.

iterate

  $result = iterate(
    center       => Center | CodeRef,
    initialize   => CodeRef,
    calc_center  => CodeRef,
    calc_wmask   => CodeRef,
    is_converged => CodeRef,
    coords       => Coords,
    iterlim      => PositiveInt,
    log          => Optional [CodeRef],
    mask         => Optional [Piddle1D_ne],
    save_mask    => Optional [Bool],
    save_weight  => Optional [Bool],
    weight       => Optional [Piddle1D_ne],
  );

A generic iteration loop for centering data using callbacks for calculating centers, included element masks, weight, and iteration completion.

A PDL::Algorithm::Center::Failure::parameter exception will be thrown if there is a parameter error.

Options

The following options are accepted:

center => Piddle1D_ne | coderef

The initial center. It may either be a piddle with shape N (or something that can be coerced into one, see "TYPES") or a coderef which will return the center as a piddle with shape N. The coderef is called as

  $initial_center = &$center( $coords, $mask, $weight, $total_weight );

with

$coords: A piddle with shape NxM containing M coordinates with dimension N
$mask: A piddle with shape M, essentially a flattened copy of the initial $mask option to "iterate".
$weight: A piddle with shape M, essentially a copy of the initial $weight option to "iterate".
$total_weight: A scalar which is the sum of $mask * $weight.

initialize => coderef

This subroutine provides initialization prior to entering the iteration loop. It should initialize the passed iteration object and work storage.

It is invoked as:

  &$initialize( $coords, $mask, $weight, $current, $work );

with

$coords

A piddle of shape NxM with the coordinates of each element

$mask

A piddle with shape M, essentially a flattened copy of the initial $mask option to "iterate".

$weight

A piddle with shape M, essentially a copy of the initial $weight option to "iterate".

$current

a reference to a Hash::Wrap based object containing data for the current iteration. initialize may augment the underlying hash with its own data (but see "Work Space"). The following attributes are provided by iterate:

nelem: The number of included coordinates, $mask-sum>.
total_weight: The sum of the weights of the included coordinates, ($mask * $weight)->dsum.

$work

A hashref which may use to store temporary data (e.g. work piddles) which will be available to all of the callback routines.

calc_center => coderef

This subroutine should return a piddle of shape N with the calculated center.

It will be called as:

  $center = &$calc_center( $coords, $mask, $weight, $current, $work );

with

$coords

A piddle of shape NxM with the coordinates of each element

$mask

A piddle with shape M containing the current inclusion mask.

$weight

A piddle with shape M containing the current weights for the included coordinates.

$current

A reference to a Hash::Wrap based object containing data for the current iteration.

calc_center may augment the underlying hash with its own data (but see "Iteration Objects"). The following attributes are provided by iterate:

nelem: The number of included coordinates, $mask->sum.
total_weight: The sum of the weights of the included coordinates, ($mask*$weight)->dsum).

$work

A hashref which may use to store temporary data (e.g. work piddles) which will be available to all of the callback routines.

calc_wmask => coderef

This subroutine should determine the current set of included coordinates and their current weights.

It will be called as:

  &$calc_mask( $coords, $mask, $weight, $current, $work );

with

$coords

A piddle of shape NxM with the coordinates of each element

$mask

A piddle with shape M, essentially a flattened copy of the initial $mask option to "iterate". Any changes to it will be discarded at the end of the iteration. Be sure to update $current->nelem if this is changed.

$weight

$current

A reference to a Hash::Wrap based object containing data for the current iteration.

calc_center may augment the underlying hash with its own data (but see "Work Space"). The following attributes are provided by iterate:

nelem: The number of included coordinates, $mask->sum. If $mask is changed this must either be updated or set to the undefined value.
total_weight: The sum of the weights of the included coordinates, ($mask * $weight)->dsum. If $weight is changed this must either be updated or set to the undefined value.

$work

A hashref which may use to store temporary data (e.g. work piddles) which will be available to all of the callback routines.

is_converged => coderef

This subroutine should return a boolean value indicating whether the iteration has converged.

It is invoked as:

  $bool = &$is_converged( $coords, $mask, $weight, $last, $current, $work );

with

$coords

A piddle of shape NxM with the coordinates of each element

$mask

A piddle with shape M containing the current inclusion mask.

$weight

A piddle with shape M containing the current weights for the included coordinates.

$last

A reference to a Hash::Wrap based object containing data for the previous iteration. is_converged may augment the underlying hash with its own data (but see "Work Space"). The following attributes are provided by iterate:

nelem: The number of included coordinates.
total_weight: The sum of the weights of the included coordinates.

$current

A reference to a Hash::Wrap based object containing data for the current iteration, with attributes as described above for $last

$work

A hashref which may use to store temporary data (e.g. work piddles) which will be available to all of the callback routines.

The is_converged routine is passed references to the actual objects used by sigma_clip to keep track of the iterations. This means that the is_converged routine may manipulate the starting point for the next iteration by altering its $current parameter.

is_converged is called prior to entering the iteration loop with $last set to undef. This allows priming the $current structure, which will be used as $last in the first iteration.

coords => Coords

The coordinates to center. coords is a piddle of shape NxM (or anything which can be coerced into it, see "TYPES") where N is the number of dimensions in the data and M is the number of data elements.

iterlim

A positive integer specifying the maximum number of iterations.

log => coderef

Optional. A subroutine which will be called

between the call to initialize and the start of the first iteration
at the end of each iteration

It is invoked as

  &$log( $iteration );

where $iteration is a copy of the current iteration object. The object will have at least the following fields:

center => piddle|undef: A piddle of shape N containing the derived center. The value for the last iteration will be undefined if all of the elements have been clipped.
iter: The iteration index
nelem: The number of included coordinates.
total_weight: The summed weight of the included coordinates.

There may be other attributes added by the various callbacks (calc_wmask, calc_center, is_converged). See for example, "Sigma Clip Iterations".

mask => piddle

When used with coords, mask must be a piddle of shape M, where M is the number of data elements in coords.

If coords is not specified, mask should have the same shape as weight.

save_mask => boolean

If true, the mask used in the final iteration will be returned in the iteration result object.

save_weight => boolean

If true, the weights used in the final iteration will be returned in the iteration result object.

weight => piddle

It defaults to a piddle of all 1's.

Callbacks are provided with Hash::Wrap based objects which contain the data for the current iteration. They should add data to the objects underlying hash which records particulars about their specific operation,

Work Space

Callbacks are passed Hash::Wrap based iteration objects and a reference to a $work hash. The iteration objects may have additional elements added to them (which will be available to the caller), but should refrain from storing unnecessary data there, as each new iteration's object is copied from that for the previous iteration.

Instead, use the passed $work hash. It is shared amongst the callbacks, so use it to store data which will not be returned to the caller.

Results

iterate returns an object which includes all of the attributes from the final iteration object (See "Iteration Object" ), with the following additional attributes/methods:

iterations => arrayref: An array of result objects for each iteration.
success => boolean: True if the iteration converged, false otherwise.
error => error object: If convergence has failed, this will contain an error object describing the failure. See "Errors".
mask => piddle: If the $save_mask option is true, this will be the final inclusion mask.
weight => piddle: If the $save_weight option is true, this will be the final weights.

The value of the center attribute in the last iteration will be undefined if all of the elements have been clipped.

Iteration Object

The results for each iteration are stored in an object with the following attributes/methods (in addition to those added by the callbacks).

center => piddle|undef: A 1D piddle containing the derived center. The value for the last iteration will be undefined if all of the elements have been clipped.
iter => integer: The iteration index. An index of 0 indicates the values determined before the iterative loop was entered, and reflects the initial clipping and mask exclusion.
nelem => integer: The number of data elements used in the center.
total_weight => number: The combined weight of the data elements used to determine the center.

Iteration Steps

Before the first iteration:

Extract an initial center from center.
Create a new iteration object.
Call initialize.
Call log

For each iteration:

Creat a new iteration object by copying the old one.
Call calc_wmask, with a copy of the initial mask and weights. calc_mask should update (in place) at least one of them
Update summed weight and number of elements if calc_wmask sets them to undef.
Call calc_center with the current mask and weights.
Call is_converged with the current mask and weights.
Call log
Goto step 1 if not converged and iteration limit has not been reached.

TYPES

In the description of the subroutines, the following types are specified:

Center: This accepts a non-null, non-empty 1D piddle, or anything that can be converted into one (for example, a scalar, a scalar piddle, or an array of numbers );
CodeRef: A code reference.
PositiveNum: A positive real number.
PositiveInt: A positive integer.
Coords: This accepts a non-null, non-empty 2D piddle, or anything that can be converted or up-converted to it.
Piddle_min1D_ne: This accepts a non-null, non-empty piddle with a minimum of 1 dimension.
Piddle1D_ne: This accepts a non-null, non-empty 1D piddle.

ERRORS

Errors are represented as objects in the following classes:

Parameter Validation

These are unconditionally thrown as PDL::Algorithm::Center::Failure::parameter objects.

Iteration

These are stored in the result object's error attribute.

  PDL::Algorithm::Center::Failure::iteration::limit_reached
  PDL::Algorithm::Center::Failure::iteration::empty

The objects stringify to a failure message.

BUGS

Please report any bugs or feature requests on the bugtracker website https://rt.cpan.org/Public/Dist/Display.html?Name=PDL-Algorithm-Center or by email to bug-PDL-Algorithm-Center@rt.cpan.org.

When submitting a bug or request, please include a test-file or a patch to an existing test-file that illustrates the bug or desired feature.

SOURCE

The development version is on github at https://github.com/djerius/pdl-algorithm-center and may be cloned from git://github.com/djerius/pdl-algorithm-center.git

AUTHOR

Diab Jerius <djerius@cpan.org>

COPYRIGHT AND LICENSE

This is free software, licensed under:

  The GNU General Public License, Version 3, June 2007

To install PDL::Algorithm::Center, copy and paste the appropriate command in to your terminal.

cpanm

cpanm PDL::Algorithm::Center

CPAN shell

perl -MCPAN -e shell
install PDL::Algorithm::Center

For more information on module installation, please visit the detailed CPAN module installation guide.

	Global
`s`	Focus search bar
`?`	Bring up this help dialog

	GitHub
`g` `p`	Go to pull requests
`g` `i`	go to github issues (only if github is preferred repository)

	POD
`g` `a`	Go to author
`g` `c`	Go to changes
`g` `i`	Go to issues
`g` `d`	Go to dist
`g` `r`	Go to repository/SCM
`g` `s`	Go to source
`g` `b`	Go to file browse

	Search terms
module: (e.g. module:Plugin)
distribution: (e.g. distribution:Dancer auth)
author: (e.g. author:SONGMU Redis)
version: (e.g. version:1.00)

NAME

VERSION

DESCRIPTION

SUBROUTINES

sigma_clip

Options

Sigma Clip Results

Sigma Clip Iterations

iterate

Options

Work Space

Results

Iteration Object

Iteration Steps

TYPES

ERRORS

BUGS

SOURCE

AUTHOR

COPYRIGHT AND LICENSE

Module Install Instructions