The Perl Toolchain Summit needs more sponsors. If your company depends on Perl, please support this very important event.

NAME

Plucene::Analysis::WhitespaceTokenizer - white space tokenizer

SYNOPSIS

        # isa Plucene::Analysis::CharTokenizer

DESCRIPTION

A WhitespaceTokenizer is a tokenizer that divides text at whitespace. Adjacent sequences of non-Whitespace characters form tokens.

METHODS