Plucene::Analysis::Tokenizer - base class for tokenizers
my $tokenizer = Plucene::Analysis::Tokenizer::Subclass ->new({ reader => $reader });
This is an abstract base class for tokenizers.
A Tokenizer is a TokenStream whose input is a Reader.
This will create a new tokenizer.
This must be defined in a subclass
Close the input reader.
To install Plucene, copy and paste the appropriate command in to your terminal.
cpanm
cpanm Plucene
CPAN shell
perl -MCPAN -e shell install Plucene
For more information on module installation, please visit the detailed CPAN module installation guide.