DTA::TokWrap::Processor::tokenize::auto - DTA tokenizer wrappers: auto tokenizer
use DTA::TokWrap::Processor::tokenize::auto; $td = DTA::TokWrap::Processor::tokenize::auto->new(%args); $doc_or_undef = $td->tokenize($doc);
DTA::TokWrap::Processor::tokenize::auto provides a "smart" wrapper for the low-level tokenizer class DTA::TokWrap::Processor::tokenize.
DTA::TokWrap::Processor::tokenize::auto inherits from DTA::TokWrap::Processor::tokenize.
$td = $CLASS_OR_OBJ->new(%args);
Constructor.
%args, %$td:
tokenize => $path_to_dtatw_tokenize, ##-- default: search inplace => $bool, ##-- prefer in-place programs for search?
%defaults = $CLASS->defaults();
Static class-dependent defaults.
$td = $td->init();
Dynamic object-dependent defaults.
$doc_or_undef = $CLASS_OR_OBJECT->tokenize($doc);
See DTA::TokWrap::Processor::tokenize::tokenize().
DTA::TokWrap::Intro(3pm), dta-tokwrap.perl(1), ...
Bryan Jurish <moocow@cpan.org>
Copyright (C) 2009-2018 by Bryan Jurish
This package is free software; you can redistribute it and/or modify it under the same terms as Perl itself, either Perl version 5.14.2 or, at your option, any later version of Perl 5 you may have available.
To install DTA::TokWrap, copy and paste the appropriate command in to your terminal.
cpanm
cpanm DTA::TokWrap
CPAN shell
perl -MCPAN -e shell install DTA::TokWrap
For more information on module installation, please visit the detailed CPAN module installation guide.