NAME

DTA::TokWrap::Processor::tokenize::dummy - DTA tokenizer wrappers: dtatw-tokenize-dummy

SYNOPSIS

            

              
              
use DTA::TokWrap::Processor::tokenize::dummy;
$td = DTA::TokWrap::Processor::tokenize::dummy->new(%args);
$doc_or_undef = $td->tokenize($doc);
            
          

DESCRIPTION

DTA::TokWrap::Processor::tokenize::dummy provides a package-local alternative to the "official" low-level tokenizer class DTA::TokWrap::Processor::tokenize.

Most users should use the high-level DTA::TokWrap wrapper class instead of using this module directly.

Constants

@ISA

DTA::TokWrap::Processor::tokenize::dummy inherits from DTA::TokWrap::Processor::tokenize.

Constructors etc.

new

            

              
              
$td = $CLASS_OR_OBJ->new(%args);
            
          

Constructor.

%args, %$td:

            

              
              
tokenize => $path_to_dtatw_tokenize, ##-- default: search
inplace  => $bool,                   ##-- prefer in-place programs for search?
            
          

defaults

            

              
              
%defaults = $CLASS->defaults();
            
          

Static class-dependent defaults.

init

            

              
              
$td = $td->init();
            
          

Dynamic object-dependent defaults.

Methods

tokenize

            

              
              
$doc_or_undef = $CLASS_OR_OBJECT->tokenize($doc);
            
          

See DTA::TokWrap::Processor::tokenize::tokenize().

SEE ALSO

DTA::TokWrap::Intro(3pm), dta-tokwrap.perl(1), ...

SEE ALSO

DTA::TokWrap::Intro(3pm), dta-tokwrap.perl(1), ...

AUTHOR

Bryan Jurish <moocow@cpan.org>

COPYRIGHT AND LICENSE

Copyright (C) 2009-2018 by Bryan Jurish

This package is free software; you can redistribute it and/or modify it under the same terms as Perl itself, either Perl version 5.14.2 or, at your option, any later version of Perl 5 you may have available.