The Perl Toolchain Summit needs more sponsors. If your company depends on Perl, please support this very important event.

NAME

DTA::TokWrap::Processor::tokenize::tomasotath_05x - DTA tokenizer wrappers: tokenizer: dwds_tomsatotath v0.5.x via command-line

SYNOPSIS

 use DTA::TokWrap::Processor::tokenize::tomasotath_05x;
 
 $tz = DTA::TokWrap::Processor::tokenize::tomasotath_05x->new(%args);
 $doc_or_undef = $tz->tokenize($doc);

DESCRIPTION

This class is currently just a wrapper for the command-line low-level tokenizer dwds_tomasotath (ToMaSoTaTh), v0.5.x.

Most users should use the high-level DTA::TokWrap wrapper class instead of using this module directly.

Constants

@ISA

DTA::TokWrap::Processor::tokenize::tomasotath inherits from DTA::TokWrap::Processor::tokenize.

Constructors etc.

new
 $tz = $CLASS_OR_OBJ->new(%args);

%args, %$tz: (none yet)

defaults
 %defaults = CLASS->defaults();

Static class-dependent defaults.

Methods

tokenize
 $doc_or_undef = $CLASS_OR_OBJECT->tokenize($doc);

See DTA::TokWrap::Processor::tokenize::tokenize().

SEE ALSO

DTA::TokWrap::Intro(3pm), dta-tokwrap.perl(1), ...

SEE ALSO

DTA::TokWrap::Intro(3pm), dta-tokwrap.perl(1), ...

AUTHOR

Bryan Jurish <moocow@cpan.org>

COPYRIGHT AND LICENSE

Copyright (C) 2009-2018 by Bryan Jurish

This package is free software; you can redistribute it and/or modify it under the same terms as Perl itself, either Perl version 5.14.2 or, at your option, any later version of Perl 5 you may have available.