Treex::Block::W2A::CS::Tokenize
version 2.20151102
Each sentence is split into a sequence of tokens. The default language-independent tokenization is used.
David Mareček <marecek@ufal.mff.cuni.cz>
Ondřej Dušek <odusek@ufal.mff.cuni.cz>
Copyright © 2011 by Institute of Formal and Applied Linguistics, Charles University in Prague
This module is free software; you can redistribute it and/or modify it under the same terms as Perl itself.
To install Treex::CS, copy and paste the appropriate command in to your terminal.
cpanm
cpanm Treex::CS
CPAN shell
perl -MCPAN -e shell install Treex::CS
For more information on module installation, please visit the detailed CPAN module installation guide.