NAME

DTA::CAB::Analyzer::LangId::Simple - simple language guesser using stopword lists

SYNOPSIS

 ##========================================================================
 ## PRELIMINARIES
 
 use DTA::CAB::Analyzer::LangId::Simple;
 
 ##========================================================================
 ## Methods: Prepare
 
 $bool = $lid->ensureLoaded();
 
 ##========================================================================
 ## Methods: Analysis: v1.x: API
 
 $doc = $anl->analyzeTypes($doc,\%types,\%opts);
 $doc = $anl->analyzeSentences($doc,\%opts);
 

DESCRIPTION

Methods: Constructors etc.

new

 $obj = CLASS_OR_OBJ->new(%args)

Creates a new simple language-guesser object, which inherits from DTA::CAB::Analyzer::Dict::Json. Known options in %args:

 ##-- analysis selection
 label      => 'lang', ##-- analyzer label
 defaultLang => 'de',  ##-- default language (if e.g. known by 'morph')
 defaultCount => 0.1,  ##-- bonus count for default lang (characters)
 minSentLen   => 2,    ##-- minimum number of tokens in sentence required before guessing
 minSentChars => 8,    ##-- minimum number of text characters in sentence required begore guessing

Methods: Prepare

ensureLoaded

 $bool = $lid->ensureLoaded();

ensures analyzer data is loaded from default files.

Methods: Analysis: v1.x: API

analyzeTypes

 $doc = $anl->analyzeTypes($doc,\%types,\%opts);

perform type-wise analysis of all (text) types in $doc->{types}

analyzeSentences

 $doc = $anl->analyzeSentences($doc,\%opts);

perform sentence-wise analysis of all sentences in $doc->{body}.

AUTHOR

Bryan Jurish <moocow@cpan.org>

COPYRIGHT AND LICENSE

Copyright (C) 2013-2019 by Bryan Jurish

This package is free software; you can redistribute it and/or modify it under the same terms as Perl itself, either Perl version 5.24.1 or, at your option, any later version of Perl 5 you may have available.

SEE ALSO

dta-cab-analyze.perl(1), dta-cab-convert.perl(1), dta-cab-http-server.perl(1), dta-cab-http-client.perl(1), dta-cab-xmlrpc-server.perl(1), dta-cab-xmlrpc-client.perl(1), DTA::CAB::Server(3pm), DTA::CAB::Client(3pm), DTA::CAB::Format(3pm), DTA::CAB(3pm), perl(1), ...