NAME

Moot::TokenReader::Native - libmoot: Token I/O: reader: native 1 word/line format

SYNOPSIS

  use Moot::TokenReader::Native;

  ##=====================================================================
  ## Usage

  $tr = Moot::TokenReader::Native->new($fmt);  ##-- constructor

  $tr->from_file($filename);                   ##-- open a named file
  $sent = $tr->get_sentence();                 ##-- read next sentence
  $tr->close();                                ##-- close current input source

  #... or any other Moot::TokenReader method

DESCRIPTION

The Moot::TokenReader::Native module provides wrappers for native 1 word/line word- and sentence-input streams as included in the libmoot library for Hidden Markov Model decoding.

Moot::TokenReader::Native inherits from Moot::TokenReader and supports all Moot::TokenReader API methods.

File Format

 FILE       ::= SENTENCE*
 SENTENCE   ::= ((TOKEN|COMMENT)*) "\n"
 TOKEN      ::= TOKEN_TEXT ("\t" ANALYSIS)* ("\r"*) "\n"
 TOKEN_TEXT ::= [^\\t\\r\\n]*
 ANALYSIS   ::= (DETAIL*) (COST?) (DETAIL*) "[" TAG ( "]" | " " ) (DETAIL*) (COST?) (DETAIL*)
 DETAIL     ::= [^\\t\\r\\n]
 COST       ::= "<" FLOAT ">"
 COMMENT    ::= "^%%" (.*) "\n"

SEE ALSO

Moot::TokenReader::XML(3perl), Moot::TokenReader(3perl), Moot::TokenWriter(3perl), Moot::TokenIO(3perl), Moot(3perl), mootfiles(5), moot(1), perl(1).

AUTHOR

Bryan Jurish <moocow@cpan.org>

COPYRIGHT AND LICENSE

Copyright (C) 2013 by Bryan Jurish

This library is free software; you can redistribute it and/or modify it under the same terms as Perl itself, either Perl version 5.14.2 or, at your option, any later version of Perl 5 you may have available.