NAME

Moot::Waste::Scanner - libmoot : WASTE tokenizer : low-level scanner

SYNOPSIS

  use Moot::Waste::Scanner;

  ##=====================================================================
  ## Usage

  $ws = Moot::Waste::Scanner->new();  ##-- create a new scanner

  $ws->from_file($filename);          ##-- open a named file
  $tok = $ws->get_token();            ##-- read next token
  $buf = $ws->get_sentence();         ##-- read all remaining tokens as a list
  $ws->close();                       ##-- close current input source

  $ws->reset();                       ##-- reset scanner data

  #... or (almost) any other Moot::TokenReader method

DESCRIPTION

The Moot::Waste::Scanner module provides an object-oriented interface to the WASTE tokenization system's low-level rule-based segment scanner stage. Moot::Waste::Scanner inherits from Moot::TokenReader and supports all Moot::TokenReader API methods.

SEE ALSO

Moot::TokenReader(3perl), Moot::Waste(3perl), Moot(3perl), waste(1), perl(1).

AUTHOR

Bryan Jurish <moocow@cpan.org>

COPYRIGHT AND LICENSE

Copyright (C) 2013 by Bryan Jurish

This library is free software; you can redistribute it and/or modify it under the same terms as Perl itself, either Perl version 5.14.2 or, at your option, any later version of Perl 5 you may have available.