The Perl Toolchain Summit needs more sponsors. If your company depends on Perl, please support this very important event.

Changes for version 0.04 - 2021-03-09

  • Always call `next` method, so it can be overridden


lexer to break text up into user-defined tokens
reusable lexer for token-stream scanning
role for token-stream classes
class to model scanned tokens
types used by Text::TokenStream et al