- String::Tokenizer - A simple string tokenizer.
- String::Tokenizer::Iterator in lib/String/Tokenizer.pm
Changes for version 0.05
- added support for whitespace tokens, feature requested by Stephan Tobias.
- added tests for this
- added documenation for this
- fixed bug where the '0' token got ignored, also thanks to Stephan Tobias for this.