Revision history for Perl extension RTF::Tokenizer.

1.06		Mon Jan 05 18:00:00 2004	
	- Fixed some brainos with tests, and skipping if IO::Scalar wasn't
			installed.
	- Corrected this file...

1.05    Mon Oct 27 13:00:00 2003
	* Added the ability to return tokens, to make XML::RTF::SAX a little
            more sane. See the docs for details.
	* Removed the syntax-highlighting modules from the core (will be
			released seperately)
	

1.04	Fri Oct 03 18:30:00 2003
	* Removed all the cruft added in 1.03 (signatures, Module::Build)
	* Added syntax-highlighting modules
	* Reworked eg/ - added rtfdiff, removed rtf2rtf, renamed rtfdump
	* Support for \uc
	* Added optional differentiation between control words and escapes
	- Bunch more tests

1.03    Never released... 
	* Use Module::Build
	* Sign the distro...
	- Recovery will go to either group

1.02   Sun Aug 31 16:10:00 2003
	* We now try to recover from badly-formed control words, meaning
	    that embeded file paths no longer cause fatal errors.
	* Escaped tabs now return '\tab'
	* Tabs are now handled correctly in text
	* \; returns an error, but no longer a fatal one
	* Text that spans multiple lines is now treated as one token
	- Removed remnants of TODO list from module...

1.01   Sun Apr 10 22:00:00 2003
	* We no longer trash $/, which is good
	* The tokenizer can be sub-classed! Yay!
	* \bin data now handled
	* new() can now invoke read_file and read_string
	* IO::File objects now accepted in read_file()
	- Added some debugging to read_file() to catch weirdness
	- Sanitized regular expressions
	- Created the _get_line() subroutine
	- Corrected documentation about read_file() behaviour
	- Stopped the {_BUFFER} being overwritten on read
	- Various bits of POD cleaned up
	- Ability to control how many characters are read determining IRS
	- Removed IO::Scalar dependency
	- Added numerous new tests (mainly to tests above features)


1.00   Wed Mar 26 14:00:00 2003
	- Complete internal rewrite
	- Removal of RTF::Tokenizer::FontTable
	- Removal of RTF::Tokenizer::ControlWords
	- Removal of bookmark() function
	- Removal of jump_to_control_word() function
	- Control symbols and entities are now correctly handled
		as control words, which removes the need for an
		entity handler.

0.04   Mon Mar 10 14:00:00 2003 (never released)
	- Carry RTF::Tokenizer::ControlWords, a Control Word glossary

0.03   Thu Oct 17 21:25:00 2002
	- Now we handle unprintables (like non-breaking spaces)

0.02.1 Mon Oct  7 10:02:00 2002
	- Corrected a mistake in the README
	- Fixed versions to be correct
	- Re-added a MANIFEST file(!)

0.02  Wed Jul  3 12:09:09 2002
	- Fixed some bugs
	- Added some more documentation
	- Added rtf2css.pl, an example script
	- Added RTF::Tokenizer::FontTable, to pull font table info into
	    a data structure.

0.01  Mon Jul  1 12:00:00 2002
	- original version; created by h2xs 1.19