KinoSearch::Analysis::Analyzer - base class for analyzers
# abstract base class -- you probably want PolyAnalyzer, not this.
In KinoSearch, an Analyzer is a filter which processes text, transforming it from one form into another. For instance, an analyzer might break up a long text into an array of tokens, or it might convert text to lowercase.
At this time, public subclassing of Analyzer is not supported. If that is to happen, the problem of how to store a collection of tokens both efficiently and elegantly must be solved. An array of tokens, each of which is a hash-based object, is elegant but not efficient. The current scheme is efficient but not elegant.
Copyright 2005-2006 Marvin Humphrey
See KinoSearch version 0.09.