The Perl Toolchain Summit needs more sponsors. If your company depends on Perl, please support this very important event.

NAME

WebService::GoogleHack::Text - This module implements some basic text processing such as parsing data etc.

SYNOPSIS

    use WebService::GoogleHack::Text;

    #create an object of type Text

    my $text = GoogleHack::Text->new(); 

    # returns an hash words

    %results=$text->getWords("file location");

    # returns an hash of 3 word sentences

    %results=$text->getSentences("file location", 3); 

    # this function reads the configuration file

    %results=$text->readConfig("location of configuration file");

    #removes HTML tags

    %results=$text->removeHTML("string");

DESCRIPTION

This is a simple Text processing package which aids GoogleHack and Rate modules. Given a file of words, it retreives the words in the file and stores it in a simple hash format. In addition, given a file of text, it can also form n word sentences.

PACKAGE METHODS

__METHOD__->new()

Purpose: This function creates an object of type Text and returns a blessed reference.

__METHOD__->init(Params Given Below)

Purpose: This this function can used to inititalize the member variables.

Valid arguments are :

  • key

    string. key to the google-api

  • wsdl_location

    string. This the wsdl file name

  • basedir

    string. The base directory of Google Hack.

  • taggerdir

    string. The location of the Brill Tagger

__METHOD__->getSentences(file_name,sentence_length,trace_file)

Purpose: Given a file of text or a variable containing text, this function tries to retrieve sentences from it.

Valid arguments are :

  • file_name

    string. Name of file to retrieve sentences from.

  • sentence_length

    Number. Number of words in a sentence.

  • trace_file.

    string. The location of the trace file. If a file_name is given, the results are stored in this file

Returns: Returns an array of strings.

__METHOD__->getSentences(file_name,trace_file)

Purpose:Given a file of text this function tries to retrieve words from it.

Valid arguments are :

  • file_name

    string. Name of file to retrieve sentences from.

  • trace_file.

    string. The location of the trace file. If a file_name is given, the results are stored in this file

Returns: Returns a hash of words.

__METHOD__->getSentences(text)

Purpose: Remove XML tags. Package XML::TokeParser must be installed

Valid arguments are :

  • text

    string. The text to be de-tagged.

Returns: Returns a XML less text.

__METHOD__->getSentences(text)

Purpose: Remove HTML tags. Package HTML::TokeParser must be installed

Valid arguments are :

  • text

    string. The text to be de-tagged.

Returns: Returns a HTML less text.

__METHOD__->getSurroundingWords(filename,stemmer)

Purpose: this function is used to read a configuration file containing informaiton such as the Google-API key, the words list etc.

Valid arguments are :

  • filename

    string. Location of the configuration file.

  • stemmer.

    bool. Porter Stemmer on or off.

returns : Returns an object which contains the parsed information.

__METHOD__->readConfig(filename)

Purpose: this function is used to read a configuration file containing informaiton such as the Google-API key, the words list etc.

Valid arguments are :

  • filename

    string. Location of the configuration file.

returns : Returns an object which contains the parsed information.

AUTHOR

Pratheepan Raveendranathan, <rave0029@d.umn.edu>

Ted Pedersen, <tpederse@d.umn.edu>

BUGS

SEE ALSO

GoogleHack home page - http://google-hack.sourceforge.net

Pratheepan Raveendranathan - http://www.d.umn.edu/~rave0029/research

Ted Pedersen - www.d.umn.edu./~tpederse

Google-Hack Maling List <google-hack-users@lists.sourceforge.net>

AUTHOR

Pratheepan Raveendranathan, <rave0029@d.umn.edu>

Ted Pedersen, <tpederse@d.umn.edu>

COPYRIGHT AND LICENSE

Copyright (c) 2005 by Pratheepan Raveendranathan, Ted Pedersen

This program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation; either version 2 of the License, or (at your option) any later version.

This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.

You should have received a copy of the GNU General Public License along with this program; if not, write to

The Free Software Foundation, Inc., 59 Temple Place - Suite 330, Boston, MA 02111-1307, USA.