Dezi::Bot::Queue - web crawler queue
use Dezi::Bot::Queue; my $queue = Dezi::Bot::Queue->new( type => 'DBI', dsn => "DBI:mysql:database=$database;host=$hostname;port=$port", username => 'myuser', password => 'mysecret', ); my $uri = 'http://dezi.org/bot.html'; $queue->put($uri); $queue->size(); # returns number of items in queue $queue->peek; # returns $uri (next value for get()) $queue->get; # returns $uri and removes it from queue
The Dezi::Bot::Queue module adheres to the API of SWISH::Prog::Queue while optimized for persistent storage.
Returns a new Dezi::Bot::Queue object. config should be a series of key/value pairs (a hash). Supported config params are:
The backend storage type. Defaults to 'DBI' (see Dezi::Bot::Queue::DBI).
If type is DBI then the dsn value will be passed directly to the DBI->connect() method.
DBI
If type is DBI then the username value will be passed directly to the DBI->connect() method.
If type is DBI then the password value will be passed directly to the DBI->connect() method.
If type is DBI then the table_name value will be used to insert rows. Defaults to dezi_queue.
dezi_queue
If type is DBI then the quote value will be used to quote column names on insert. Defaults to false.
false
If type is DBI then the quote_char value will be used when quote is true. Defaults to backtick.
All subclasses must implement this abstract method. Called internally in new().
Get/set the name of the queue.
Add item to the queue.
Returns the next item.
Returns the next item value, but leaves it on the stack.
Returns the number of items currently in the queue.
Peter Karman, <karman at cpan.org>
<karman at cpan.org>
Please report any bugs or feature requests to bug-dezi-bot at rt.cpan.org, or through the web interface at http://rt.cpan.org/NoAuth/ReportBug.html?Queue=Dezi-Bot. I will be notified, and then you'll automatically be notified of progress on your bug as I make changes.
bug-dezi-bot at rt.cpan.org
You can find documentation for this module with the perldoc command.
perldoc Dezi::Bot
You can also look for information at:
RT: CPAN's request tracker
http://rt.cpan.org/NoAuth/Bugs.html?Dist=Dezi-Bot
AnnoCPAN: Annotated CPAN documentation
http://annocpan.org/dist/Dezi-Bot
CPAN Ratings
http://cpanratings.perl.org/d/Dezi-Bot
Search CPAN
http://search.cpan.org/dist/Dezi-Bot/
Copyright 2013 Peter Karman.
This program is free software; you can redistribute it and/or modify it under the terms of either: the GNU General Public License as published by the Free Software Foundation; or the Artistic License.
See http://dev.perl.org/licenses/ for more information.
To install Dezi::Bot, copy and paste the appropriate command in to your terminal.
cpanm
cpanm Dezi::Bot
CPAN shell
perl -MCPAN -e shell install Dezi::Bot
For more information on module installation, please visit the detailed CPAN module installation guide.