WWW::Crawler::Mojo::Queue::Memory - Crawler queue with memory
Crawler queue with memory.
This class inherits all methods from WWW::Crawler::Mojo::Queue and implements following new ones.
Capacity of queue, indecating how many jobs can be kept in queue at a time. If you enqueue over capacity, the oldest job will be automatically disposed.
jobs.
A hash ref in which the class keeps DONE flags for each jobs in order to avoid to perform resembling jobs multiple times.
# Mark a job as DONE $queue->redundancy_storage->{$job->digest} = 1; # Delete the mark delete($queue->redundancy_storage->{$job->digest});
This class inherits all methods from WWW::Crawler::Mojo::Queue class and implements following new ones.
Implementation for WWW::Crawler::Mojo::Queue interface.
Keita Sugama, <sugama@jamadam.com>
Copyright (C) Keita Sugama.
This program is free software; you can redistribute it and/or modify it under the same terms as Perl itself.
To install WWW::Crawler::Mojo, copy and paste the appropriate command in to your terminal.
cpanm
cpanm WWW::Crawler::Mojo
CPAN shell
perl -MCPAN -e shell install WWW::Crawler::Mojo
For more information on module installation, please visit the detailed CPAN module installation guide.