WWW-Crawler-Mojo-0.14 - A web crawling framework for Perl - metacpan.org

30 Oct 2015 04:38:40 UTC
Browse (raw)
Changes
How to Contribute
Repository
Issues (0)
Testers (32 / 392 / 9)
Kwalitee
Bus factor: 0
88.23% Coverage
License: perl_5
Activity
24 month
Tools
Download (22.92KB)
MetaCPAN Explorer
Permissions
Subscribe to distribution
- Dependencies
- Mojolicious
- and possibly others
- Reverse dependencies
- CPAN Testers List
- Dependency graph
Permalinks
This version
Latest version
++ed by:

4 PAUSE users

1 non-PAUSE user

Keita Sugama /

WWW-Crawler-Mojo-0.14

Changes for version 0.14 - 2015-10-22

Added experimental MySQL support for queue (harshals).
Improved documentations.
Added some example codes.
Improved form submittion emulation on unselected and multi selected options.

Modules

WWW::Crawler::Mojo

A web crawling framework for Perl

WWW::Crawler::Mojo::Job

Single crawler job

WWW::Crawler::Mojo::Queue

Crawler queue base class

WWW::Crawler::Mojo::Queue::Memory

Crawler queue with memory

WWW::Crawler::Mojo::Queue::MySQL

Crawler queue with Mysql [EXPERIMENTAL]

WWW::Crawler::Mojo::ScraperUtil

Scraper utitlities

WWW::Crawler::Mojo::UserAgent

Crawler specific featured user agent

Examples

Other files

To install WWW::Crawler::Mojo, copy and paste the appropriate command in to your terminal.

cpanm WWW::Crawler::Mojo

perl -MCPAN -e shell
install WWW::Crawler::Mojo

For more information on module installation, please visit the detailed CPAN module installation guide.

	Global
`s`	Focus search bar
`?`	Bring up this help dialog

	GitHub
`g` `p`	Go to pull requests
`g` `i`	go to github issues (only if github is preferred repository)

	POD
`g` `a`	Go to author
`g` `c`	Go to changes
`g` `i`	Go to issues
`g` `d`	Go to dist
`g` `r`	Go to repository/SCM
`g` `s`	Go to source
`g` `b`	Go to file browse

	Search terms
module: (e.g. module:Plugin)
distribution: (e.g. distribution:Dancer auth)
author: (e.g. author:SONGMU Redis)
version: (e.g. version:1.00)