NAME

WWW::Crawler::Mojo::Job - Single crawler job

SYNOPSIS

    my $job = WWW::Crawler::Mojo::Job->new;

DESCRIPTION

This class represents a single crawler job.

ATTRIBUTES

literal_uri

resolved_uri

referrer

depth

additional_props

Add propeties for job.

    $job->additional_props({key1 => $value1, key2 => $value2});

redirect_history

METHODS

child

Initiate a child job by parent job. The parent uri is set to child referrer.

    my $job1 = WWW::Crawler::Mojo::Job->new(resolved_uri => 'http://a/1');
    my $job2 = $job1->child(resolved_uri => 'http://a/2');
    say $job2->referrer # 'http://a/1'

add_props

redirect

Replaces the resolved URI and history at once.

    my $job = WWW::Crawler::Mojo::Job->new;
    $job->resolved_uri($url1);
    $job->redirect($url2, $url3);
    say $job->resolved_uri # $url2
    say $job->redirect_history # [$url1, $url3]

AUTHOR

Sugama Keita, <sugama@jamadam.com>

COPYRIGHT AND LICENSE

Copyright (C) Sugama Keita.

This program is free software; you can redistribute it and/or modify it under the same terms as Perl itself.