/ 
WWW-Crawl4AI-0.007

Changes for version 0.007 - 2026-10-25

  • do_request now raises a type=transport error (status_code 0) also for the synthetic 500 that LWP::UserAgent returns on connection failure (marked by the 'Client-Warning: Internal response' header), not only for status 599. Previously an unreachable server surfaced as type=api, status 500.
  • SYNOPSIS: enable the 'say' feature so the example runs as written
  • A redirect is not followed, a 3xx is an error that names the status, the method and the path
  • An answer that is no JSON is an error that names the status, the method and the path
  • The task id is encoded as one path segment
  • The distribution declares LWP::Protocol::https, without it every https target fails
  • The declared prerequisites are checked by a test that reads the cpanfile

Documentation

www-crawl4ai-doctor
probe Crawl4AI / CloakBrowser / proxy reachability and print the chain
www-crawl4ai-test-url
run the full WWW::Crawl4AI strategy chain against one URL

Modules

WWW::Crawl4AI
Perl client and fallback orchestrator for Crawl4AI
WWW::Crawl4AI::Attempt
one strategy attempt in a WWW::Crawl4AI fallback chain
WWW::Crawl4AI::Client
UA-agnostic REST client for the Crawl4AI Docker API
WWW::Crawl4AI::DeepCrawlIterator
breadth-first iterator for deep_crawl, separating frontier management from crawl logic
WWW::Crawl4AI::Detect
service detection and content-quality classification for Crawl4AI
WWW::Crawl4AI::Error
structured error class for WWW::Crawl4AI
WWW::Crawl4AI::Markdown
markdown field resolution across Crawl4AI response shapes
WWW::Crawl4AI::Request
builds Crawl4AI /crawl and /md request payloads
WWW::Crawl4AI::Result
normalized result of a WWW::Crawl4AI strategy chain
WWW::Crawl4AI::Strategy
role for a single crawl strategy in the WWW::Crawl4AI fallback chain
WWW::Crawl4AI::Strategy::Browser
Crawl4AI strategy with full JS rendering (wait for networkidle)
WWW::Crawl4AI::Strategy::Callback
last-resort Crawl4AI strategy delegating to a user coderef
WWW::Crawl4AI::Strategy::CloakBrowser
Crawl4AI strategy attaching to CloakBrowser over CDP
WWW::Crawl4AI::Strategy::Plain
cheapest Crawl4AI strategy - headless text mode, no escalation
WWW::Crawl4AI::Strategy::Proxy
Crawl4AI strategy routing through a configured proxy
WWW::Crawl4AI::Strategy::Stealth
Crawl4AI strategy with enable_stealth and randomized fingerprint
WWW::Crawl4AI::StrategyChain
ordered list of strategy objects, pluggable at construction time

Examples

Other files