Daisuke Maki
and 1 contributors

NAME

site-crawler.pl - Crawl Within A Specific Site

SYNOPSIS

  site-crawler.pl [path]

DESCRIPTION

This example crawls within the given site, looking for any links that might be found within the pages.

It will only look at HTML pages that reside under the url given in the command line

Please note that this crawler will NOT terminate by itself at this point (it's an example toy!). You need to CTRL-C yourself