Daisuke Maki
and 1 contributors


site-crawler.pl - Crawl Within A Specific Site


  site-crawler.pl [path]


This example crawls within the given site, looking for any links that might be found within the pages.

It will only look at HTML pages that reside under the url given in the command line

Please note that this crawler will NOT terminate by itself at this point (it's an example toy!). You need to CTRL-C yourself