2000-02-26 Kingpin <mthurn@tasc.com>
* WWW::Search VERSION 2.10 RELEASED!
2000-02-25 Kingpin <mthurn@tasc.com>
* lib/WWW/Search.pm (reset_search): new function. New feature: if
you call native_query() a second time on the same WWW::Search
object, a new search will be started. (Before this change, you
would get the results of the first query all over again)
2000-02-24 Kingpin <mthurn@tasc.com>
* lib/WWW/Search/Dejanews.pm et al.: removed to their own separate registered module
2000-02-15 Kingpin <mthurn@tasc.com>
* lib/WWW/Search/AltaVista/Intranet.pm (native_retrieve_some): parse Rank integer
2000-02-08 Kingpin <mthurn@tasc.com>
* WWW::Search VERSION 2.09 RELEASED!
2000-02-07 Kingpin <mthurn@tasc.com>
* WebSearch: new option --gui to mimic query in browser
2000-02-04 Kingpin <mthurn@tasc.com>
* lib/WWW/Search/OpenDirectory.pm: updated to 2.02
* lib/WWW/Search/Yahoo.pm: removed to its own separate registered module
2000-02-01 Kingpin <mthurn@tasc.com>
* lib/WWW/Search.pm (maintainer): new method
2000-01-31 Kingpin <mthurn@tasc.com>
* lib/WWW/Search/Test.pm: new module
* lib/WWW/Search/Magellan.pm: updated to 2.04 (new test cases)
2000-01-28 Kingpin <mthurn@tasc.com>
* lib/WWW/Search/Excite.pm: removed to its own separate registered module
2000-01-19 Kingpin <mthurn@tasc.com>
* lib/WWW/Search.pm (gui_query): new method
* lib/WWW/Search/HotBot.pm: removed to its own separate registered module
2000-01-18 Kingpin <mthurn@tasc.com>
* lib/WWW/Search/Dejanews.pm: updated to 2.07 (new output format)
2000-01-14 Kingpin <mthurn@tasc.com>
* lib/WWW/Search/Euroseek.pm: new backend
2000-01-13 Kingpin <mthurn@tasc.com>
* lib/WWW/Search/Snap.pm: updated to 2.03
* lib/WWW/Search/Google.pm: updated to 2.16
2000-01-03 Kingpin <mthurn@tasc.com>
* Lycos::Sites retired
* Lycos.pm updated to 2.09 (thanks to dbradford@bdctechnologies.com)
1999-12-24 Kingpin <mthurn@tasc.com>
* WWW::Search VERSION 2.08 RELEASED!
1999-12-23 Kingpin <mthurn@tasc.com>
* Google.pm updated to 2.15 (return more details for each result)
1999-12-22 Kingpin <mthurn@tasc.com>
* HotBot.pm updated to 2.10 (new output format)
* Lycos::Pages retired
* Lycos.pm updated to 2.08 (new URL for advanced search)
1999-12-15 Kingpin <mthurn@tasc.com>
* Profusion.pm retired
* HotBot.pm updated to 2.09 (handle new result count format)
* Google.pm updated to 2.12 (new output format, etc.)
1999-12-13 Kingpin <mthurn@tasc.com>
* Yahoo::Classifieds::Employment updated to 1.01 (remove unneeded 'use Socket')
* Monster updated to 1.01 (remove unneeded 'use Socket')
* HeadHunter updated to 1.01 (remove unneeded 'use Socket')
1999-12-11 Kingpin <mthurn@tasc.com>
* WWW::Search VERSION 2.07 RELEASED!
1999-12-10 Kingpin <mthurn@tasc.com>
* Magellan.pm updated to 2.03 (new test cases)
* Lycos::Sites.pm updated to 2.05 (fix for missing 'next' link)
* HotBot.pm updated to 2.08 (was missing next-page link)
* Dejanews.pm updated to 2.06 (ignore more deja-internal links)
* SearchResult.pm updated to 2.06 (pod additions & corrections)
* Infoseek.pm updated to 2.05 (handles new output format)
* Lycos.pm updated to 2.07 (handles new output format)
1999-12-07 Kingpin <mthurn@tasc.com>
* Dejanews.pm updated to 2.05 (new test cases, and pod typo)
1999-12-06 Kingpin <mthurn@tasc.com>
* Dejanews.pm updated to 2.04 (handles new output format)
1999-12-03 Kingpin <mthurn@tasc.com>
* Makefile.PL modified for new test suite call sequence
* NetFind.pm updated to 1.8
* Lycos::Sites.pm updated to 2.05 (handles new url and new output format)
* Lycos.pm updated to 2.05 (handles new output format for Lycos::Sites)
1999-12-01 Kingpin <mthurn@tasc.com>
* WWW::Search VERSION 2.06 RELEASED!
1999-11-30 Kingpin <mthurn@tasc.com>
* ZDNet.pm updated to 2.02 (handles new output format)
1999-11-29 Kingpin <mthurn@tasc.com>
* AltaVista::Intranet.pm updated to 2.02 (fixed to work with latest AltaVista.pm)
1999-11-22 Kingpin <mthurn@tasc.com>
* Yahoo.pm updated to 2.06 (supports Yahoo Korea)
1999-11-12 Kingpin <mthurn@tasc.com>
* HotBot.pm updated to 2.07 (clean up and fix regexen)
1999-11-08 Kingpin <mthurn@tasc.com>
* Span.pm updated to 2.03
* NorthernLight.pm updated to 2.04 (strip tags, etc.)
1999-11-05 Kingpin <mthurn@tasc.com>
* MetaCrawler.pm fixed, renamed, and updated to 2.06
* GoTo.pm updated to 1.05
1999-10-29 Kingpin <mthurn@tasc.com>
* AltaVista.pm updated (handles new output format)
1999-10-22 Kingpin <mthurn@tasc.com>
* Lycos.pm updated to 2.04 (use strip_tags, and extract real URL
from www.lycos.com's redirection URL)
1999-10-20 Kingpin <mthurn@tasc.com>
* Excite.pm updated to 2.03 (fixed parser for new output format,
and now strips tags out of title and description)
1999-10-18 Kingpin <mthurn@tasc.com>
* GoTo.pm updated to 1.04 (now uses source field of SearchResult)
* new backend Dice.pm for searching jobs at www.dice.com
* new backend AOL::Classifieds::Employment
* new backend AltaVista::Careers
* new backend Yahoo::Classifieds::Employment
* new backend Monster.pm for searching jobs at jobsearch.monster.com
* new backend HeadHunter.pm for searching jobs at www.headhunter.net
* Google.pm updated to 2.09 (fixed parser for new output format)
* HotBot.pm updated to 2.06 (strip tags, and new output format)
1999-10-14 Kingpin <mthurn@tasc.com>
* Yahoo.pm updated to 2.05 (strip tags, ignore newsgroups)
* Fireball.pm updated to 2.00 (fixed)
1999-10-13 Kingpin <mthurn@tasc.com>
* WWW::Search VERSION 2.05 RELEASED!
1999-10-12 Kingpin <mthurn@tasc.com>
* Google.pm updated to 2.06 (fixed parser for new output format)
1999-10-11 Kingpin <mthurn@tasc.com>
* Yahoo.pm updated to 2.04 (fixed parser for new output)
* NetFind.pm updated to 1.5 (fixed parser for new output format)
1999-10-08 Kingpin <mthurn@tasc.com>
* new fields in WWW::SearchResult (company, location, source)
* cleaned up output of test.pl (again)
* WebSearch now prints error messages to STDERR instead of STDOUT, and only prints "Nothing found." in verbose mode
1999-10-05 Kingpin <mthurn@tasc.com>
* Yahoo.pm updated to 2.03 (use hash_to_cgi_string)
* WebCrawler.pm updated to 2.02 (use hash_to_cgi_string)
* Magellan.pm updated to 2.02 (use hash_to_cgi_string)
* Lycos.pm updated to 2.03 (use hash_to_cgi_string)
* LookSmart.pm updated to 2.02 (fixed)
* Infoseek.pm updated to 2.05 (fix parser for Companies and News searches, and use hash_to_cgi_string)
* HotBot.pm updated to 2.05 (new test cases and uses hash_to_cgi_string)
* Excite::News.pm updated to 2.02 (fix parser)
* Excite.pm updated to 2.02 (use hash_to_cgi_string)
* Dejanews.pm updated to 2.03 (use hash_to_cgi_string)
* new method WWW::Search::hash_to_cgi_string to control construction of parameter lists
1999-10-04 Kingpin <mthurn@tasc.com>
* fixed pod2man error in NetFind.pm pod
1999-10-02 Kingpin <mthurn@tasc.com>
* AltaVista.pm updated (gets approximate_result_count better now)
* Search.pm updated (no longer screws up if
approximate_result_count is called before parsing any results)
1999-10-01 Kingpin <mthurn@tasc.com>
* WWW::Search VERSION 2.04 RELEASED!
1999-09-30 Kingpin <mthurn@tasc.com>
* cleaned up the output of `make test`
1999-09-29 Kingpin <mthurn@tasc.com>
* new module Lycos::Sites.pm for searching Lycos categorized sites
* new module Lycos::Pages.pm for searching Lycos indexed web pages
* Lycos.pm updated to 2.02 to recognize Sites searches
* Yahoo.pm updated to 2.02 (new test cases, and pod update)
* Infoseek.pm updated to 2.03
(handle \n in descriptions and ignore "company profile" URLs)
1999-09-28 Kingpin <mthurn@tasc.com>
* Infoseek.pm updated to 2.02 (fixed "next" page URL parsing)
* WebSearch has a new option --debug to turn on debugging in backends
* WebSearch has a new option --lwpdebug to turn on low-level LWP debugging
1999-09-27 Kingpin <mthurn@tasc.com>
* Google.pm updated to 2.05
* Metapedia.pm updated to 2.06
1999-09-22 Kingpin <mthurn@tasc.com>
* GoTo.pm updated to 1.03 (format change, URL unencryption fixed)
* WebSearch pod reflects long option names
1999-09-20 Kingpin <mthurn@tasc.com>
* NetFind.pm updated to 0.7 (AOL moved/merged their search services)
1999-09-17 Kingpin <mthurn@tasc.com>
* Dejanews.pm updated to version 2.02 (fixed URL parsing)
* new backend Deja.pm for searching www.deja.com
1999-09-15 Kingpin <mthurn@tasc.com>
* new backend GoTo.pm for searching www.goto.com
* WebSearch has a new option --count to show the approximate_result_count
1999-09-13 Kingpin <mthurn@tasc.com>
* `make test -u` now deletes existing test files before updating
* NorthernLight.pm updated to version 2.03 (fixed URL parsing)
1999-09-09 Kingpin <mthurn@tasc.com>
* new backend NetFind.pm for searching netfind2.aol.com
1999-09-07 Kingpin <mthurn@tasc.com>
* extraneous warnings removed from AutoSearch
1999-08-19 Kingpin <mthurn@tasc.com>
* WWW::Search VERSION 2.03 RELEASED!
1999-08-18 Kingpin <mthurn@tasc.com>
* AutoSearch updated to version 2.01, with new command-line arguments -host and -port
* AutoSearch now allows multiple -options arguments with the same key
1999-08-16 Kingpin <mthurn@tasc.com>
* complete package tested with ActivePerl 519 in WinNT
* It finally happened! Our "Bogus" query string is starting to
appear in web archives and is being indexed by search engines.
Therefore, the "Bogus" query string now contains some "random"
numbers so that it can never be indexed.
1999-08-09 Kingpin <mthurn@tasc.com>
* WebSearch now allows long command-line argument names with double-minus
* WebSearch updated to version 2.04, with new command-line arguments --host and --port
* WebSearch now allows multiple --options arguments with the same key
1999-08-01 Kingpin <mthurn@tasc.com>
* WebSearch now has its own VERSION number
1999-07-23 Jim Smyser
* NorthernLight.pm updated to 2.02 (fix description parsing)
1999-07-16 Kingpin <mthurn@tasc.com>
* complete package tested with ActivePerl 517 in Win98
1999-07-14 Kingpin <mthurn@tasc.com>
* WWW::Search VERSION 2.01 RELEASED!
1999-07-13 Kingpin <mthurn@tasc.com>
* various cleanups in test.pl
* All backends with their own version numbers have been bumped up
to 2.01 (this is to clean up the CPAN database)
* Makefile.PL and the test suite now work in Win32
* all test cases updated for all working backends; test cases
eliminated for known broken backends
* NorthernLight.pm updated
* new backend Google.pm for searching www.google.com
* new backend OpenDirectory.pm for searching search.dmoz.org
1999-07-09 Kingpin <mthurn@tasc.com>
* Infoseek.pm updated to version 1.18; warnings removed
* new backend LookSmart.pm for searching looksmart.com
1999-07-06 Kingpin <mthurn@tasc.com>
* Dejanews.pm updated to version 1.12; now uses www.deja.com;
adheres to new test mechanism
* AltaVista/AdvancedWeb.pm updated to version 2.01
1999-07-02 Kingpin <mthurn@tasc.com>
* ZDNet.pm FIXED and updated to version 1.03
* NorthernLight.pm FIXED and updated to version 1.05
1999-07-01 Kingpin <mthurn@tasc.com>
* WWW::Search VERSION 1.025 RELEASED!
1999-06-30 Kingpin <mthurn@tasc.com>
* WebCrawler.pm updated to version 1.14; adheres to new test mechanism
* Infoseek.pm now strips HTML from titles and descriptions
* Infoseek/Companies.pm updated to version 1.10; adheres to new test mechanism
* Infoseek/News.pm updated to version 1.09; adheres to new test mechanism
* Infoseek/Web.pm updated to version 1.10; adheres to new test mechanism
* new exported function strip_tags()
1999-06-29 Kingpin <mthurn@tasc.com>
* Excite.pm updated to version 1.11; adheres to new test mechanism
* new test mechanism puts list of test cases into each module's
code (no more duplicate test code!)
* Infoseek.pm updated to version 1.14; Companies and News searches fixed
1999-06-28 Kingpin <mthurn@tasc.com>
* test/test.pl is more informative about errors
* Infoseek.pm updated to version 1.13
1999-06-24 Kingpin <mthurn@tasc.com>
* Profusion.pm updated to version 1.05
* OpenDirectory.pm updated
1999-06-22 Kingpin <mthurn@tasc.com>
* The version method is now implemented within the WWW::Search
module, so backends no longer need to declare it locally
* Snap.pm updated
1999-06-21 Kingpin <mthurn@tasc.com>
* NorthernLight.pm updated; now returns score and date for each hit
* new backend AltaVista::Intranet
* HotBot.pm updated; now unescapes URLs before returning them
=====================================
RELEASE HISTORY (moved here from the README file):
1.002: (11 October 1996)
- First public release.
1.004: (31 October 1996)
- new: AutoSearch, a client application (see below for details)
- new: WWW::Search is now in CPAN (see GETTING WWW::Search for details)
- bug fix: installation problem (no rule to make CLIENTS/search) fixed
1.005: (12 November 1996)
- new: back-ends for HotBot, Lycos, and several AltaVista variants
- new: application support for search-engine selection
- new: application and library support for search-engine options
1.006: (25 November 1996)
- private beta release, see 1.007 for list of new features
1.007: (17 December 1996)
- new: back-ends for Dejanews (from Cesare Feroldi de Rosa),
Infoseek (also from Cesare Feroldi de Rosa),
and Excite (from GLen Pringle)
- new: more fields in SearchResult (score, dates, etc., see the man page)
(problem found by Cesare Feroldi de Rosa)
- new: better error handling on network failures
(AutoSearch should report errors on its pages,
$search->response() provides an API for error reporting)
- new (internal): user_agent handling has changed
- new: proxy support added to WWW::Search (still needed in applications)
(problem and fix suggested by T. V. Raman)
- bug-fix: numerous documentation updates
(problems found by Larry Virden)
- bug-fix: AltaVista web search was occasionally dropping hits
(problem found by Larry Virden, fixed by Bill Scheding)
- bug-fix: all non-alphanumeric characters are now escaped
(problem found by Larry Virden)
1.008: (8 January 1997)
- private alpha release, see 1.009 for list of new features
1.009: (14 January 1997)
overview: 1.009 is primarily a maintenance release to accommodate
changes to LWP and some search engines.
- change: search application renamed WebSearch (a more specific name)
- bug-fix: the WWW::Search error in formatting is fixed
(problem found by Larry Virden, fix by him and johnh)
- bug-fix: RobotUA handling updated for new LWP in Search.pm
- bug-fix: update for Infoseek (page format changed about 1 Jan 97)
(problem found by Joseph McDonald, fix by Cesare Feroldi de Rosa)
- bug-fix: update for Excite (page format changed about 9 Jan 97)
(problem found by Juan Jose Amor, fix by GLen Pringle)
1.010: (20 August 1997)
overview: an interim release to fix AltaVista
- new: normalized_score, a back-end independent score (from Paul Lindner)
- new: generic options are supported by several back-ends
(specify search engine URL, debugging, etc.)
- new: AltaVista back-end now sets SearchResult::raw
- bug-fix: update for AltaVista (page format changed Jul 97)
(some information wrt fix provided by Guy Decoux)
1.011: (8 October 1997)
- internal alpha release, see 1.012 for list of new features
1.012: (3 November 1997)
- Overview: an alpha release for test-suite testing
- new: for testing, HTTP results can be saved to disk and played back
- new: test scripts (try "make test")
- bug-fix: Lycos works again and is now maintained by John Heidemann
- bug-fix: AltaVista advanced and news searches have been repaired
- bug-fix: some uninitialized value warnings suppressed
(fix suggested by R. Chandrasekar (Mickey))
- new: new back-ends PLweb
- new: documentation for PLweb (contributed by Paul Linder)
- new: new back-ends: Gopher, Simple (contributed by Paul Linder)
- new: WWW::Search mailing list:
to subscribe, send "subscribe info-www-search" as
the body of a message to <info-www-search-request@isi.edu>
1.013, (19 February 1998)
overview: this is an alpha release to include Martin's new back-ends
- bug fix: HotBot back-end updated by Martin Thurn <mthurn@tasc.com>
- new: Yahoo back-end now works, by Martin Thurn <mthurn@tasc.com>
- problem: several back-ends don't work (Lycos)
- problem: several back-ends don't have test suites and
so may or may not work (DejaNews, Excite, HotBot, Infoseek, PLweb,
SFgate, Verity, Yahoo)
- reminder: WWW::Search mailing list:
to subscribe, send "subscribe info-www-search" as
the body of a message to <info-www-search-request@isi.edu>
1.014, (24 March 1998)
overview: this is an alpha release to fix the AltaVista/Lycos back-ends
- bug fix: AltaVista/Lycos back-ends
(problem reported by Bilal Siddiqui <bilal.siddiqui@mankato.msus.edu>)
- known problem: some back-end test suites give intermittent results
(AltaVista::News)
- problem: several back-ends don't have test suites and
so may or may not work (DejaNews, Excite, HotBot, Infoseek, PLweb,
SFgate, Verity, Yahoo)
1.015, (2-Apr-98)
overview: this is an alpha release with several new back-ends
- new: back-ends: Magellan, WebCrawler (thanks to Martin Thurn)
- bug fix: Yahoo/HotBot/Excite back-ends,
with test suites. Many thanks to Martin Thurn.
- bug fix: AltaVista news test suites have been relaxed,
even though the code worked before, the test suites
used to report false negatives.
- bug fix: AltaVista is now more careful to detect the end of
a hit's raw HTML
- new: the test suite has been enhanced to be less sensitive
to changes in what's indexed
- problem: several back-ends don't have test suites and
so may or may not work (DejaNews, Infoseek, PLweb,
SFgate, Verity)
- reminder: WWW::Search mailing list:
to subscribe, send "subscribe info-www-search" as
the body of a message to <info-www-search-request@isi.edu>
1.016, 21-May-98
overview: this is an alpha to fix HotBot/Infoseek
- bug fix: Infoseek/HotBot back ends now work again.
(HotBot problem reported by Alan McCoy <a.r.mccoy@larc.nasa.gov>,
both back-ends fixed by Martin Thurn)
- addition: Infoseek test suite
- addition: test output now includes the version number
1.017, 27-May-98
overview: this is the public release since 1.012
- bug fix: Lycos bug fix
1.018, 31-May-98
overview: back-end updates
- bug fix: Excite and WebCrawler (by Martin Thurn),
AltaVista (by John Heidemann)
updated 30-May-98
- known bugs: WWW::Search doesn't work on MacPerl because of
end-of-line differences. A fix for this problem is in
progress. (Problem identified and fix suggested by
Chris Nandor.)
1.019, 25-Jun-98
overview: back-end updates
- bug fix: test suite bugs were causing false negatives on
Yahoo, Excite, Magellan, WebCrawler (reported by Martin Thurn,
fixed John Heidemann)
- new feature: the test suite is now run daily (automatically).
Output can be found at
<http://www.isi.edu/~johnh/WORK/LSAM/WWW_SEARCH/>.
- new feature: verbose mode of WebSearch is more verbose
- bug fix: AltaVista was recording the RealName URL on some queries
(bug reported by Vassilis Papadimos <vpapad@dblab.ece.ntua.gr>)
- bug fix: AltaVista wasn't correctly reporting change_time/size
(bug and fix from Martin Valldeby <martin.valldeby@pakom.se>)
1.020, 12-Aug-98
overview: lots of bug fixes and new back-ends
- bug fix: maximum_to_retrieve now works for very small values.
(Problem identified by Vidyut Luther <vluther@hpctc.org>.)
- new back-ends: ExciteForWebServers, FolioViews, Livelink, MSIndexServer,
Null, Search97
all from Paul Lindner (thanks!)
- bug fix: Gopher, PLweb, SFgate, Simple, Verity from Paul Lindner
- bug fix: Lycos from John Heidemann
- new test suites: PLweb, FolioViews, Null, MSIndexServer, Search97,
SFgate, ExciteForWebServers rom Paul Lindner
- bug fix: HotBot repair from Martin Thurn
1.021, 27-Aug-98
overview: a general release
- new: Windows installation is now supported by
Jim Smyser <jsmyser@bigfoot.com>; please see his web
page <http://pubinfo.phx.primenet.com/www.search/>
for details.
- new: MacPerl should now be supported. Thanks to Chris Nandor
for the problem and a fix.
- bug fix: Infoseek, WebCrawler, Dejanews, HotBot by Martin Thurn
- bug fix: AltaVista approx_count bug found by
Darren Stalder <darren@u.washington.edu>
- bug fix: documentation cleanups from Neil Bowers
1.022, 16-Oct-98
overview: An interim release to fix several broken back-ends.
- bug fix: documentation cleanups from Ave Wrigley
- bug fix: Infoseek updates (from Martin Thurn)
- bug fix: AltaVista update (minor format changes Oct. 1998,
partial fix from Andreas Borchert)
- new: back ends for Crawler, Fireball, NorthernLight from Andreas Borchert
1.024, 11-Dec-98
overview: primarily bug fixes for back ends
- new: proxy support added to WebSearch and AutoSearch
(based on code from Paul Linder)
- new: new back end for Snap.com (from Jim Smyser)
- bug fix: Yahoo, HotBot, Excite, Lycos (from Martin Thurn),
NorthernLight (from Jim Smyser)