Revision history for Robots-Validate:
v0.3.7 2026-08-26 17:39:55+01:00 Europe/London (TRIAL RELEASE)
[Enhancements]
- Switch to Try::Tiny over Syntax::Keyword::Try.
[Bug Fixes]
- bad_robot now returns undef for unknown results, like validate does.
- validate returns undef for unknown IPs without user agents.
v0.3.6 2026-08-26 14:18:13+01:00 Europe/London (TRIAL RELEASE)
[Enhancements]
- User-agents are not matched against in a case-insensitive manner.
- Updated robot rules.
[Bug Fixes]
- Fixed typo in robot rules.
[Documentation]
- Documented potential rule conflicts.
- Improved documentation.
v0.3.5 2026-08-25 17:54:33+01:00 Europe/London (TRIAL RELEASE)
[Enhancements]
- This uses the pure-Perl Algorithm::AhoCorasick module, but will use Algorithm::AhoCorasick::XS if it is available.
- Added bad_robot convenience method.
- cache_failure can be set in the cache_options as a global default.
[Bug Fixes]
- Fixed regression: cache_failure overwrote the default expires_in setting.
[Documentation]
- Added recommended modules to the REQUIREMENTS section of the README.
- Fixed POD errors.
- Updated SUPPORT section errors.
[Tests]
- Add tests for pure-Perl modules only.
v0.3.4 2026-08-25 14:18:32+01:00 Europe/London (TRIAL RELEASE)
[Enhancements]
- Added the cache_failure option to invalidate.
- This changes the behaviour of caching before v0.3.0.
- Added more bots: Cotoyogi, MJ12Bot and SofyaBot.
[Documentation]
- Added missing items to Changes for v0.3.0.
- Updated KNOWN ISSUES.
v0.3.3 2026-08-24 19:40:03+01:00 Europe/London (TRIAL RELEASE)
[Enhancements]
- Updated robot rules.
- Added devel/rebuild-robots-config utility to rebuild the robot rules.
- Switched the configuration parser to use TOML::Tiny by default, but TOML::XS if it is available.
[Documentation]
- Improved documentation.
[Tests]
- Added a missing prerequsite.
- Improved tests.
v0.3.2 2026-08-23 22:11:38+01:00 Europe/London (TRIAL RELEASE)
[Security]
- Added missing initial dot to the domain suffixes for petalbot and visionheight,
which allowed an imposter domain such as fakepetalsearch.com.
[Bug Fixes]
- Fixed IPv6 DNS validation.
[Documentation]
- Removed duplicate CONTRIBUTOR.
- Documented why the initial dot for the domain suffix is important.
- Improved the SECURITY CONSIDERATIONS section.
- Updated automation policy to be "human supervised".
- Added link to TOML specification in SEE ALSO.
v0.3.1 2026-08-23 01:44:55+01:00 Europe/London (TRIAL RELEASE)
[Documentation]
- Fixed error in Changes.
v0.3.0 2026-08-23 01:36:04+01:00 Europe/London (TRIAL RELEASE)
[Incompatible Changes]
- This is a complete rewrite, and the interface is not compatible.
- Bumped minimum Perl version to v5.24;
[Enhancements]
- This uses the Aho-Corasick algorithm to match multiple user-agent strings efficiently.
- The robot rules are in a configuration file, allowing the user to easily update their own rules.
- The robot rules have been expanded and updated.
- Support for caching the results has been added, GH#3.
[Tests]
- Updated the tests to use Test2.
[Documentation]
- Updated the author email address.
- Updated the copyright year.
- Added a security policy.
[Toolchain]
- Use SigStore instead of Module::Signature to sign releases.
- Added Automation Policy and DOAP metadata.
v0.2.9 2024-01-06 13:48:11+00:00 Europe/London
[Incompatible Changes]
- Bumped minimum Perl version to v5.14.
[Enhancements]
- Improved the regex for Slurp to work with Inktomi slurp, not just Yahoo slurp.
- Added rule for DataProviderBot.
- Added rule for MonsidoBot.
- Added rule for Headline ev-crawler.
- Removed the starting wordbreak from the regexes, which should improve performance.
[Other]
- Removed Neevabot rule, since the bot seems to have shut down.
[Documentation]
- Fixed a typo.
- Updated copyright year.
v0.2.8 2023-12-13 09:12:44+00:00 Europe/London
[Enhancements]
- Updated rules for Amazonbot.
[Documentation]
- Bump copyright year.
[Tests]
- Switched package used for the release manifest.
[Toolchain]
- Sign distribution.
- Fixed MANIFEST.SKIP rules.
v0.2.7 2022-05-12 11:12:06-04:00 EST5EDT
[Enhancements]
- Added rules for Amazonbot.
[Documentation]
- Fixed encoding of links in README.
[Toolchain]
- Remove bad MANIFEST.SKIP rule.
v0.2.6 2022-02-12 11:36:55+00:00 Europe/London
[Documentation]
- Bump copyright year.
v0.2.5 2022-02-12 11:28:35+00:00 Europe/London
[Enhancements]
- Added rules for InfoTiger.
[Toolchain]
- Removed MANIFEST.SKIP builder due to issues with prerequisites.
v0.2.4 2021-06-23 17:11:21+01:00 Europe/London
[Enhancements]
- Added rules for Coc Coc bot and Qwant.
[Documentation]
- Add warning about undocumented rules.
v0.2.3 2021-06-10 11:30:13+01:00 Europe/London
[Enhancements]
- Added rules for Neevabot and PetalBot.
v0.2.2 2021-05-15 17:13:12+01:00 Europe/London
[Enhancements]
- Added rules for Archivo.pt and IONOS.
v0.2.1 2021-02-06 15:24:22+00:00 Europe/London
[Enhancements]
- Added rule for Applebot.
[Documentation]
- Update the copyright year.
v0.2.0 2020-10-12 17:50:15+01:00 Europe/London
[Enhancements]
- Allow validate to take a Plack environment hash.
v0.1.6 2019-11-16 11:05:30+00:00 Europe/London
[Enhancements]
- Added rule for SeznamBot.
- Disable strict const attributes unless running in strict mode.
[Documentation]
- Bump copyright year.
v0.1.5 2018-12-06 17:56:02+00:00 Europe/London
[Bug Fixes]
- Bumped minimum version of Types::Const to support Regexp refs.
v0.1.4 2018-12-04 10:42:31+00:00 Europe/London
[Other]
- Use stricter types for robots attribute.
v0.1.3 2018-11-07 00:01:09+00:00 Europe/London
[Documentation]
- Fix typo in abstract.
- Reformat Changes.
[Tests]
- Added actual tests.
[Other]
- Remove unused code.
- Made query type explicit.
v0.1.2 2018-11-06 20:22:07+00:00 Europe/London
[Enhancements]
- Added rules for Embedly, Exabot, LinkedIn, Mojeek, Naver/Yeti,
Pinterest, Sogou spiders.
[Documentation]
- Fixed typo.
- Added note about limitations.
[Other]
- Sorted robots.
v0.1.1 2018-11-05 21:43:45+00:00 Europe/London
[Bug Fixes]
- Specify a minimum version for List::Util.
- Update Yandex verifiction rules.
[Documentation]
- Document robot verifiction in SEE ALSO section.
v0.1.0 2018-11-05 21:29:06+00:00 Europe/London
- Initial prototype released.