The Perl Toolchain Summit needs more sponsors. If your company depends on Perl, please support this very important event.

NAME

WARC::Record::Logical - reassemble multi-segment records

SYNOPSIS

  use WARC::Record;

DESCRIPTION

This is an internal class used to implement WARC::Record objects representing continued records in WARC files. A "continued record" is also referred to as a "logical record" in the WARC specification and is a record that has one or more "continuation" records to store a data block that is too large to fit in a single WARC volume.

Note that a logical record will compare as equal to its first segment.

Methods in this class are documented as part of WARC::Record.

CAVEATS

The code for handling segmented records that are longer than Perl's integers can represent is relatively lightly tested and assumes that no individual segment is longer than an integer can represent. This will not be a problem if the recommendation to limit WARC file size to 1GB is followed, but may be an issue if larger files nonetheless use segmentation.

AUTHOR

Jacob Bachmeyer, <jcb@cpan.org>

SEE ALSO

WARC, WARC::Record

COPYRIGHT AND LICENSE

Copyright (C) 2019 by Jacob Bachmeyer

This library is free software; you can redistribute it and/or modify it under the same terms as Perl itself.