NAME

Bencher::Scenario::CPANMetaValidation - Benchmark CPAN Meta validation

VERSION

This document describes version 0.001 of Bencher::Scenario::CPANMetaValidation (from Perl distribution Bencher-Scenario-CPANMetaValidation), released on 2017-03-06.

SYNOPSIS

To run benchmark with default option:

% bencher -m CPANMetaValidation

For more options (dump scenario, list/include/exclude/add participants, list/include/exclude/add datasets, etc), see bencher or run bencher --help.

DESCRIPTION

Packaging a benchmark script as a Bencher scenario makes it convenient to include/exclude/add participants/datasets (either via CLI or Perl code), send the result to a central repository, among others . See Bencher and bencher (CLI) for more details.

BENCHMARK PARTICIPANTS

  • sah (perl_code)

    Data::Sah + Sah::Schema::cpan::meta20.

    Code template:

    state $v = Data::Sah::gen_validator("cpan::meta20*", {return_type=>"bool"}); $v->(<meta>) ? 1:0
  • cmv (perl_code)

    CPAN::Meta::Validator.

    Code template:

    my $cmv = CPAN::Meta::Validator->new(<meta>);
                                  if ($cmv->is_valid) { return 1 } else { return 0 }

BENCHMARK DATASETS

  • invalid

  • min_valid

SAMPLE BENCHMARK RESULTS

Run on: perl: v5.24.0, CPU: Intel(R) Core(TM) M-5Y71 CPU @ 1.20GHz (2 cores), OS: GNU/Linux LinuxMint version 17.3, OS kernel: Linux version 3.19.0-32-generic.

Benchmark with default options (bencher -m CPANMetaValidation):

#table1#
+-------------+-----------+-----------+-----------+------------+---------+---------+
| participant | dataset   | rate (/s) | time (μs) | vs_slowest |  errors | samples |
+-------------+-----------+-----------+-----------+------------+---------+---------+
| sah         | min_valid |      4400 |     230   |        1   | 4.8e-07 |      20 |
| cmv         | min_valid |     36000 |      27   |        8.3 | 4.3e-08 |      31 |
| cmv         | invalid   |     39000 |      25   |        8.9 |   4e-08 |      20 |
| sah         | invalid   |    430000 |       2.3 |       97   | 3.3e-09 |      20 |
+-------------+-----------+-----------+-----------+------------+---------+---------+

To display as an interactive HTML table on a browser, you can add option --format html+datatables.

HOMEPAGE

Please visit the project's homepage at https://metacpan.org/release/Bencher-Scenario-CPANMetaValidation.

SOURCE

Source repository is at https://github.com/perlancar/perl-Bencher-Scenario-CPANMetaValidation.

BUGS

Please report any bugs or feature requests on the bugtracker website https://rt.cpan.org/Public/Dist/Display.html?Name=Bencher-Scenario-CPANMetaValidation

When submitting a bug or request, please include a test-file or a patch to an existing test-file that illustrates the bug or desired feature.

AUTHOR

perlancar <perlancar@cpan.org>

COPYRIGHT AND LICENSE

This software is copyright (c) 2017 by perlancar@cpan.org.

This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself.