Bencher::Scenario::AppSorted - Benchmark sorted vs is-sorted
This document describes version 0.002 of Bencher::Scenario::AppSorted (from Perl distribution Bencher-Scenario-AppSorted), released on 2021-07-31.
To run benchmark with default option:
% bencher -m AppSorted
To run module startup overhead benchmark:
% bencher --module-startup -m AppSorted
For more options (dump scenario, list/include/exclude/add participants, list/include/exclude/add datasets, etc), see bencher or run bencher --help.
bencher --help
Packaging a benchmark script as a Bencher scenario makes it convenient to include/exclude/add participants/datasets (either via CLI or Perl code), send the result to a central repository, among others . See Bencher and bencher (CLI) for more details.
Version numbers shown below are the versions used when running the sample benchmark.
App::sorted 0.002
File::IsSorted 0.0.6
sorted (command)
Command line:
#TEMPLATE: sorted <filename>; true
is-sorted (command)
#TEMPLATE: is-sorted check <filename>; true
100k-sorted
100k-unsorted-middle
100k-unsorted-beginning
Run on: perl: v5.34.0, CPU: Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz (4 cores), OS: GNU/Linux LinuxMint version 19, OS kernel: Linux version 5.3.0-68-generic.
Benchmark command (default options):
Result formatted as table:
#table1# | participant | dataset | rate (/s) | time (ms) | pct_faster_vs_slowest | pct_slower_vs_fastest | errors | samples | |-------------+-------------------------+-----------+-----------+-----------------------+-----------------------+---------+---------| | sorted | 100k-sorted | 8.1 | 120 | 0.00% | 96.99% | 0.0011 | 7 | | sorted | 100k-unsorted-middle | 10 | 98 | 27.06% | 55.04% | 0.00018 | 7 | | sorted | 100k-unsorted-beginning | 13 | 75 | 64.21% | 19.97% | 0.00029 | 8 | | is-sorted | 100k-sorted | 13 | 75 | 65.08% | 19.33% | 0.00031 | 7 | | is-sorted | 100k-unsorted-middle | 14 | 70 | 77.62% | 10.91% | 0.00016 | 8 | | is-sorted | 100k-unsorted-beginning | 16 | 63 | 96.99% | 0.00% | 0.00023 | 7 |
The above result formatted in Benchmark.pm style:
Rate sorted 100k-sorted sorted 100k-unsorted-middle sorted 100k-unsorted-beginning is-sorted 100k-sorted is-sorted 100k-unsorted-middle is-sorted 100k-unsorted-beginning sorted 100k-sorted 8.1/s -- -18% -37% -37% -41% -47% sorted 100k-unsorted-middle 10/s 22% -- -23% -23% -28% -35% sorted 100k-unsorted-beginning 13/s 60% 30% -- 0% -6% -16% is-sorted 100k-sorted 13/s 60% 30% 0% -- -6% -16% is-sorted 100k-unsorted-middle 14/s 71% 39% 7% 7% -- -9% is-sorted 100k-unsorted-beginning 16/s 90% 55% 19% 19% 11% -- Legends: is-sorted 100k-sorted: dataset=100k-sorted participant=is-sorted is-sorted 100k-unsorted-beginning: dataset=100k-unsorted-beginning participant=is-sorted is-sorted 100k-unsorted-middle: dataset=100k-unsorted-middle participant=is-sorted sorted 100k-sorted: dataset=100k-sorted participant=sorted sorted 100k-unsorted-beginning: dataset=100k-unsorted-beginning participant=sorted sorted 100k-unsorted-middle: dataset=100k-unsorted-middle participant=sorted
The above result presented as chart:
Benchmark command (benchmarking module startup overhead):
% bencher -m AppSorted --module-startup
#table2# | participant | time (ms) | mod_overhead_time | pct_faster_vs_slowest | pct_slower_vs_fastest | errors | samples | |---------------------+-----------+-------------------+-----------------------+-----------------------+---------+---------| | File::IsSorted | 32 | 28 | 0.00% | 693.00% | 0.00012 | 7 | | App::sorted | 9 | 5 | 242.68% | 131.41% | 0.00032 | 7 | | perl -e1 (baseline) | 4 | 0 | 693.00% | 0.00% | 0.00016 | 9 |
Rate F:I A:s perl -e1 (baseline) F:I 31.2/s -- -71% -87% A:s 111.1/s 255% -- -55% perl -e1 (baseline) 250.0/s 700% 125% -- Legends: A:s: mod_overhead_time=5 participant=App::sorted F:I: mod_overhead_time=28 participant=File::IsSorted perl -e1 (baseline): mod_overhead_time=0 participant=perl -e1 (baseline)
To display as an interactive HTML table on a browser, you can add option --format html+datatables.
--format html+datatables
perlancar (on netbook-dell-xps13) <perlancar@gmail.com>
Please visit the project's homepage at https://metacpan.org/release/Bencher-Scenario-AppSorted.
Source repository is at https://github.com/perlancar/perl-Bencher-Scenario-AppSorted.
Please report any bugs or feature requests on the bugtracker website https://rt.cpan.org/Public/Dist/Display.html?Name=Bencher-Scenario-AppSorted
When submitting a bug or request, please include a test-file or a patch to an existing test-file that illustrates the bug or desired feature.
perlancar <perlancar@cpan.org>
This software is copyright (c) 2021 by perlancar@cpan.org.
This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself.
To install Bencher::Scenario::AppSorted, copy and paste the appropriate command in to your terminal.
cpanm
cpanm Bencher::Scenario::AppSorted
CPAN shell
perl -MCPAN -e shell install Bencher::Scenario::AppSorted
For more information on module installation, please visit the detailed CPAN module installation guide.