Bencher::Scenario::SortBySpec - Benchmark Sort::BySpec (e.g. against Sort::ByExample, etc)
This document describes version 0.04 of Bencher::Scenario::SortBySpec (from Perl distribution Bencher-Scenario-SortBySpec), released on 2017-01-25.
To run benchmark with default option:
% bencher -m SortBySpec
To run module startup overhead benchmark:
% bencher --module-startup -m SortBySpec
For more options (dump scenario, list/include/exclude/add participants, list/include/exclude/add datasets, etc), see bencher or run bencher --help.
bencher --help
Packaging a benchmark script as a Bencher scenario makes it convenient to include/exclude/add participants/datasets (either via CLI or Perl code), send the result to a central repository, among others . See Bencher and bencher (CLI) for more details.
Version numbers shown below are the versions used when running the sample benchmark.
Sort::ByExample 0.007
Sort::BySpec 0.02
gen_sorter-sbe (perl_code) [gen_sorter, sbe]
Code template:
Sort::ByExample::sbe(<spec>)
gen_sorter-sbs (perl_code) [gen_sorter, sbs]
Sort::BySpec::sort_by_spec(spec => <spec>)
sort-sbe (perl_code) [sort, sbe]
state $sorter = Sort::ByExample::sbe(<spec>); [$sorter->(@{<list>})]
sort-sbs (perl_code) [sort, sbs]
state $sorter = Sort::BySpec::sort_by_spec(spec => <spec>); [$sorter->(@{<list>})]
eg-num5-list10
eg-num5-list100
eg-num5-list1000
Run on: perl: v5.24.0, CPU: Intel(R) Core(TM) M-5Y71 CPU @ 1.20GHz (2 cores), OS: GNU/Linux LinuxMint version 17.3, OS kernel: Linux version 3.19.0-32-generic.
Benchmark with default options (bencher -m SortBySpec):
bencher -m SortBySpec
#table1# +----------------+------------------+-----------+-----------+------------+---------+---------+ | participant | dataset | rate (/s) | time (ms) | vs_slowest | errors | samples | +----------------+------------------+-----------+-----------+------------+---------+---------+ | sort-sbs | eg-num5-list1000 | 220 | 4.5 | 1 | 9.9e-06 | 30 | | sort-sbs | eg-num5-list100 | 2200 | 0.454 | 9.93 | 2.1e-07 | 20 | | sort-sbe | eg-num5-list1000 | 2440 | 0.411 | 11 | 4.8e-08 | 25 | | sort-sbe | eg-num5-list100 | 23200 | 0.0431 | 105 | 1.3e-08 | 22 | | sort-sbs | eg-num5-list10 | 33200 | 0.0302 | 149 | 1.2e-08 | 24 | | sort-sbe | eg-num5-list10 | 117000 | 0.00854 | 528 | 2.8e-09 | 28 | | gen_sorter-sbs | eg-num5-list100 | 180000 | 0.0055 | 810 | 6.7e-09 | 20 | | gen_sorter-sbe | eg-num5-list100 | 184230 | 0.0054281 | 829.77 | 1.1e-11 | 21 | | gen_sorter-sbe | eg-num5-list10 | 185000 | 0.00539 | 835 | 1.7e-09 | 20 | | gen_sorter-sbs | eg-num5-list10 | 200000 | 0.005 | 900 | 7.4e-08 | 31 | | gen_sorter-sbs | eg-num5-list1000 | 202000 | 0.00495 | 910 | 1.7e-09 | 20 | | gen_sorter-sbe | eg-num5-list1000 | 207000 | 0.00484 | 930 | 1.5e-09 | 24 | +----------------+------------------+-----------+-----------+------------+---------+---------+
Benchmark module startup overhead (bencher -m SortBySpec --module-startup):
bencher -m SortBySpec --module-startup
#table2# +---------------------+------------------------------+--------------------+----------------+-----------+------------------------+------------+---------+---------+ | participant | proc_private_dirty_size (MB) | proc_rss_size (MB) | proc_size (MB) | time (ms) | mod_overhead_time (ms) | vs_slowest | errors | samples | +---------------------+------------------------------+--------------------+----------------+-----------+------------------------+------------+---------+---------+ | Sort::ByExample | 0.99 | 4.3 | 16 | 21 | 15.1 | 1 | 6.6e-05 | 20 | | Sort::BySpec | 2.4 | 5.9 | 22 | 9.2 | 3.3 | 2.3 | 2.7e-05 | 20 | | perl -e1 (baseline) | 2.4 | 5.8 | 22 | 5.9 | 0 | 3.5 | 1.3e-05 | 20 | +---------------------+------------------------------+--------------------+----------------+-----------+------------------------+------------+---------+---------+
To display as an interactive HTML table on a browser, you can add option --format html+datatables.
--format html+datatables
Please visit the project's homepage at https://metacpan.org/release/Bencher-Scenario-SortBySpec.
Source repository is at https://github.com/perlancar/perl-Bencher-Scenario-SortBySpec.
Please report any bugs or feature requests on the bugtracker website https://rt.cpan.org/Public/Dist/Display.html?Name=Bencher-Scenario-SortBySpec
When submitting a bug or request, please include a test-file or a patch to an existing test-file that illustrates the bug or desired feature.
perlancar <perlancar@cpan.org>
This software is copyright (c) 2017 by perlancar@cpan.org.
This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself.
To install Bencher::Scenario::SortBySpec, copy and paste the appropriate command in to your terminal.
cpanm
cpanm Bencher::Scenario::SortBySpec
CPAN shell
perl -MCPAN -e shell install Bencher::Scenario::SortBySpec
For more information on module installation, please visit the detailed CPAN module installation guide.