NAME
Bencher::Scenario::RandomNumbers - Benchmark some random number generation
VERSION
This document describes version 0.001 of Bencher::Scenario::RandomNumbers (from Perl distribution Bencher-Scenario-RandomNumbers), released on 2023-12-28.
SYNOPSIS
To run benchmark with default option:
% bencher -m RandomNumbers
To run module startup overhead benchmark:
% bencher --module-startup -m RandomNumbers
For more options (dump scenario, list/include/exclude/add participants, list/include/exclude/add datasets, etc), see bencher or run bencher --help
.
DESCRIPTION
Packaging a benchmark script as a Bencher scenario makes it convenient to include/exclude/add participants/datasets (either via CLI or Perl code), send the result to a central repository, among others . See Bencher and bencher (CLI) for more details.
BENCHMARKED MODULES
Version numbers shown below are the versions used when running the sample benchmark.
Data::Entropy::Algorithms 0.007
Math::LogRand 0.05
Math::Random::MT 1.17
Math::Random::LogUniform 0.001
BENCHMARK PARTICIPANTS
CORE::rand (perl_code)
Code template:
CORE::rand()
Data::Entropy::Algorithms::rand (perl_code)
Function call template:
Data::Entropy::Algorithms::rand()
Math::LogRand::LogRand (perl_code)
Function call template:
Math::LogRand::LogRand(999,9999)
Math::Random::MT::rand (perl_code)
Function call template:
Math::Random::MT::rand()
Math::Random::LogUniform::logirand (perl_code)
Function call template:
Math::Random::LogUniform::logirand(1000,10000)
BENCHMARK SAMPLE RESULTS
Sample benchmark #1
Run on: perl: v5.38.2, CPU: Intel(R) Core(TM) i5-7200U CPU @ 2.50GHz (2 cores), OS: GNU/Linux Ubuntu version 20.04, OS kernel: Linux version 5.4.0-164-generic.
Benchmark command (default options):
% bencher -m RandomNumbers
Result formatted as table:
#table1#
+------------------------------------+-----------+-----------+-----------------------+-----------------------+---------+---------+
| participant | rate (/s) | time (μs) | pct_faster_vs_slowest | pct_slower_vs_fastest | errors | samples |
+------------------------------------+-----------+-----------+-----------------------+-----------------------+---------+---------+
| Data::Entropy::Algorithms::rand | 40000 | 25 | 0.00% | 166731.76% | 8.7e-08 | 21 |
| Math::LogRand::LogRand | 2250000 | 0.444 | 5597.56% | 2828.13% | 9.8e-11 | 20 |
| Math::Random::LogUniform::logirand | 3150000 | 0.317 | 7871.53% | 1992.84% | 3.8e-11 | 20 |
| Math::Random::MT::rand | 3180000 | 0.315 | 7946.24% | 1973.41% | 5.1e-11 | 20 |
| CORE::rand | 66000000 | 0.015 | 166731.76% | 0.00% | 8.5e-11 | 21 |
+------------------------------------+-----------+-----------+-----------------------+-----------------------+---------+---------+
The above result formatted in Benchmark.pm style:
Rate DEA:r ML:L MRL:l MRM:r C:r
DEA:r 40000/s -- -98% -98% -98% -99%
ML:L 2250000/s 5530% -- -28% -29% -96%
MRL:l 3150000/s 7786% 40% -- 0% -95%
MRM:r 3180000/s 7836% 40% 0% -- -95%
C:r 66000000/s 166566% 2860% 2013% 2000% --
Legends:
C:r: participant=CORE::rand
DEA:r: participant=Data::Entropy::Algorithms::rand
ML:L: participant=Math::LogRand::LogRand
MRL:l: participant=Math::Random::LogUniform::logirand
MRM:r: participant=Math::Random::MT::rand
Sample benchmark #2
Benchmark command (benchmarking module startup overhead):
% bencher -m RandomNumbers --module-startup
Result formatted as table:
#table2#
+---------------------------+-----------+-------------------+-----------------------+-----------------------+---------+---------+
| participant | time (ms) | mod_overhead_time | pct_faster_vs_slowest | pct_slower_vs_fastest | errors | samples |
+---------------------------+-----------+-------------------+-----------------------+-----------------------+---------+---------+
| Data::Entropy::Algorithms | 20 | 14 | 0.00% | 240.00% | 3.6e-05 | 20 |
| Math::LogRand | 18 | 12 | 13.28% | 200.15% | 1.9e-05 | 20 |
| Math::Random::LogUniform | 16 | 10 | 23.46% | 175.40% | 1.9e-05 | 20 |
| Math::Random::MT | 14 | 8 | 45.21% | 134.15% | 3.2e-05 | 20 |
| perl -e1 (baseline) | 6 | 0 | 240.00% | 0.00% | 1.3e-05 | 20 |
+---------------------------+-----------+-------------------+-----------------------+-----------------------+---------+---------+
The above result formatted in Benchmark.pm style:
Rate DE:A M:L MR:L MR:M perl -e1 (baseline)
DE:A 50.0/s -- -9% -19% -30% -70%
M:L 55.6/s 11% -- -11% -22% -66%
MR:L 62.5/s 25% 12% -- -12% -62%
MR:M 71.4/s 42% 28% 14% -- -57%
perl -e1 (baseline) 166.7/s 233% 200% 166% 133% --
Legends:
DE:A: mod_overhead_time=14 participant=Data::Entropy::Algorithms
M:L: mod_overhead_time=12 participant=Math::LogRand
MR:L: mod_overhead_time=10 participant=Math::Random::LogUniform
MR:M: mod_overhead_time=8 participant=Math::Random::MT
perl -e1 (baseline): mod_overhead_time=0 participant=perl -e1 (baseline)
To display as an interactive HTML table on a browser, you can add option --format html+datatables
.
BENCHMARK NOTES
HOMEPAGE
Please visit the project's homepage at https://metacpan.org/release/Bencher-Scenario-RandomNumbers.
SOURCE
Source repository is at https://github.com/perlancar/perl-Bencher-Scenario-RandomNumbers.
SEE ALSO
AUTHOR
perlancar <perlancar@cpan.org>
CONTRIBUTING
To contribute, you can send patches by email/via RT, or send pull requests on GitHub.
Most of the time, you don't need to build the distribution yourself. You can simply modify the code, then test via:
% prove -l
If you want to build the distribution (e.g. to try to install it locally on your system), you can install Dist::Zilla, Dist::Zilla::PluginBundle::Author::PERLANCAR, Pod::Weaver::PluginBundle::Author::PERLANCAR, and sometimes one or two other Dist::Zilla- and/or Pod::Weaver plugins. Any additional steps required beyond that are considered a bug and can be reported to me.
COPYRIGHT AND LICENSE
This software is copyright (c) 2023 by perlancar <perlancar@cpan.org>.
This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself.
BUGS
Please report any bugs or feature requests on the bugtracker website https://rt.cpan.org/Public/Dist/Display.html?Name=Bencher-Scenario-RandomNumbers
When submitting a bug or request, please include a test-file or a patch to an existing test-file that illustrates the bug or desired feature.