The London Perl and Raku Workshop takes place on 26th Oct 2024. If your company depends on Perl, please consider sponsoring and/or attending.
 / 
Bencher-Scenario-RandomNumbers-0.001
River stage zero No dependents
/ Bencher::Scenario::RandomNumbers

NAME

Bencher::Scenario::RandomNumbers - Benchmark some random number generation

VERSION

This document describes version 0.001 of Bencher::Scenario::RandomNumbers (from Perl distribution Bencher-Scenario-RandomNumbers), released on 2023-12-28.

SYNOPSIS

To run benchmark with default option:

 % bencher -m RandomNumbers

To run module startup overhead benchmark:

 % bencher --module-startup -m RandomNumbers

For more options (dump scenario, list/include/exclude/add participants, list/include/exclude/add datasets, etc), see bencher or run bencher --help.

DESCRIPTION

Packaging a benchmark script as a Bencher scenario makes it convenient to include/exclude/add participants/datasets (either via CLI or Perl code), send the result to a central repository, among others . See Bencher and bencher (CLI) for more details.

BENCHMARKED MODULES

Version numbers shown below are the versions used when running the sample benchmark.

Data::Entropy::Algorithms 0.007

Math::LogRand 0.05

Math::Random::MT 1.17

Math::Random::LogUniform 0.001

BENCHMARK PARTICIPANTS

  • CORE::rand (perl_code)

    Code template:

     CORE::rand()

  • Data::Entropy::Algorithms::rand (perl_code)

    Function call template:

     Data::Entropy::Algorithms::rand()

  • Math::LogRand::LogRand (perl_code)

    Function call template:

     Math::LogRand::LogRand(999,9999)

  • Math::Random::MT::rand (perl_code)

    Function call template:

     Math::Random::MT::rand()

  • Math::Random::LogUniform::logirand (perl_code)

    Function call template:

     Math::Random::LogUniform::logirand(1000,10000)

BENCHMARK SAMPLE RESULTS

Sample benchmark #1

Run on: perl: v5.38.2, CPU: Intel(R) Core(TM) i5-7200U CPU @ 2.50GHz (2 cores), OS: GNU/Linux Ubuntu version 20.04, OS kernel: Linux version 5.4.0-164-generic.

Benchmark command (default options):

 % bencher -m RandomNumbers

Result formatted as table:

 #table1#
 +------------------------------------+-----------+-----------+-----------------------+-----------------------+---------+---------+
 | participant                        | rate (/s) | time (μs) | pct_faster_vs_slowest | pct_slower_vs_fastest |  errors | samples |
 +------------------------------------+-----------+-----------+-----------------------+-----------------------+---------+---------+
 | Data::Entropy::Algorithms::rand    |     40000 |    25     |                 0.00% |            166731.76% | 8.7e-08 |      21 |
 | Math::LogRand::LogRand             |   2250000 |     0.444 |              5597.56% |              2828.13% | 9.8e-11 |      20 |
 | Math::Random::LogUniform::logirand |   3150000 |     0.317 |              7871.53% |              1992.84% | 3.8e-11 |      20 |
 | Math::Random::MT::rand             |   3180000 |     0.315 |              7946.24% |              1973.41% | 5.1e-11 |      20 |
 | CORE::rand                         |  66000000 |     0.015 |            166731.76% |                 0.00% | 8.5e-11 |      21 |
 +------------------------------------+-----------+-----------+-----------------------+-----------------------+---------+---------+

The above result formatted in Benchmark.pm style:

               Rate    DEA:r   ML:L  MRL:l  MRM:r   C:r 
  DEA:r     40000/s       --   -98%   -98%   -98%  -99% 
  ML:L    2250000/s    5530%     --   -28%   -29%  -96% 
  MRL:l   3150000/s    7786%    40%     --     0%  -95% 
  MRM:r   3180000/s    7836%    40%     0%     --  -95% 
  C:r    66000000/s  166566%  2860%  2013%  2000%    -- 
 
 Legends:
   C:r: participant=CORE::rand
   DEA:r: participant=Data::Entropy::Algorithms::rand
   ML:L: participant=Math::LogRand::LogRand
   MRL:l: participant=Math::Random::LogUniform::logirand
   MRM:r: participant=Math::Random::MT::rand

Sample benchmark #2

Benchmark command (benchmarking module startup overhead):

 % bencher -m RandomNumbers --module-startup

Result formatted as table:

 #table2#
 +---------------------------+-----------+-------------------+-----------------------+-----------------------+---------+---------+
 | participant               | time (ms) | mod_overhead_time | pct_faster_vs_slowest | pct_slower_vs_fastest |  errors | samples |
 +---------------------------+-----------+-------------------+-----------------------+-----------------------+---------+---------+
 | Data::Entropy::Algorithms |        20 |                14 |                 0.00% |               240.00% | 3.6e-05 |      20 |
 | Math::LogRand             |        18 |                12 |                13.28% |               200.15% | 1.9e-05 |      20 |
 | Math::Random::LogUniform  |        16 |                10 |                23.46% |               175.40% | 1.9e-05 |      20 |
 | Math::Random::MT          |        14 |                 8 |                45.21% |               134.15% | 3.2e-05 |      20 |
 | perl -e1 (baseline)       |         6 |                 0 |               240.00% |                 0.00% | 1.3e-05 |      20 |
 +---------------------------+-----------+-------------------+-----------------------+-----------------------+---------+---------+

The above result formatted in Benchmark.pm style:

                          Rate  DE:A   M:L  MR:L  MR:M  perl -e1 (baseline) 
  DE:A                  50.0/s    --   -9%  -19%  -30%                 -70% 
  M:L                   55.6/s   11%    --  -11%  -22%                 -66% 
  MR:L                  62.5/s   25%   12%    --  -12%                 -62% 
  MR:M                  71.4/s   42%   28%   14%    --                 -57% 
  perl -e1 (baseline)  166.7/s  233%  200%  166%  133%                   -- 
 
 Legends:
   DE:A: mod_overhead_time=14 participant=Data::Entropy::Algorithms
   M:L: mod_overhead_time=12 participant=Math::LogRand
   MR:L: mod_overhead_time=10 participant=Math::Random::LogUniform
   MR:M: mod_overhead_time=8 participant=Math::Random::MT
   perl -e1 (baseline): mod_overhead_time=0 participant=perl -e1 (baseline)

To display as an interactive HTML table on a browser, you can add option --format html+datatables.

BENCHMARK NOTES

HOMEPAGE

Please visit the project's homepage at https://metacpan.org/release/Bencher-Scenario-RandomNumbers.

SOURCE

Source repository is at https://github.com/perlancar/perl-Bencher-Scenario-RandomNumbers.

SEE ALSO

AUTHOR

perlancar <perlancar@cpan.org>

CONTRIBUTING

To contribute, you can send patches by email/via RT, or send pull requests on GitHub.

Most of the time, you don't need to build the distribution yourself. You can simply modify the code, then test via:

 % prove -l

If you want to build the distribution (e.g. to try to install it locally on your system), you can install Dist::Zilla, Dist::Zilla::PluginBundle::Author::PERLANCAR, Pod::Weaver::PluginBundle::Author::PERLANCAR, and sometimes one or two other Dist::Zilla- and/or Pod::Weaver plugins. Any additional steps required beyond that are considered a bug and can be reported to me.

COPYRIGHT AND LICENSE

This software is copyright (c) 2023 by perlancar <perlancar@cpan.org>.

This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself.

BUGS

Please report any bugs or feature requests on the bugtracker website https://rt.cpan.org/Public/Dist/Display.html?Name=Bencher-Scenario-RandomNumbers

When submitting a bug or request, please include a test-file or a patch to an existing test-file that illustrates the bug or desired feature.