NAME
Bencher::Scenario::Log::ger::NullOutput - Benchmark Log::ger logging speed with the default/null output
VERSION
This document describes version 0.019 of Bencher::Scenario::Log::ger::NullOutput (from Perl distribution Bencher-Scenarios-Log-ger), released on 2023-10-29.
SYNOPSIS
To run benchmark with default option:
% bencher -m Log::ger::NullOutputFor more options (dump scenario, list/include/exclude/add participants, list/include/exclude/add datasets, etc), see bencher or run bencher --help.
DESCRIPTION
Packaging a benchmark script as a Bencher scenario makes it convenient to include/exclude/add participants/datasets (either via CLI or Perl code), send the result to a central repository, among others . See Bencher and bencher (CLI) for more details.
BENCHMARKED MODULES
Version numbers shown below are the versions used when running the sample benchmark.
Log::Any 1.717
Log::Contextual 0.008001
Log::Contextual::SimpleLogger 0.008001
Log::Dispatch 2.71
Log::Dispatch::Null 2.71
Log::Dispatchouli 3.007
Log::Fast v2.0.1
Log::Log4perl 1.57
Log::Log4perl::Tiny 1.8.0
Log::ger 0.040
Log::ger::Format::MultilevelLog 0.040
Log::ger::Plugin::OptAway 0.009
XLog 1.1.3
BENCHMARK PARTICIPANTS
Log::ger-100k_log_trace (command)
Command line:
#TEMPLATE: #perl -MLog::ger -e for(1..100_000) { log_trace(q[]) }Log::ger-100k_log_is_trace (command)
Command line:
#TEMPLATE: #perl -MLog::ger -e for(1..100_000) { log_is_trace() }Log::ger+LGP:OptAway-100k_log_trace (command)
Command line:
#TEMPLATE: #perl -MLog::ger::Plugin=OptAway -MLog::ger -e for(1..100_000) { log_trace(q[]) }Log::ger+LGF:MutilevelLog-100k_log_trace (command)
Command line:
#TEMPLATE: #perl -MLog::ger::Format=MultilevelLog -MLog::ger -e for(1..100_000) { log("trace", q[]) }Log::ger+LGP:MutilevelLog-100k_log_6 (command)
Command line:
#TEMPLATE: #perl -MLog::ger::Format=MultilevelLog -MLog::ger -e for(1..100_000) { log(6, q[]) }Log::Fast-100k_DEBUG (command)
Command line:
#TEMPLATE: #perl -MLog::Fast -e $LOG = Log::Fast->global; $LOG->level("INFO"); for(1..100_000) { $LOG->DEBUG(q()) }Log::Fast-100k_is_debug (command)
Command line:
#TEMPLATE: #perl -MLog::Fast -e $LOG = Log::Fast->global; for(1..100_000) { $LOG->level() eq "DEBUG" }Log::Any-no_adapter-100k_log_trace (command)
Command line:
#TEMPLATE: #perl -MLog::Any -e my $log = Log::Any->get_logger; for(1..100_000) { $log->trace(q[]) }Log::Any-no_adapter-100k_is_trace (command)
Command line:
#TEMPLATE: #perl -MLog::Any -e my $log = Log::Any->get_logger; for(1..100_000) { $log->is_trace }Log::Any-null_adapter-100k_log_trace (command)
Command line:
#TEMPLATE: #perl -MLog::Any -MLog::Any::Adapter -e Log::Any::Adapter->set(q[Null]); my $log = Log::Any->get_logger; for(1..100_000) { $log->trace(q[]) }Log::Any-null_adapter-100k_is_trace (command)
Command line:
#TEMPLATE: #perl -MLog::Any -MLog::Any::Adapter -e Log::Any::Adapter->set(q[Null]); my $log = Log::Any->get_logger; for(1..100_000) { $log->is_trace }Log::Dispatch::Null-100k_debug (command)
Command line:
#TEMPLATE: #perl -MLog::Dispatch -e my $null = Log::Dispatch->new(outputs=>[["Null", min_level=>"debug"]]); for(1..100_000) { $null->debug("") }Log::Log4perl-easy-100k_trace (command)
Command line:
#TEMPLATE: #perl -MLog::Log4perl=:easy -e Log::Log4perl->easy_init($ERROR); for(1..100_000) { TRACE "" }Log::Log4perl::Tiny-100k_trace (command)
Command line:
#TEMPLATE: #perl -MLog::Log4perl::Tiny=:easy -e for(1..100_000) { TRACE "" }Log::Contextual+Log4perl-100k_trace (command)
Command line:
#TEMPLATE: #perl -e use Log::Contextual ":log", "set_logger"; use Log::Log4perl ":easy"; Log::Log4perl->easy_init($DEBUG); my $logger = Log::Log4perl->get_logger; set_logger $logger; for(1..100_000) { log_trace {} }Log::Contextual+SimpleLogger-100k_trace (command)
Command line:
#TEMPLATE: #perl -MLog::Contextual::SimpleLogger -e use Log::Contextual ":log", -logger=>Log::Contextual::SimpleLogger->new({levels=>["debug"]}); for(1..100_000) { log_trace {} }Log::Dispatchouli-100k_debug (command)
Command line:
#TEMPLATE: #perl -MLog::Dispatchouli -e $logger = Log::Dispatchouli->new({ident=>"ident", facility=>"facility", to_stdout=>1, debug=>0}); for(1..100_000) { $logger->log_debug("") }Mojo::Log-100k_debug (command)
Command line:
#TEMPLATE: #perl -MMojo::Log -e $log = Mojo::Log->new(level=>"warn"); for(1..100_000) { $log->debug("") }XLog-100k_debug (command)
Command line:
#TEMPLATE: #perl -MXLog -e for(1..100_000) { XLog::debug("") }
BENCHMARK SAMPLE RESULTS
Sample benchmark #1
Run on: perl: v5.38.0, CPU: Intel(R) Core(TM) i5-7200U CPU @ 2.50GHz (2 cores), OS: GNU/Linux Ubuntu version 20.04, OS kernel: Linux version 5.4.0-164-generic.
Benchmark command (default options):
% bencher -m Log::ger::NullOutputResult formatted as table:
#table1#
+------------------------------------------+-----------+-----------+-----------------------+-----------------------+-----------+---------+
| participant | rate (/s) | time (ms) | pct_faster_vs_slowest | pct_slower_vs_fastest | errors | samples |
+------------------------------------------+-----------+-----------+-----------------------+-----------------------+-----------+---------+
| Log::Dispatch::Null-100k_debug | 1.97 | 508 | 0.00% | 3831.61% | 0.00032 | 8 |
| Log::Contextual+Log4perl-100k_trace | 2.2 | 460 | 11.26% | 3433.68% | 0.00063 | 6 |
| Log::Contextual+SimpleLogger-100k_trace | 2.3 | 440 | 14.82% | 3324.26% | 0.0011 | 6 |
| Mojo::Log-100k_debug | 5.58 | 179 | 183.55% | 1286.57% | 0.0001 | 6 |
| Log::Dispatchouli-100k_debug | 6 | 167 | 204.77% | 1190.02% | 6.4e-05 | 6 |
| Log::Log4perl::Tiny-100k_trace | 9.72 | 103 | 393.82% | 696.16% | 3.9e-05 | 6 |
| Log::Fast-100k_is_debug | 16 | 64 | 688.73% | 398.48% | 7.6e-05 | 7 |
| Log::Any-null_adapter-100k_log_trace | 15.9 | 63 | 706.34% | 387.59% | 2.3e-05 | 7 |
| Log::Log4perl-easy-100k_trace | 17.9 | 55.9 | 808.92% | 332.56% | 4.3e-05 | 6 |
| Log::Any-no_adapter-100k_is_trace | 23 | 43 | 1071.54% | 235.59% | 8.1e-05 | 7 |
| Log::Any-null_adapter-100k_is_trace | 23.1 | 43.3 | 1072.70% | 235.26% | 2.2e-05 | 6 |
| Log::Fast-100k_DEBUG | 26 | 39 | 1206.11% | 201.02% | 6.7e-05 | 7 |
| XLog-100k_debug | 35 | 28 | 1693.38% | 119.23% | 7.6e-05 | 6 |
| Log::Any-no_adapter-100k_log_trace | 40.9 | 24.5 | 1977.36% | 89.26% | 2.4e-05 | 7 |
| Log::ger+LGP:OptAway-100k_log_trace | 44.2 | 22.6 | 2146.33% | 75.02% | 6e-06 | 6 |
| Log::ger+LGP:MutilevelLog-100k_log_6 | 50 | 20 | 2187.70% | 71.86% | 0.00028 | 6 |
| Log::ger+LGF:MutilevelLog-100k_log_trace | 49 | 21 | 2375.40% | 58.83% | 3.1e-05 | 6 |
| Log::ger-100k_log_trace | 75 | 13 | 3701.48% | 3.42% | 2.3e-05 | 6 |
| Log::ger-100k_log_is_trace | 77 | 13 | 3831.61% | 0.00% | 4.7e-05 | 7 |
+------------------------------------------+-----------+-----------+-----------------------+-----------------------+-----------+---------+The above result formatted in Benchmark.pm style:
Rate Log::Dispatch::Null-100k_debug Log::Contextual+Log4perl-100k_trace Log::Contextual+SimpleLogger-100k_trace Mojo::Log-100k_debug Log::Dispatchouli-100k_debug Log::Log4perl::Tiny-100k_trace Log::Fast-100k_is_debug Log::Any-null_adapter-100k_log_trace Log::Log4perl-easy-100k_trace Log::Any-null_adapter-100k_is_trace Log::Any-no_adapter-100k_is_trace Log::Fast-100k_DEBUG XLog-100k_debug Log::Any-no_adapter-100k_log_trace Log::ger+LGP:OptAway-100k_log_trace Log::ger+LGF:MutilevelLog-100k_log_trace Log::ger+LGP:MutilevelLog-100k_log_6 Log::ger-100k_log_trace Log::ger-100k_log_is_trace
Log::Dispatch::Null-100k_debug 1.97/s -- -9% -13% -64% -67% -79% -87% -87% -88% -91% -91% -92% -94% -95% -95% -95% -96% -97% -97%
Log::Contextual+Log4perl-100k_trace 2.2/s 10% -- -4% -61% -63% -77% -86% -86% -87% -90% -90% -91% -93% -94% -95% -95% -95% -97% -97%
Log::Contextual+SimpleLogger-100k_trace 2.3/s 15% 4% -- -59% -62% -76% -85% -85% -87% -90% -90% -91% -93% -94% -94% -95% -95% -97% -97%
Mojo::Log-100k_debug 5.58/s 183% 156% 145% -- -6% -42% -64% -64% -68% -75% -75% -78% -84% -86% -87% -88% -88% -92% -92%
Log::Dispatchouli-100k_debug 6/s 204% 175% 163% 7% -- -38% -61% -62% -66% -74% -74% -76% -83% -85% -86% -87% -88% -92% -92%
Log::Log4perl::Tiny-100k_trace 9.72/s 393% 346% 327% 73% 62% -- -37% -38% -45% -57% -58% -62% -72% -76% -78% -79% -80% -87% -87%
Log::Fast-100k_is_debug 16/s 693% 618% 587% 179% 160% 60% -- -1% -12% -32% -32% -39% -56% -61% -64% -67% -68% -79% -79%
Log::Any-null_adapter-100k_log_trace 15.9/s 706% 630% 598% 184% 165% 63% 1% -- -11% -31% -31% -38% -55% -61% -64% -66% -68% -79% -79%
Log::Log4perl-easy-100k_trace 17.9/s 808% 722% 687% 220% 198% 84% 14% 12% -- -22% -23% -30% -49% -56% -59% -62% -64% -76% -76%
Log::Any-null_adapter-100k_is_trace 23.1/s 1073% 962% 916% 313% 285% 137% 47% 45% 29% -- 0% -9% -35% -43% -47% -51% -53% -69% -69%
Log::Any-no_adapter-100k_is_trace 23/s 1081% 969% 923% 316% 288% 139% 48% 46% 30% 0% -- -9% -34% -43% -47% -51% -53% -69% -69%
Log::Fast-100k_DEBUG 26/s 1202% 1079% 1028% 358% 328% 164% 64% 61% 43% 11% 10% -- -28% -37% -42% -46% -48% -66% -66%
XLog-100k_debug 35/s 1714% 1542% 1471% 539% 496% 267% 128% 125% 99% 54% 53% 39% -- -12% -19% -25% -28% -53% -53%
Log::Any-no_adapter-100k_log_trace 40.9/s 1973% 1777% 1695% 630% 581% 320% 161% 157% 128% 76% 75% 59% 14% -- -7% -14% -18% -46% -46%
Log::ger+LGP:OptAway-100k_log_trace 44.2/s 2147% 1935% 1846% 692% 638% 355% 183% 178% 147% 91% 90% 72% 23% 8% -- -7% -11% -42% -42%
Log::ger+LGF:MutilevelLog-100k_log_trace 49/s 2319% 2090% 1995% 752% 695% 390% 204% 200% 166% 106% 104% 85% 33% 16% 7% -- -4% -38% -38%
Log::ger+LGP:MutilevelLog-100k_log_6 50/s 2440% 2200% 2100% 794% 735% 415% 220% 215% 179% 116% 114% 95% 39% 22% 13% 5% -- -35% -35%
Log::ger-100k_log_trace 75/s 3807% 3438% 3284% 1276% 1184% 692% 392% 384% 330% 233% 230% 200% 115% 88% 73% 61% 53% -- 0%
Log::ger-100k_log_is_trace 77/s 3807% 3438% 3284% 1276% 1184% 692% 392% 384% 330% 233% 230% 200% 115% 88% 73% 61% 53% 0% --
Legends:
Log::Any-no_adapter-100k_is_trace: participant=Log::Any-no_adapter-100k_is_trace
Log::Any-no_adapter-100k_log_trace: participant=Log::Any-no_adapter-100k_log_trace
Log::Any-null_adapter-100k_is_trace: participant=Log::Any-null_adapter-100k_is_trace
Log::Any-null_adapter-100k_log_trace: participant=Log::Any-null_adapter-100k_log_trace
Log::Contextual+Log4perl-100k_trace: participant=Log::Contextual+Log4perl-100k_trace
Log::Contextual+SimpleLogger-100k_trace: participant=Log::Contextual+SimpleLogger-100k_trace
Log::Dispatch::Null-100k_debug: participant=Log::Dispatch::Null-100k_debug
Log::Dispatchouli-100k_debug: participant=Log::Dispatchouli-100k_debug
Log::Fast-100k_DEBUG: participant=Log::Fast-100k_DEBUG
Log::Fast-100k_is_debug: participant=Log::Fast-100k_is_debug
Log::Log4perl-easy-100k_trace: participant=Log::Log4perl-easy-100k_trace
Log::Log4perl::Tiny-100k_trace: participant=Log::Log4perl::Tiny-100k_trace
Log::ger+LGF:MutilevelLog-100k_log_trace: participant=Log::ger+LGF:MutilevelLog-100k_log_trace
Log::ger+LGP:MutilevelLog-100k_log_6: participant=Log::ger+LGP:MutilevelLog-100k_log_6
Log::ger+LGP:OptAway-100k_log_trace: participant=Log::ger+LGP:OptAway-100k_log_trace
Log::ger-100k_log_is_trace: participant=Log::ger-100k_log_is_trace
Log::ger-100k_log_trace: participant=Log::ger-100k_log_trace
Mojo::Log-100k_debug: participant=Mojo::Log-100k_debug
XLog-100k_debug: participant=XLog-100k_debugTo display as an interactive HTML table on a browser, you can add option --format html+datatables.
BENCHMARK NOTES
Not included here:
-
Cannot do null output, must log to a file. (Technically you can use /dev/null, but.)
HOMEPAGE
Please visit the project's homepage at https://metacpan.org/release/Bencher-Scenarios-Log-ger.
SOURCE
Source repository is at https://github.com/perlancar/perl-Bencher-Scenarios-Log-ger.
AUTHOR
perlancar <perlancar@cpan.org>
CONTRIBUTING
To contribute, you can send patches by email/via RT, or send pull requests on GitHub.
Most of the time, you don't need to build the distribution yourself. You can simply modify the code, then test via:
% prove -lIf you want to build the distribution (e.g. to try to install it locally on your system), you can install Dist::Zilla, Dist::Zilla::PluginBundle::Author::PERLANCAR, Pod::Weaver::PluginBundle::Author::PERLANCAR, and sometimes one or two other Dist::Zilla- and/or Pod::Weaver plugins. Any additional steps required beyond that are considered a bug and can be reported to me.
COPYRIGHT AND LICENSE
This software is copyright (c) 2023, 2021, 2020, 2018, 2017 by perlancar <perlancar@cpan.org>.
This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself.
BUGS
Please report any bugs or feature requests on the bugtracker website https://rt.cpan.org/Public/Dist/Display.html?Name=Bencher-Scenarios-Log-ger
When submitting a bug or request, please include a test-file or a patch to an existing test-file that illustrates the bug or desired feature.