Fsdb::Filter::dbrowuniq - eliminate adjacent rows with duplicate fields, maybe counting River stage zero No dependents

Eliminate adjacent rows with duplicate fields, perhaps counting them. Roughly equivalent to the Unix uniq command, but optionally only operating on the specified fields. By default, *all* columns must be unique. If column names are specified, only th...

JOHNH/Fsdb-2.69 - 22 Nov 2019 17:43:00 GMT

Fsdb::Filter::dbrowcount - count the number of rows in an Fsdb stream River stage zero No dependents

Count the number of rows and write out a new fsdb file with one column (n) and one value: the number of rows. This program is a strict subset of dbcolstats. Although there are other ways to get a count of rows ("dbcolstats", or "dbrowaccumulate -C 1"...

JOHNH/Fsdb-2.69 - 22 Nov 2019 17:43:00 GMT

Fsdb::Filter::dbpipeline - allow db commands to be assembled as pipelines in Perl River stage zero No dependents

This module makes it easy to create pipelines in Perl using separate processes. (In the past we used to use perl threads.) By default (as with all Fsdb modules), input is from STDIN and output to STDOUT. Two helper functions, fromfile and tofile can ...

JOHNH/Fsdb-2.69 - 22 Nov 2019 17:43:00 GMT

Fsdb::Filter::yaml_to_db - convert a subset of YAML into fsdb River stage zero No dependents

Converts a *very limited* subset of YAML into Fsdb format. The input is YAML-format (*not* fsdb). The input is parsed as YAML, assuming the file is an array of dictionary entries. We extract the dictionary names and output this as an fsdb table. The ...

JOHNH/Fsdb-2.69 - 22 Nov 2019 17:43:00 GMT

Fsdb::Filter::dbcolmerge - merge multiple columns into one River stage zero No dependents

For each row, merge multiple columns down to a single column, joining elements with ElementSeparator (defaults to a single underscore)....

JOHNH/Fsdb-2.69 - 22 Nov 2019 17:43:00 GMT

Fsdb::Filter::dbcolhisto - compute a histogram over a column of Fsdb data River stage zero No dependents

This program computes a histogram over a column of data. Records containing non-numeric data are considered null do not contribute to the stats (optionally they are treated as zeros). Defaults to 10 buckets over the exact range of data. Up to three p...

JOHNH/Fsdb-2.69 - 22 Nov 2019 17:43:00 GMT

Fsdb::Filter::dbformmail - write a shell script that will send e-mail to many people River stage zero No dependents

Read a ``form mail'' message from the file FORMAT_FILE.TXT, filling in underscore-preceded column-names with data. Output a shell script which will send each message through some mail transport MECHANISM. Do not use this program for evil or I will ha...

JOHNH/Fsdb-2.69 - 22 Nov 2019 17:43:00 GMT

Fsdb::Filter::dbfilediff - compare two fsdb tables River stage zero No dependents

Dbfilediff compares two Fsdb tables, row by row. Unlike Unix diff(1), this program assumes the files are identical line-by-line and we compare fields. Thus, insertion of one extra row will result in all subsequent lines being marked different. By def...

JOHNH/Fsdb-2.69 - 22 Nov 2019 17:43:00 GMT

Fsdb::Filter::dbcolstats - compute statistics on a fsdb column River stage zero No dependents

Compute statistics over a COLUMN of data. Records containing non-numeric data are considered null do not contribute to the stats (with the "-a" option they are treated as zeros). Confidence intervals are a t-test (+/- (t_{a/2})*s/sqrt(n)) and assume ...

JOHNH/Fsdb-2.69 - 22 Nov 2019 17:43:00 GMT

Fsdb::Filter::dbcoldefine - define the columns of a plain text file to make it an Fsdb file River stage zero No dependents

This program writes a new header before the data with the specified column names. It does *not* do any validation of the data contents; it is up to the user to verify that, other than the header, the input datastream is a correctly formatted Fsdb fil...

JOHNH/Fsdb-2.69 - 22 Nov 2019 17:43:00 GMT

Fsdb::Filter::dbcolcreate - create new columns River stage zero No dependents

Create columns "NewColumn1", etc. with an optional "DefaultValue"....

JOHNH/Fsdb-2.69 - 22 Nov 2019 17:43:00 GMT

Fsdb::Filter::dbcolneaten - pretty-print columns of Fsdb data (assuming a monospaced font) River stage zero No dependents

dbcolneaten arranges that the Fsdb data appears in neat columns if you view it with a monospaced font. To do this, it pads out each field with spaces to line up the next field. Field settings are of the form field op value OP is >=, =, or <= specifyi...

JOHNH/Fsdb-2.69 - 22 Nov 2019 17:43:00 GMT

Fsdb::Filter::dbcolrename - change the names of columns in a fsdb schema River stage zero No dependents

Dbcolrename changes the names of columns in a fsdb schema, mapping OldName1 to NewName1, and so on for multiple pairs of column names. Note that it is valid to do "overlapping" renames like "dbcolrename a b b a"....

JOHNH/Fsdb-2.69 - 22 Nov 2019 17:43:00 GMT

Fsdb::Filter::dbmapreduce - reduce all input rows with the same key River stage zero No dependents

Group input data by KeyField, then apply a function (the "reducer") to each group. The reduce function can be an external program given by ReduceCommand and ReduceArguments, or an Perl subroutine given in CodeFile or FilterCode. If a "--" appears bef...

JOHNH/Fsdb-2.69 - 22 Nov 2019 17:43:00 GMT

Fsdb::Filter::dbfilealter - alter the format of an Fsdb file, changing the row/column separator River stage zero No dependents

This program reformats a Fsdb file, altering the row ("-R rs") or column ("-F fs") separator. It verifies that this action does not violate the file constraints (for example, if spaces appear in data and the new format has space as a separator), and ...

JOHNH/Fsdb-2.69 - 22 Nov 2019 17:43:00 GMT

Fsdb::Filter::dbfilepivot - pivot a table, converting multiple rows into single wide row River stage zero No dependents

Pivot a table, converting multiple rows corresponding to the same key into a single wide row. In a normalized database, one might have data with a schema like (id, attribute, value), but sometimes it's more convenient to see the data with a schema li...

JOHNH/Fsdb-2.69 - 22 Nov 2019 17:43:00 GMT

Fsdb::Filter::dbmultistats - run dbcolstats over each group of inputs identified by some key River stage zero No dependents

The input table is grouped by KeyField, then we compute a separate set of column statistics on ValueField for each group with a unique key. Assumptions and requirements are the same as dbmapreduce (this program is just a wrapper around that program):...

JOHNH/Fsdb-2.69 - 22 Nov 2019 17:43:00 GMT

Fsdb::Filter::dbrvstatdiff - evaluate statistical differences between two random variables River stage zero No dependents

Produce statistics on the difference of sets of random variables. If a hypothesized difference is given (with "-h"), to does a Student's t-test. Random variables are specified by: "m1c", "m2c" The column names of means of random variables. "sd1c", "s...

JOHNH/Fsdb-2.69 - 22 Nov 2019 17:43:00 GMT

Fsdb::Filter::dbsubprocess - invoke a subprocess as a Fsdb filter object River stage zero No dependents

Run PROGRAM as a process, with optional ARGUMENTS as program arguments, feeding its standard input and standard output as fsdb streams. A "--" can separate arguments to dbsubprocess from the program and its arguments. As with similar tools, like open...

JOHNH/Fsdb-2.69 - 22 Nov 2019 17:43:00 GMT

Fsdb::Filter::tcpdump_to_db - convert tcpdump textual output to fsdb River stage zero No dependents

Converts a tcpdump textual data stream to Fsdb format. Currently it handles only TCP and silently fails on other traffic! Awaiting enhancement... you're welcome to help....

JOHNH/Fsdb-2.69 - 22 Nov 2019 17:43:00 GMT

58 results (0.032 seconds)