txdfilter - filter textual data files
This program filters/transforms textual data files (pipe operation) concering the syntax and header stuff. The data itself is preserved. Any Parameters after options are file title and data column titles (overriding the named parameters).
These are the general rules for specifying parameters to this program:
txdfilter -s -xyz -s=value --long --long=value [--] [files/stuff]
You mention the options to change parameters in any order or even multiple times. They are processed in the oder given, later operations overriding/extending earlier settings. Using the separator "--" stops option parsing An only mentioned short/long name (no "=value") means setting to 1, which is true in the logical sense. Also, prepending + instead of the usual - negates this, setting the value to 0 (false). Specifying "-s" and "--long" is the same as "-s=1" and "--long=1", while "+s" and "++long" is the sames as "-s=0" and "--long=0".
There are also different operators than just "=" available, notably ".=", "+=", "-=", "*=" and "/=" for concatenation / appending array/hash elements and scalar arithmetic operations on the value. Arrays are appended to via "array.=element", hash elements are set via "hash.=name=value". You can also set more array/hash elements by specifying a separator after the long parameter line like this for comma separation:
--array/,/=1,2,3 --hash/,/=name=val,name2=val2
The available parameters are these, default values (in Perl-compatible syntax) at the time of generating this document following the long/short names:
0
ignore whitespace at beginning and end of line (disables strict mode) (from Text::NumericData)
[]
new column titles (as in "title1","title2","title3")
undef
comment character (if not set, deduce from data or use #) (from Text::NumericData)
comment to include between file title and column titles, lines in array
'[#%]*[^\\S\\015\\012]*'
regex for matching comments (from Text::NumericData)
Which configfile(s) to use (overriding automatic search in likely paths); special: just -I or --config causes printing a current config file to STDOUT
1
include the data in printout
delete any comment lines after data
treat empty lines as empty data sets, preserving them in output (from Text::NumericData)
''
regex for first data line (alterative to lhex)
fill value for undefined data (from Text::NumericData)
include the header in printout
use this fixed number of lines as header (overriding any heuristics)
Show the help message. Value 1..9: help level, par: help for paramter par (long name) only.
Additional fun with negative values, optionally followed by comma-separated list of parameter names: -1: list par names, -2: list one line per name, -3: -2 without builtins, -10: dump values (Perl style), -11: dump values (lines), -100: print POD.
keep old title(s) lines as historic comments (writing new overall title before, new column titles below), otherwise replace them
Add a dataset index as first column (maybe just to make other tools happy so with the data lines not starting with text). You can influence the column name via modtitles.
regex for last header line (alternative to fdex)
line ending to use: (DOS, MAC, UNIX or be explicit if you can, taken from data if undefined, finally resorting to UNIX) (from Text::NumericData)
{}
modify existing titles... hash with column indices as key, in Perl: (1=>"NeSpalte",4=>"AndereSpalte")
make completely new header
printf formats to use (if there is no "%" present at all, one will be prepended) (from Text::NumericData)
'[\\+\\-]?\\d*\\.?\\d*[eE]?\\+?\\-?\\d*'
regex for matching numbers (from Text::NumericData)
create Origin-friendly format with tab separation and coltitles as only header line and NO comment character, triggers also quote=0 and delaftercom=1
use this separator for output (leave undefined to use input separator, fallback to TAB) (from Text::NumericData)
quote titles (from Text::NumericData)
quote character to use (derived from input or ") (from Text::NumericData)
use this separator for input (otherwise deduce from data; TAB is another way to say "tabulator", fallback is ) (from Text::NumericData)
strictly split data lines at configured separator (otherwise more fuzzy logic is involved) (from Text::NumericData)
allow text as data (not first column) (from Text::NumericData)
new title
touch the data lines (otherwise just copy them)
touch the header (otherwise just copy)
print out the program version
Thomas Orgis <thomas@orgis.org>
Copyright (c) 2005-2023 Thomas Orgis, Free Software licensed under the same terms as Perl 5.10
To install Text::NumericData, copy and paste the appropriate command in to your terminal.
cpanm
cpanm Text::NumericData
CPAN shell
perl -MCPAN -e shell install Text::NumericData
For more information on module installation, please visit the detailed CPAN module installation guide.