csvjoin - join all csv files in folder into one and remove duplicates
version 1.01
csvjoin -d </user/pavel/csv> -i <in_column_name_or_index> -o <column name to store source> -v
<in_column_name_or_index> could be column name if csv has header or just row number.
In case of using row number please make sure that csv column structure is same
Read csv files without subdirectories
All available options:
-d | --dir name of directory to process. by default is cwd -i | --in number or name of column, data from which will be checked for unique, by default is id or first column -j | --join number or name of column where data is different and where it is needed to join values -f | --file name of output file, by default is unique.csv -v | --verbose verbose mode
Examples of usage:
csvjoin csvjoin -i 2 csvjoin ---in ID -v
CLI tool that makes one csv with unique data from all csv in current folder
Removes duplicates in csv file assuming that one column could be different ( content in this column will be joined )
Criteria that records are same is same field ID. However you can pass your own column names
ID
NOW WORKS FINE ONLY FOR NAMED CSV FILES AND ON LINUX SYSTEMS
See more:
Text::CSV Text::CSV_XS Text::CSV::Simple Tie::CSV_File Text::CSV::Merge
Pavel Serikov <pavelsr@cpan.org>
This software is copyright (c) 2018 by Pavel Serikov.
This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself.
To install CSV::Processor, copy and paste the appropriate command in to your terminal.
cpanm
cpanm CSV::Processor
CPAN shell
perl -MCPAN -e shell install CSV::Processor
For more information on module installation, please visit the detailed CPAN module installation guide.