The Perl and Raku Conference 2025: Greenville, South Carolina - June 27-29 Learn more

NETSENSEI / Datahub-Factory-1.73 / README 

            

              
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93

              
NAME
    Datahub::Factory - A conveyor belt which transports data from a data
    source to a data sink.
SYNOPSIS
    dhconveyor command OPTIONS
DESCRIPTION
    Datahub::Factory is a command line conveyor belt which automates three
    tasks:
    Data is fetched automatically from a local or remote data source.
    Data is converted to an exchange format.
    The output is pushed to a data sink.
    Datahub::Factory fetches data from several sources as specified by the
    Importer settings, executes a Catmandu::Fix and sends it to a data
    sink, set via an Exporter. Several importer and exporter modules are
    provided, but developers can extend the functionality with their own
    modules.
    Datahub::Factory contains Log4perl support.
CONFIGURATION
 Command line options
    All commands share the following switches:
    --log_level
      Set the log_level. Takes a numeric parameter. Supported levels are: 1
      (WARN), 2 (INFO), 3 (DEBUG). WARN (1) is the default.
    --log_output
      Selects an output for the log messages. By default, it will send them
      to STDERR (pass STDERR as parameter), but STDOUT (STDOUT) and a log
      file.
    --verbose
      Set verbosity. Invoking the command with the --verbose, -v flag will
      render verbose output to the terminal.
COMMANDS
 help COMMAND
    Documentation about command line options.
 transport OPTIONS
 <https://metacpan.org/pod/Datahub::Factory::Command::transport>
    Fetch data from a local or remote source, convert it to an exchange
    format and export the data.
 transport OPTIONS
 <https://metacpan.org/pod/Datahub::Factory::Command::index>
    Fetch data from a local source, and push it to an enterprise search
    engine via a bulk API.
API
    Datahub::Factory uses a plugin-based architecture, making it easy to
    extend with new functionality.
    New commands can be added by creating a Perl module that contains a
    `command_name.pm` file in the `lib/Datahub/Factory/Command` path.
    Datahub::Factory uses the Datahub::Factory::Command namespace and
    leverages App::Cmd internally.
    New Datahub::Factory::Importer, Datahub::Factory::Exporter and
    Datahub::Factory::Fixer plugins can be added in the same way.
AUTHORS
    Matthias Vandermaesen <matthias.vandermaesen@vlaamsekunstcollectie.be>
    Pieter De Praetere <pieter@packed.be>
COPYRIGHT AND LICENSE
    This software is copyright (c) 2016 by PACKED, vzw, Vlaamse
    Kunstcollectie, vzw.
    This is free software; you can redistribute it and/or modify it under
    the terms of the GNU General Public License, Version 3, June 2007.