From Perl (via "re.pl" or in a Perl program): interlinear( "/path/to/a/pre-prepared-configfile.pl", "/path/to/a/pre-prepared-sourcefile.csv" ); or from the command line: interlinear . (note the dot at the end), to use the file as a script and include the location of the source file directly in the configuration file; or, again, from the command line: interlinear interstart to begin with a dialogue question.
Interlinear is a program for computing the missing values in multivariate datasieries pre-prepared in csv format. The program can adopt the following algorithmic strategies and intermix their result:
a) a propagating distance-weighted gradient-based strategy (by far the best one so far, keeping into account that the behaviour of factors is often not linear and there are curvatures all aroung the design space);
b) pure linear interpolation (one may want to use this in some occasions: for example, on factorials);
c) nearest neighbour (a strategy of last resort. One may want to use it to unlock a computation which is based on data which are too sparse to proceed, or when nothing else works).
Strategy a) works for cases which are adjacent in the design space. For example, it cannot work with the gradient between a certain iteration 1 and the corresponding iteration 3. It can only work with the gradient between iterations 1 and 2, or 2 and 3. For that reason, it does not work well with data evenly distributed in the design space, like those deriving from latin hypercube sampling, or a random sampling; and works well with data clustered in small patches, like those deriving from coordinate descent sampling strategies. To work well with a latin hypercube sampling, it is necessary to include a pass of strategy b) before calling strategy a). Then strategy a) will charge itself of reducing the gradient errors created by the initial pass of strategy b).
A configuration file should be prepared following the example in the "examples" folder in this distribution. If the configuration file is incomplete or missing, the program adopts its own defaults, exploiting the distance-weighted gradient-based strategy.
The only variable that must mandatorily be specified in a configuration file is $sourcefile : the Unix path to the source file containining the dataseries.
The source file has to be prepared by listing in each column the values (levels) of the parameters (factors, variables), putting in the last column the objective function value, when present.
The parameter number is given by the position of the column (i.e. column 4 host parameter 4).
Here below is shown an example of multivatiate dataseries of 3 parameters assuming 3 levels each. having with missing objecive function entries.
Note that the parameter listings cannot be incomplete. Just the objective function entries can be. The program converts this format into the one liked by Sim::OPTS, which is the following:
After some computations, Interlinear will output a new dataseries, with the missing values filled in.
An example of configuration file can be found in the "examples" folder in this distribution.
Gian Luca Brunetti, <firstname.lastname@example.org>
Copyright (C) 2018 by Gian Luca Brunetti and Politecnico di Milano. This is free software. You can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation, version 3 or newer.