The Perl Toolchain Summit needs more sponsors. If your company depends on Perl, please support this very important event.

NAME

Config::Manager::File - Basic File Utilities (for Tools)

SYNOPSIS

  use Config::Manager::File
  qw(
        Normalize
        MakeDir
        UniqueTempFileName
        ConvertFromHost
        ConvertToHost
        CompareFiles
        CopyFile
        MoveByCopying
        MD5Checksum
        ReadFile
        WriteFile
        AppendFile
        ConvertFileWithCallback
        SerializeSimple
        Semaphore_Passeer
        Semaphore_Verlaat
        GetNextTicket
  );

  use Config::Manager::File qw(:all);

  $dir = Normalize($dir);

  ($drv,$dir) = Normalize($dir);

  $error = MakeDir($dir);

  $tempfilename = &UniqueTempFileName();

  &ConvertFromHost($targetfile,$sourcefile,$linenumbering,$purgeblanks);

  &ConvertToHost($targetfile,$sourcefile,$linenumbering,$purgeblanks,$checklength);

  $same = &CompareFiles($file1,$file2);

  &CopyFile($source,$target);

  &MoveByCopying($source,$target);

  $checksum = &MD5Checksum($source);

  $arrayref = &ReadFile($source);

  &WriteFile($target,@contents);

  &AppendFile($target,$source);

  &ConvertFileWithCallback($target,$source,$callback);

  $printable = &SerializeSimple("varname",$datastructure);

  Semaphore_Passeer($lockfile);

  Semaphore_Verlaat($lockfile);

  $ticket = GetNextTicket($lockfile,$ticketfile,$count_min,$count_max);

DESCRIPTION

  • $dir = Normalize($dir);

    ($drv,$dir) = Normalize($dir);

    Normalizes a given path (which may include a filename part), i.e., substitutes "\" with "/", removes multiple slashes, removes "../" and "./" where possible, etc.

    This function accepts absolute as well as relative paths. Any trailing slash(es) will be removed.

    If called in list context, this function returns a possible drive letter and the path (without leading slash this time) separately.

    The "drive" return value will contain a dot (".") if the given path was a relative one.

    In scalar context, the function returns "$drive/$path". (Again, the "drive" will be a dot (".") if the path is relative.)

    If the given path does not contain a drive letter and the path is absolute, the "drive" part will be empty (i.e., contain the empty string).

    So this function works for Unix and Win32 alike, but not for other operating systems with different path separator characters that aren't slash ("/") or backslash ("\"), such as MacOS, for example, which uses a colon (":").

  • $error = MakeDir($dir);

    This function recursively creates the given (absolute) path (note that the path is normalized using the "Normalize()" function above before being created).

    The function returns an empty string in case of success and a string containing an error message in case of an error.

  • $tempfilename = &UniqueTempFileName();

    Generates a unique temporary file name with an absolute path (in the temporary directory which has been configured in the user's or the global configuration file).

    The file itself is NOT created by this function.

    The file name is composed of the "scope" (as passed to the "Config::Manager::Conf::init()" method during global initialization) followed by the day of year (000 to 364 or 365), the hour, minutes, seconds, the process ID, a running number and terminates with ".tmp".

    All temporary files created in this manner are automatically deleted at shutdown time of the Perl interpreter (if they still exist). So you need not worry about deleting any of your temporary files, but you may do so if you wish.

  • &ConvertFromHost($targetfile,$sourcefile,$linenumbering,$purgeblanks);

    Converts the given input file after it has been fetched from a mainframe.

    The original input file is NEVER altered in any way. A new file (whose name "$targetfile" is given) is written instead.

    "$targetfile" must be a valid filename; beware that it will be overwritten if it already exists!

    "$sourcefile" is the input file's name (and path), "$linenumbering" is a flag (0 = "no", 1 = "yes") indicating whether line numbers shall be removed from the beginning of each line, and "$purgeblanks" is a flag (0 = "no", 1 = "yes") indicating whether trailing whitespace is to be purged from each line.

    Any sequences of "Carriage Return" and "Line Feed" characters (ASCII hexadecimal 0x0D and 0x0A) at the end of lines are converted to the end-of-line character sequence of the current operating system.

    Returns true on success or "undef" in case of error (error messages are written to the log file and put on hold for possible output to the screen).

    Possible warning messages will also be written to the log file and to STDERR.

    This happens for instance if a line does not begin with 6 digits when the "$linenumbering" option is enabled, or if there was a problem closing the input file, or if a needed configuration constant was unavailable.

  • &ConvertToHost($targetfile,$sourcefile,$linenumbering,$purgeblanks,$checklength);

    Converts the given input file so that it can be sent to a host mainframe.

    The original input file is NEVER altered in any way. A new file (whose name "$targetfile" is given) is written instead.

    "$targetfile" must be a valid filename; beware that it will be overwritten if it already exists!

    "$sourcefile" is the input file's name (and path), "$linenumbering" is a flag (0 = "no", 1 = "yes") indicating whether line numbers shall be prepended to each line, "$purgeblanks" is a flag (0 = "no", 1 = "yes") indicating whether trailing whitespace is to be removed from each line, and "$checklength" is a flag (0 = "no", 1 = "yes") signaling whether lines should be checked for correct length (a warning message will be issued if the maximum COBOL line length (66 columns) is exceeded by any line).

    Any sequences of "Carriage Return" and "Line Feed" characters (ASCII hexadecimal 0x0D and 0x0A) at the end of lines are converted to the end-of-line character sequence of the current operating system.

    Returns true on success or "undef" in case of error (error messages are written to the log file and put on hold for possible output to the screen).

    Possible warning messages will also be written to the log file and to STDERR.

    This happens for instance if a line is longer than the maximum permitted number of characters per line (66) or if there was a problem closing the input file, or if a needed configuration constant was unavailable.

  • $same = &CompareFiles($file1,$file2);

    Compares the contents of two files.

    Returns "true" (1) if the files are the same, "false" (0) if they differ, and "undef" in case of any error.

    The corresponding error message will be written to the log file and put on hold (for subsequent display on the screen, if desired) in the latter case.

  • &CopyFile($source,$target);

    Copies file "$source" to "$target". Returns "true" (1) on success and "undef" in case of any error.

    The corresponding error message will be written to the log file and put on hold (for subsequent display on the screen, if desired) in the latter case.

  • &MoveByCopying($source,$target);

    Copies file "$source" to "$target", then deletes file "$source" if the copy was successful. Returns "true" (1) on success and "undef" in case of any error.

    The corresponding error message will be written to the log file and put on hold (for subsequent display on the screen, if desired) in the latter case.

    Note that moving WITHOUT copying is performed with Perl's built-in "rename()" function!

    BEWARE that moving without copying is not possible across file system boundaries on most Unix systems!

    So whenever you are unsure whether you are actually trying to move across a file system boundary or not, better use "MoveByCopying()"!

    Otherwise, this can easily lead to sudden errors when directory locations are changed in the configuration!

    YOU HAVE BEEN WARNED!

  • $checksum = &MD5Checksum($source);

    Determines the MD5 checksum for file "$source". Returns the checksum (a 16 digit hexadecimal string) on success and "undef" in case of any error.

    The corresponding error message will be written to the log file and put on hold (for subsequent display on the screen, if desired) in the latter case.

    MD5 is used in cryptography for "fingerprints"; it is guaranteed to differ strongly for slightly altered input (but the reverse is not necessarily true!).

    In combination with the file's length, this can be used to uniquely identify files, for instance in the recursive processing of certain files, in order to avoid infinite recursion.

    For example as follows ("$file" contains the name and path of the file in question, and "$checksum" contains its checksum):

      if (defined $filesig{-s $file}{$checksum})
      {
          # file already known
      }
      else
      {
          # file not encountered yet
      }
      $filesig{-s $file}{$checksum}{$file} = 1; # add file to list
  • $arrayref = &ReadFile($source);

    Returns a reference to a Perl array containing the lines of the given file (the input separator "$/" is set to "\n" (line mode) locally before the file is read).

    Returns "undef" in case of any error.

    The corresponding error message will be written to the log file and put on hold (for subsequent display on the screen, if desired) in the latter case.

    BEWARE that the lines returned still have their terminating newline character ("\n"), which you may need to get rid of (e.g. with "chomp")!

  • &WriteFile($target,@contents);

    Writes the given lines of text (or binary data) to the given file.

    It is your responsibility to provide newline characters ("\n") as necessary, the lines of text are simply concatenated (without any intervening characters!) and written to the file.

    (Therefore this routine is also suitable for binary data!)

    You may at your option provide scalars as parameters (which will be written to the file "as is"), or array references, whose contents will be written to the file (also "as is"), or both (mixed).

    Example:

      @msg = ();
      push( @msg, "1st line\n" );
      push( @msg, "2nd line\n" );
      &WriteFile( $target, "Messages:\n\n", \@msg );

    Returns "true" (1) on success and "undef" in case of any error.

    The corresponding error message will be written to the log file and put on hold (for subsequent display on the screen, if desired) in the latter case.

  • &AppendFile($target,$source);

    Appends file "$source" to file "$target" using binary mode.

    Returns "true" (1) on success and "undef" in case of any error.

    The corresponding error message will be written to the log file and put on hold (for subsequent display on the screen, if desired) in the latter case.

  • &ConvertFileWithCallback($target,$source,$callback);

    This is the most flexible method for reading a file, modifying its contents, and writing them to another file.

    The file "$source" is read line by line (the input separator "$/" is set to "\n" (line mode) locally before the file is opened), and for each line, a callback function (provided by you) is called.

    Your callback function should expect two parameters: First, the line just read, and second, this line's line number (you may not need the line number, though, and can safely ignore it).

    After processing the line, your callback function should return the modified line or "undef".

    The returned value is then written to the given "$target" file, provided that the return value is not "undef". If the callback function's return value is "undef", nothing is printed to the output file. (This way, you can delete certain lines from a file!)

    BEWARE that the lines passed to the callback function still have their terminating newline character ("\n"), which you may need to get rid of (e.g. with "chomp") first and back on before returning the line!

    Example of use:

      $cb = sub { my($l) = @_; $l =~ s!\s+$!!; "$l\n"; };
      &ReportErrorAndExit unless
          (defined &ConvertFileWithCallback($target,$source,$cb));

    The function returns "true" (1) on success and "undef" in case of any error.

    The corresponding error message will be written to the log file and put on hold (for subsequent display on the screen, if desired) in the latter case.

  • $printable = &SerializeSimple("varname",$datastructure);

    This function takes the name of a variable and the variable itself as arguments, the latter of which is usually a reference to some data structure.

    The function returns a reference to an array which contains lines that can be printed to the screen or a file. This reference can also be passed to the "WriteFile()" function, which will automatically write the lines in the array to the indicated file.

    Note that the elements of this array already DO have "newline" characters ("\n") at the end of each line.

    As the name of this function indicates, it can only handle simple data structures consisting of SCALARs, ARRAYs, HASHes and REFerences thereof, but no objects, regular expressions, closures or external data structures.

    (See Data::Dumper(3) for a more complete solution.)

    Moreover, it cannot handle self-references and will enter an infinite loop if any self-references are encountered (this will provoke a "deep recursion" warning message printed to the screen).

    The printable lines returned are valid Perl code which can be read back in later from a file using "require" or "eval".

    The name of the variable provided here will then determine which variable the data structure will be assigned to.

    Note that you can set this variable name to anything you like (but your program which reads back the data structure will have to know in advance which variable name to expect), and remember that you can always fully qualify this variable name in order to force it into any given package you want.

  • Semaphore_Passeer($lockfile);

    Protect critical sections in your code with this relatively simple yet usually sufficient file locking mechanism.

    The given file may not be used for anything else, as it will be created and deleted and its contents rewritten.

    In case of an error, the corresponding error message is written to the default logfile and sent to the screen, but the function will keep on trying infinitely.

    There is no specific return value on success.

  • Semaphore_Verlaat($lockfile);

    Leave critical sections in your code by calling this function with the same argument you called "Semaphore_Passeer()" (see immediately above) before the critical section.

    In case of an error, the corresponding error message is written to the default logfile and sent to the screen, and "undef" is returned.

    In case of success a true value is returned.

  • $ticket = GetNextTicket($lockfile,$ticketfile,$min,$max);

    Get ticket numbers, protected by (true) file locking.

    The ticket number is created automatically if it doesn't exist yet (and initialized to the "$min" value given).

    Ticket number values may contain the characters [0-9a-zA-Z] (in any combination).

    The ticket number is incremented automatically at each call of this function (using Perl's "magic" incrementation if the value contains alphanumeric characters).

    When the ticket number exceeds the given "$max" value, it is reset to "$min" (i.e., the function implements automatic wrapping).

    In case file locking is not implemented on your machine, this function uses "Semaphore_Passeer()" and "Semaphore_Verlaat()" (see above) instead, provided that a non-empty lockfile name has been given. Otherwise (if the lockfile name is undefined or empty) no file locking will be performed at all.

    Note that this function will always attempt to unlink (i.e., delete) this lockfile if it is specified before returning.

    Thus it is advantageous to leave the lockfile name undefined or empty if you know that your program will always run on machines which support file locking.

    Note also that the lockfile and the ticketfile must be distinct of course.

    In case of an error, the corresponding error message is written to the default logfile and sent to the screen, execution of the function is aborted and "undef" is returned.

    In case of success the new ticket number is returned.

SEE ALSO

Config::Manager(3), Config::Manager::Base(3), Config::Manager::Conf(3), Config::Manager::PUser(3), Config::Manager::Report(3), Config::Manager::SendMail(3), Config::Manager::User(3).

VERSION

This man page documents "Config::Manager::File" version 1.7.

AUTHORS

 Steffen Beyer <sb@engelschall.com>
 http://www.engelschall.com/u/sb/download/
 Gerhard Albers

COPYRIGHT

 Copyright (c) 2003 by Steffen Beyer & Gerhard Albers.
 All rights reserved.

LICENSE

This package is free software; you can use, modify and redistribute it under the same terms as Perl itself, i.e., under the terms of the "Artistic License" or the "GNU General Public License".

Please refer to the files "Artistic.txt" and "GNU_GPL.txt" in this distribution, respectively, for more details!

DISCLAIMER

This package is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

See the "GNU General Public License" for more details.