—# ABSTRACT: Embed your tests in your code, next to what is being tested
#pod =pod
#pod
#pod =head1 DESCRIPTION
#pod
#pod Embedding tests allows tests to be placed near the code being tested.
#pod
#pod This is a nice supplement to the traditional .t files.
#pod
#pod =head2 How does it work?
#pod
#pod C<Test::Inline> lets you write small fragments of general or
#pod function-specific testing code, and insert it anywhere you want in your
#pod modules, inside a specific tagged L<POD|perlpod> segment, like the
#pod following.
#pod
#pod =begin testing
#pod
#pod # This code assumes we have a cpuinfo file
#pod ok( -f /proc/cpuinfo, 'Host has a standard /proc/cpuinfo file' );
#pod
#pod =end testing
#pod
#pod =begin testing label
#pod
#pod # Test generation of the <label> HTML tag
#pod is( My::HTML->label('foo'), '<label>foo</label>', '->label(simple) works' );
#pod is( My::HTML->label('bar', 'foo'), '<label for="bar">foo</label>', '->label(for) works' );
#pod
#pod =end testing
#pod
#pod You can add as many, or as few, of these chunks of tests as you wish.
#pod The key condition when writing them is that they should be logically
#pod independant of each other. Each chunk of testing code should not die
#pod or crash if it is run before or after another chunk.
#pod
#pod Using L<inline2test> or another test compiler, you can then transform
#pod these chunks in a test script, or an entire tree of modules into a
#pod complete set of standard L<Test::More>-based test scripts.
#pod
#pod These test scripts can then be executed as normal.
#pod
#pod =head2 What is Test::Inline good for?
#pod
#pod C<Test::Inline> is incredibly useful for doing ad-hoc unit testing.
#pod
#pod In any large groups of modules, you can add testing code here, there and
#pod everywhere, anywhere you want. The next time the test compiler is run, a
#pod new test script will just appear.
#pod
#pod This also makes it great for testing assumptions you normally wouldn't
#pod bother to write run-time code to test. It ensures that your assumptions
#pod about the way Perl does some operation, or about the state of the host,
#pod are confirmed at install-time.
#pod
#pod If your assumption is ever wrong, it gets picked up at install-time and
#pod based on the test failures, you can correct your assumption.
#pod
#pod It's also extremely useful for systematically testing self-contained code.
#pod
#pod That is, any code which can be independantly tested without the need for
#pod external systems such as databases, and that has no side-effects on external
#pod systems.
#pod
#pod All of this code, written by multiple people, can then have one single set
#pod of test files generated. You can check all the bits and pieces of a large
#pod API, or anything you like, in fine detail.
#pod
#pod Test::Inline also introduces the concept of unit-tested documentation.
#pod
#pod Not only can your code be tested, but if you have a FAQ or some other
#pod pure documentation module, you can validate that the documentation is
#pod correct for the version of the module installed.
#pod
#pod If the module ever changes to break the documentation, you can catch it
#pod and correct the documentation.
#pod
#pod =head2 What is Test::Inline bad for?
#pod
#pod C<Test::Inline> is B<not> a complete testing solution, and there are several
#pod types of testing you probably DON'T want to use it for.
#pod
#pod =over
#pod
#pod =item *
#pod
#pod Static testing across the entire codebase
#pod
#pod =item *
#pod
#pod Functional testing
#pod
#pod =item *
#pod
#pod Tests with side-effects such as those that might change a testing database
#pod
#pod =back
#pod
#pod =head2 Getting Started
#pod
#pod Because Test::Inline creates test scripts with file names that B<don't>
#pod start with a number (for ordering purposes), the first step is to create
#pod your normal test scripts using file names in the CPAN style of
#pod F<01_compile.t>, F<02_main.t>, F<03_foobar.t>, and so on.
#pod
#pod You can then add your testing fragments wherever you like throughout
#pod your code, and use the F<inline2test> script to generate the test scripts
#pod for the inline tests. By default the test scripts will be named after
#pod the packages/classes that the test fragments are found in.
#pod
#pod Tests for Class::Name will end up in the file C<class_name.t>.
#pod
#pod These test files sit quite happily alongside your number test scripts.
#pod
#pod When you run the test suite as you normally would, the inline scripts
#pod will be run after the numbered tests.
#pod
#pod =head1 METHODS
#pod
#pod =cut
use
5.006;
use
strict;
use
IO::Handle ();
use
List::Util 1.19 ();
use
File::Spec 0.80 ();
use
Params::Util 0.21 ();
use
Algorithm::Dependency 1.02 ();
use
Algorithm::Dependency::Source ();
use
Test::Inline::Util ();
use
Test::Inline::Section ();
use
Test::Inline::Script ();
use
Test::Inline::Content ();
use
Test::Inline::Content::Legacy ();
use
Test::Inline::Content::Default ();
use
Test::Inline::Content::Simple ();
use
Test::Inline::Extract ();
use
Test::Inline::IO::File ();
our
$VERSION
=
'2.214'
;
our
@ISA
=
'Algorithm::Dependency::Source'
;
#####################################################################
# Constructor and Accessors
#pod =pod
#pod
#pod =head2 new
#pod
#pod my $Tests = Test::Inline->new(
#pod verbose => 1,
#pod readonly => 1,
#pod output => 'auto',
#pod manifest => 'auto/manifest',
#pod );
#pod
#pod The C<new> constructor creates a new test generation framework. Once the
#pod constructor has been used to create the generator, the C<add_class> method
#pod can be used to specify classes, or class heirachies, to generate tests for.
#pod
#pod B<verbose> - The C<verbose> option causes the generator to write state and
#pod debugging information to STDOUT as it runs.
#pod
#pod B<manifest> - The C<manifest> option, if provided, will cause a manifest
#pod file to be created and written to disk. The manifest file contains a list
#pod of all the test files generated, but listed in the prefered order they
#pod should be processed to best satisfy the class-level dependency of the
#pod tests.
#pod
#pod B<check_count> - The C<check_count> value controls how strictly the
#pod test script will watch the number of tests that have been executed.
#pod
#pod When set to false, the script does no count checking other than the
#pod standard total count for scripts (where all section counts are known)
#pod
#pod When set to C<1> (the default), C<Test::Inline> does smart count checking,
#pod doing section-by-section checking for known-count sections B<only> when
#pod the total for the entire script is not known.
#pod
#pod When set to C<2> or higher, C<Test::Inline> does full count checking,
#pod doing section-by-section checking for every section with a known number
#pod of tests.
#pod
#pod B<file_content> - The C<file_content> option should be provided as a CODE
#pod reference, which will be passed as arguments the C<Test::Inline> object,
#pod and a single L<Test::Inline::Script> object, and should return a string
#pod containing the contents of the resulting test file. This will be written
#pod to the C<OutputHandler>.
#pod
#pod B<output> - The C<output> option provides the location of the directory
#pod where the tests will be written to. It should both already exist, and be
#pod writable. If using a custom C<OutputHandler>, the value of C<output> should
#pod refer to the location B<within the OutputHandler> that the files will be
#pod written to.
#pod
#pod B<readonly> - The C<readonly> option, if provided, indicates that any
#pod generated test files should be created (or set when updated) with
#pod read-only permissions, to prevent accidentally adding to or editing the
#pod test scripts directly (instead of via the classes).
#pod
#pod This option is currently disabled by default, by may be enabled by default
#pod in a future release, so if you do NOT want your tests being created as
#pod read-only, you should explicitly set this option to false.
#pod
#pod B<InputHandler> - The C<InputHandler> option, if provided, supplies an
#pod alternative C<FileHandler> from which source modules are retrieved.
#pod
#pod B<OuputHandler> - The C<OutputHandler> option, if provided, supplies an
#pod alternative C<FileHandler> to which the resulting test scripts are written.
#pod
#pod Returns a new C<Test::Inline> object on success.
#pod
#pod Returns C<undef> if there is a problem with one of the options.
#pod
#pod =cut
# For now, the various Handlers are hard-coded
sub
new {
my
$class
= Params::Util::_CLASS(
shift
);
my
%params
=
@_
;
unless
(
$class
) {
die
'->new is a static method'
;
}
# Create the object
my
$self
=
bless
{
# Return errors via exceptions?
exception
=> !!
$params
{exception},
# Extensibility provided through the use of Handler classes
InputHandler
=>
$params
{InputHandler},
ExtractHandler
=>
$params
{ExtractHandler},
ContentHandler
=>
$params
{ContentHandler},
OutputHandler
=>
$params
{OutputHandler},
# Store the ::TestFile objects
Classes
=> {},
},
$class
;
# Run in verbose mode?
$self
->{verbose} = !!
$params
{verbose};
# Generate tests with read-only permissions?
$self
->{readonly} = !!
$params
{readonly};
# Generate a manifest file?
$self
->{manifest} =
$params
{manifest}
if
$params
{manifest};
# Do count checking?
$self
->{check_count} =
exists
$params
{check_count}
?
$params
{check_count}
?
$params
{check_count} >= 2
? 2
# Paranoid count checking
: 1
# Smart count checking
: 0
# No count checking
: 1;
# Smart count checking (default)
# Support the legacy file_content param
if
(
$params
{file_content} ) {
Params::Util::_CODE(
$params
{file_content}) or
return
undef
;
$self
->{ContentHandler} = Test::Inline::Content::Legacy->new(
$params
{file_content}
) or
return
undef
;
}
# Set the default Handlers
$self
->{ExtractHandler} ||=
'Test::Inline::Extract'
;
$self
->{ContentHandler} ||= Test::Inline::Content::Default->new;
$self
->{InputHandler} ||= Test::Inline::IO::File->new( File::Spec->curdir );
$self
->{OutputHandler} ||= Test::Inline::IO::File->new(
path
=> File::Spec->curdir,
readonly
=>
$self
->{readonly},
);
# Where to write test file to, within the context of the OutputHandler
$self
->{output} =
defined
$params
{output} ?
$params
{output} :
''
;
$self
;
}
#pod =pod
#pod
#pod =head2 exception
#pod
#pod The C<exception> method returns a flag which indicates whether error will
#pod be returned via exceptions.
#pod
#pod =cut
sub
exception {
$_
[0]->{exception};
}
#pod =pod
#pod
#pod =head2 InputHandler
#pod
#pod The C<InputHandler> method returns the file handler object that will be
#pod used to find and load the source code.
#pod
#pod =cut
sub
InputHandler {
$_
[0]->{InputHandler};
}
#pod =pod
#pod
#pod =head2 ExtractHandler
#pod
#pod The C<ExtractHandler> accessor returns the object that will be used
#pod to extract the test sections from the source code.
#pod
#pod =cut
sub
ExtractHandler {
$_
[0]->{ExtractHandler};
}
#pod =pod
#pod
#pod =head2 ContentHandler
#pod
#pod The C<ContentHandler> accessor return the script content generation handler.
#pod
#pod =cut
sub
ContentHandler {
$_
[0]->{ContentHandler};
}
#pod =pod
#pod
#pod =head2 OutputHandler
#pod
#pod The C<OutputHandler> accessor returns the file handler object that the
#pod generated test scripts will be written to.
#pod
#pod =cut
sub
OutputHandler {
$_
[0]->{OutputHandler};
}
#####################################################################
# Test::Inline Methods
#pod =pod
#pod
#pod =head2 add $file, $directory, \$source, $Handle
#pod
#pod The C<add> method is a parameter-sensitive method for adding something
#pod to the build schedule.
#pod
#pod It takes as argument a file path, a directory path, a reference to a SCALAR
#pod containing perl code, or an L<IO::Handle> (or subclass) object. It will
#pod retrieve code from the parameter as appropriate, parse it, and create zero
#pod or more L<Test::Inline::Script> objects representing the test scripts that
#pod will be generated for that source code.
#pod
#pod Returns the number of test scripts added, which could be zero, or C<undef>
#pod on error.
#pod
#pod =cut
sub
add {
my
$self
=
shift
;
my
$source
=
$self
->_source(
shift
) or
return
undef
;
if
(
ref
$source
) {
# Add a chunk of source code
return
$self
->_add_source(
$source
);
}
else
{
# Add a whole directory
return
$self
->_add_directory(
$source
);
}
}
#pod =pod
#pod
#pod =head2 add_class
#pod
#pod $Tests->add_class( 'Foo::Bar' );
#pod $Tests->add_class( 'Foo::Bar', recursive => 1 );
#pod
#pod The C<add_class> method adds a class to the list of those to have their tests
#pod generated. Optionally, the C<recursive> option can be provided to add not just
#pod the class you provide, but all classes below it as well.
#pod
#pod Returns the number of classes found with inline tests, and added, including
#pod C<0> if no classes with tests are found. Returns C<undef> if an error occurs
#pod while adding the class or it's children.
#pod
#pod =cut
sub
add_class {
my
$self
=
shift
;
my
$name
=
shift
or
return
undef
;
my
%options
=
@_
;
# Determine the files to add
$self
->_verbose(
"Checking $name\n"
);
my
$files
=
$options
{recursive}
?
$self
->InputHandler->find(
$name
)
:
$self
->InputHandler->file(
$name
);
return
$files
unless
$files
;
# 0 or undef
# Add the files
my
$added
= 0;
foreach
my
$file
(
@$files
) {
my
$rv
=
$self
->add(
$file
);
return
undef
unless
defined
$rv
;
$added
+=
$rv
;
}
# Clear the caches
delete
$self
->{schedule};
delete
$self
->{filenames};
$added
;
}
#pod =pod
#pod
#pod =head2 add_all
#pod
#pod The C<add_all> method will search the C<InputHandler> for all *.pm files,
#pod and add them to the generation set.
#pod
#pod Returns the total number of test scripts added, which may be zero, or
#pod C<undef> on error.
#pod
#pod =cut
sub
add_all {
my
$self
=
shift
;
my
$rv
=
eval
{
$self
->_add_directory(
'.'
);
};
return
$self
->_error($@)
if
$@;
return
$rv
;
}
# Recursively add an entire directory of files
sub
_add_directory {
my
$self
=
shift
;
# Find all module files in the directory
my
$files
=
$self
->InputHandler->find(
shift
) or
return
undef
;
# Add each file
my
$added
= 0;
foreach
my
$file
(
@$files
) {
my
$source
=
$self
->InputHandler->
read
(
$file
) or
return
undef
;
my
$rv
=
$self
->_add_source(
$source
);
return
undef
unless
defined
$rv
;
$added
+=
$rv
;
}
$added
;
}
# Actually add the source code
sub
_add_source {
my
$self
=
shift
;
my
$source
= Params::Util::_SCALAR(
shift
) or
return
undef
;
# Extract the elements from the source code
my
$Extract
=
$self
->ExtractHandler->new(
$source
)
or
return
$self
->_error(
"Failed to create ExtractHandler"
);
my
$elements
=
$Extract
->elements or
return
0;
# Parse the elements into sections
my
$Sections
= Test::Inline::Section->parse(
$elements
)
or
return
$self
->_error(
"Failed to parse sections: $Test::Inline::Section::errstr"
);
# Split up the Sections by class
my
%classes
= ();
foreach
my
$Section
(
@$Sections
) {
# All sections MUST have a package
my
$context
=
$Section
->context
or
return
$self
->_error(
"Section does not have a package context"
);
$classes
{
$context
} ||= [];
push
@{
$classes
{
$context
}},
$Section
;
}
# Convert the collection of Sections into class-specific test file objects
my
$added
= 0;
my
$Classes
=
$self
->{Classes};
foreach
my
$_class
(
keys
%classes
) {
# We can't safely spread tests for the same class across
# different files. Error if we spot a duplicate.
if
(
$Classes
->{
$_class
} ) {
return
$self
->_error(
"Caught duplicate test class"
);
}
# Create a new ::TestFile object for the collection of Sections
my
$File
= Test::Inline::Script->new(
$_class
,
$classes
{
$_class
},
$self
->{check_count}
) or
return
$self
->_error(
"Failed to create a new TestFile for '$_class'"
);
$self
->_verbose(
"Adding $File to schedule\n"
);
$Classes
->{
$_class
} =
$File
;
$added
++;
}
$added
++;
}
#pod =pod
#pod
#pod =head2 classes
#pod
#pod The C<classes> method returns a list of the names of all the classes that
#pod have been added to the C<Test::Inline> object, or the null list C<()> if
#pod nothing has been added.
#pod
#pod =cut
sub
classes {
my
$self
=
shift
;
sort
keys
%{
$self
->{Classes}};
}
#pod =pod
#pod
#pod =head2 class
#pod
#pod For a given class name, fetches the L<Test::Inline::Script> object for that
#pod class, if it has been added to the C<Test::Inline> object. Returns C<undef>
#pod if the class has not been added to the C<Test::Inline> object.
#pod
#pod =cut
sub
class {
$_
[0]->{Classes}->{
$_
[1]} }
#pod =pod
#pod
#pod =head2 filenames
#pod
#pod For all of the classes added, the C<filenames> method generates a map of the
#pod filenames that the test files for the various classes should be written to.
#pod
#pod Returns a reference to a hash with the classes as keys, and filenames as
#pod values.
#pod
#pod Returns C<0> if there are no files to write.
#pod
#pod Returns C<undef> on error.
#pod
#pod =cut
sub
filenames {
my
$self
=
shift
;
return
$self
->{filenames}
if
$self
->{filenames};
# Create an Algorithm::Dependency for the classes
my
$Algorithm
= Algorithm::Dependency::Ordered->new(
source
=>
$self
,
ignore_orphans
=> 1,
) or
return
undef
;
# Get the build schedule
$self
->_verbose(
"Checking dependencies\n"
);
unless
(
$Algorithm
->source->items ) {
return
0;
}
my
$schedule
=
$Algorithm
->schedule_all or
return
undef
;
# Merge the test position counter with the class base names
my
%filenames
= ();
for
(
my
$i
= 0;
$i
<=
$#$schedule
;
$i
++ ) {
my
$class
=
$schedule
->[
$i
];
$filenames
{
$class
} =
$self
->{Classes}->{
$class
}->filename;
}
$self
->{schedule} = [
map
{
$filenames
{
$_
} }
@$schedule
];
$self
->{filenames} = \
%filenames
;
}
#pod =pod
#pod
#pod =head2 schedule
#pod
#pod While the C<filenames> method generates a map of the files for the
#pod various classes, the C<schedule> returns the list of file names in the
#pod order in which they should actually be executed.
#pod
#pod Returns a reference to an array containing the file names as strings.
#pod
#pod Returns C<0> if there are no files to write.
#pod
#pod Returns C<undef> on error.
#pod
#pod =cut
sub
schedule {
my
$self
=
shift
;
return
$self
->{schedule}
if
$self
->{schedule};
# Generate the file names and schedule
$self
->filenames or
return
undef
;
$self
->{schedule};
}
#pod =pod
#pod
#pod =head2 manifest
#pod
#pod The C<manifest> generates the contents of the manifest file, if it is both
#pod wanted and needed.
#pod
#pod Returns the contents of the manifest file as a normal string, false if it
#pod is either not wanted or needed, or C<undef> on error.
#pod
#pod =cut
sub
manifest {
my
$self
=
shift
;
# Do we need to create a file?
my
$schedule
=
$self
->schedule or
return
undef
;
return
''
unless
$self
->{manifest};
return
''
unless
@$schedule
;
# Each manifest entry should be listed by it's path relative to
# the location of the manifest file.
my
$manifest_dir
= (File::Spec->splitpath(
$self
->{manifest}))[1];
my
$relative_path
= Test::Inline::Util->relative(
$manifest_dir
=>
$self
->{output},
);
return
undef
unless
defined
$relative_path
;
# Generate and merge the manifest entries
my
@manifest
=
@$schedule
;
if
(
length
$relative_path
) {
@manifest
=
map
{ File::Spec->catfile(
$relative_path
,
$_
) }
@manifest
;
}
join
''
,
map
{
"$_\n"
}
@manifest
;
}
#pod =pod
#pod
#pod =head2 save
#pod
#pod $Tests->save;
#pod
#pod The C<save> method generates the test files for all classes, and saves them
#pod to the C<output> directory.
#pod
#pod Returns the number of test files generated. Returns C<undef> on error.
#pod
#pod =cut
sub
save {
my
$self
=
shift
;
# Get the file names to save to
my
$filenames
=
$self
->filenames;
return
$filenames
unless
$filenames
;
# undef or 0
# Write the manifest if needed
my
$manifest
=
$self
->manifest;
return
undef
unless
defined
$manifest
;
if
(
$manifest
) {
if
(
$self
->OutputHandler->
write
(
$self
->{manifest},
$manifest
) ) {
$self
->_verbose(
"Wrote manifest file '$self->{manifest}'\n"
);
}
else
{
$self
->_verbose(
"Failed to write manifest file '$self->{manifest}'\n"
);
return
undef
;
}
}
# Write the files
my
$written
= 0;
foreach
my
$class
(
sort
keys
%$filenames
) {
$self
->_save(
$class
) or
return
undef
;
$written
++;
}
$written
;
}
sub
_file {
my
$self
=
shift
;
my
$filenames
=
$self
->filenames or
return
undef
;
$filenames
->{
$_
[0]};
}
sub
_save {
my
$self
=
shift
;
my
$class
=
shift
or
return
undef
;
my
$filename
=
$self
->_file(
$class
) or
return
undef
;
local
$| = 1;
# Write the file
my
$content
=
$self
->_content(
$class
) or
return
undef
;
$self
->_verbose(
"Saving..."
);
if
(
$self
->{output} ) {
$filename
= File::Spec->catfile(
$self
->{output},
$filename
);
}
unless
(
$self
->OutputHandler->
write
(
$filename
,
$content
) ) {
$self
->_verbose(
"Failed\n"
);
return
undef
;
}
$self
->_verbose(
"Done\n"
);
1;
}
sub
_content {
my
$self
=
shift
;
my
$class
=
shift
or
return
undef
;
my
$filename
=
$self
->_file(
$class
) or
return
undef
;
my
$Script
=
$self
->class(
$class
) or
return
undef
;
# Get the file content
$self
->_verbose(
"Generating $filename for $class..."
);
my
$content
=
$self
->ContentHandler->process(
$self
,
$Script
);
$self
->_verbose(
"Failed\n"
)
unless
defined
$content
;
$content
;
# content or undef
}
#####################################################################
# Implement the Algorithm::Dependency::Source Interface
sub
load { 1 }
sub
item {
$_
[0]->{Classes}->{
$_
[1]} }
sub
items {
my
$classes
=
shift
->{Classes};
map
{
$classes
->{
$_
} }
sort
keys
%$classes
;
}
#####################################################################
# Support Methods
# Get the source code from a variety of places
sub
_source {
my
$self
=
shift
;
return
undef
unless
defined
$_
[0];
unless
(
ref
$_
[0] ) {
if
(
$self
->InputHandler->exists_file(
$_
[0]) ) {
# File path
return
$self
->InputHandler->
read
(
shift
);
}
elsif
(
$self
->InputHandler->exists_dir(
$_
[0]) ) {
# Directory path
return
shift
;
# Handled seperately
}
return
undef
;
}
if
( Params::Util::_SCALAR(
$_
[0]) ) {
# Reference to SCALAR containing code
return
shift
;
}
if
( Params::Util::_INSTANCE(
$_
[0],
'IO::Handle'
) ) {
my
$fh
=
shift
;
my
$old
=
$fh
->input_record_separator(
undef
);
my
$code
=
$fh
->getline;
$fh
->input_record_separator(
$old
);
return
\
$code
;
}
# Unknown
undef
;
}
# Print a message if we are in verbose mode
sub
_verbose {
my
$self
=
shift
;
return
1
unless
$self
->{verbose};
@_
;
}
# Warn and return
sub
_error {
my
$self
=
shift
;
if
(
$self
->exception ) {
Carp::croak(
"Error: $_[0]"
);
}
$self
->_verbose(
map
{
"Error: $_"
}
@_
);
undef
;
}
1;
__END__
=pod
=encoding UTF-8
=head1 NAME
Test::Inline - Embed your tests in your code, next to what is being tested
=head1 VERSION
version 2.214
=head1 DESCRIPTION
Embedding tests allows tests to be placed near the code being tested.
This is a nice supplement to the traditional .t files.
=head2 How does it work?
C<Test::Inline> lets you write small fragments of general or
function-specific testing code, and insert it anywhere you want in your
modules, inside a specific tagged L<POD|perlpod> segment, like the
following.
=begin testing
# This code assumes we have a cpuinfo file
ok( -f /proc/cpuinfo, 'Host has a standard /proc/cpuinfo file' );
=end testing
=begin testing label
# Test generation of the <label> HTML tag
is( My::HTML->label('foo'), '<label>foo</label>', '->label(simple) works' );
is( My::HTML->label('bar', 'foo'), '<label for="bar">foo</label>', '->label(for) works' );
=end testing
You can add as many, or as few, of these chunks of tests as you wish.
The key condition when writing them is that they should be logically
independant of each other. Each chunk of testing code should not die
or crash if it is run before or after another chunk.
Using L<inline2test> or another test compiler, you can then transform
these chunks in a test script, or an entire tree of modules into a
complete set of standard L<Test::More>-based test scripts.
These test scripts can then be executed as normal.
=head2 What is Test::Inline good for?
C<Test::Inline> is incredibly useful for doing ad-hoc unit testing.
In any large groups of modules, you can add testing code here, there and
everywhere, anywhere you want. The next time the test compiler is run, a
new test script will just appear.
This also makes it great for testing assumptions you normally wouldn't
bother to write run-time code to test. It ensures that your assumptions
about the way Perl does some operation, or about the state of the host,
are confirmed at install-time.
If your assumption is ever wrong, it gets picked up at install-time and
based on the test failures, you can correct your assumption.
It's also extremely useful for systematically testing self-contained code.
That is, any code which can be independantly tested without the need for
external systems such as databases, and that has no side-effects on external
systems.
All of this code, written by multiple people, can then have one single set
of test files generated. You can check all the bits and pieces of a large
API, or anything you like, in fine detail.
Test::Inline also introduces the concept of unit-tested documentation.
Not only can your code be tested, but if you have a FAQ or some other
pure documentation module, you can validate that the documentation is
correct for the version of the module installed.
If the module ever changes to break the documentation, you can catch it
and correct the documentation.
=head2 What is Test::Inline bad for?
C<Test::Inline> is B<not> a complete testing solution, and there are several
types of testing you probably DON'T want to use it for.
=over
=item *
Static testing across the entire codebase
=item *
Functional testing
=item *
Tests with side-effects such as those that might change a testing database
=back
=head2 Getting Started
Because Test::Inline creates test scripts with file names that B<don't>
start with a number (for ordering purposes), the first step is to create
your normal test scripts using file names in the CPAN style of
F<01_compile.t>, F<02_main.t>, F<03_foobar.t>, and so on.
You can then add your testing fragments wherever you like throughout
your code, and use the F<inline2test> script to generate the test scripts
for the inline tests. By default the test scripts will be named after
the packages/classes that the test fragments are found in.
Tests for Class::Name will end up in the file C<class_name.t>.
These test files sit quite happily alongside your number test scripts.
When you run the test suite as you normally would, the inline scripts
will be run after the numbered tests.
=head1 METHODS
=head2 new
my $Tests = Test::Inline->new(
verbose => 1,
readonly => 1,
output => 'auto',
manifest => 'auto/manifest',
);
The C<new> constructor creates a new test generation framework. Once the
constructor has been used to create the generator, the C<add_class> method
can be used to specify classes, or class heirachies, to generate tests for.
B<verbose> - The C<verbose> option causes the generator to write state and
debugging information to STDOUT as it runs.
B<manifest> - The C<manifest> option, if provided, will cause a manifest
file to be created and written to disk. The manifest file contains a list
of all the test files generated, but listed in the prefered order they
should be processed to best satisfy the class-level dependency of the
tests.
B<check_count> - The C<check_count> value controls how strictly the
test script will watch the number of tests that have been executed.
When set to false, the script does no count checking other than the
standard total count for scripts (where all section counts are known)
When set to C<1> (the default), C<Test::Inline> does smart count checking,
doing section-by-section checking for known-count sections B<only> when
the total for the entire script is not known.
When set to C<2> or higher, C<Test::Inline> does full count checking,
doing section-by-section checking for every section with a known number
of tests.
B<file_content> - The C<file_content> option should be provided as a CODE
reference, which will be passed as arguments the C<Test::Inline> object,
and a single L<Test::Inline::Script> object, and should return a string
containing the contents of the resulting test file. This will be written
to the C<OutputHandler>.
B<output> - The C<output> option provides the location of the directory
where the tests will be written to. It should both already exist, and be
writable. If using a custom C<OutputHandler>, the value of C<output> should
refer to the location B<within the OutputHandler> that the files will be
written to.
B<readonly> - The C<readonly> option, if provided, indicates that any
generated test files should be created (or set when updated) with
read-only permissions, to prevent accidentally adding to or editing the
test scripts directly (instead of via the classes).
This option is currently disabled by default, by may be enabled by default
in a future release, so if you do NOT want your tests being created as
read-only, you should explicitly set this option to false.
B<InputHandler> - The C<InputHandler> option, if provided, supplies an
alternative C<FileHandler> from which source modules are retrieved.
B<OuputHandler> - The C<OutputHandler> option, if provided, supplies an
alternative C<FileHandler> to which the resulting test scripts are written.
Returns a new C<Test::Inline> object on success.
Returns C<undef> if there is a problem with one of the options.
=head2 exception
The C<exception> method returns a flag which indicates whether error will
be returned via exceptions.
=head2 InputHandler
The C<InputHandler> method returns the file handler object that will be
used to find and load the source code.
=head2 ExtractHandler
The C<ExtractHandler> accessor returns the object that will be used
to extract the test sections from the source code.
=head2 ContentHandler
The C<ContentHandler> accessor return the script content generation handler.
=head2 OutputHandler
The C<OutputHandler> accessor returns the file handler object that the
generated test scripts will be written to.
=head2 add $file, $directory, \$source, $Handle
The C<add> method is a parameter-sensitive method for adding something
to the build schedule.
It takes as argument a file path, a directory path, a reference to a SCALAR
containing perl code, or an L<IO::Handle> (or subclass) object. It will
retrieve code from the parameter as appropriate, parse it, and create zero
or more L<Test::Inline::Script> objects representing the test scripts that
will be generated for that source code.
Returns the number of test scripts added, which could be zero, or C<undef>
on error.
=head2 add_class
$Tests->add_class( 'Foo::Bar' );
$Tests->add_class( 'Foo::Bar', recursive => 1 );
The C<add_class> method adds a class to the list of those to have their tests
generated. Optionally, the C<recursive> option can be provided to add not just
the class you provide, but all classes below it as well.
Returns the number of classes found with inline tests, and added, including
C<0> if no classes with tests are found. Returns C<undef> if an error occurs
while adding the class or it's children.
=head2 add_all
The C<add_all> method will search the C<InputHandler> for all *.pm files,
and add them to the generation set.
Returns the total number of test scripts added, which may be zero, or
C<undef> on error.
=head2 classes
The C<classes> method returns a list of the names of all the classes that
have been added to the C<Test::Inline> object, or the null list C<()> if
nothing has been added.
=head2 class
For a given class name, fetches the L<Test::Inline::Script> object for that
class, if it has been added to the C<Test::Inline> object. Returns C<undef>
if the class has not been added to the C<Test::Inline> object.
=head2 filenames
For all of the classes added, the C<filenames> method generates a map of the
filenames that the test files for the various classes should be written to.
Returns a reference to a hash with the classes as keys, and filenames as
values.
Returns C<0> if there are no files to write.
Returns C<undef> on error.
=head2 schedule
While the C<filenames> method generates a map of the files for the
various classes, the C<schedule> returns the list of file names in the
order in which they should actually be executed.
Returns a reference to an array containing the file names as strings.
Returns C<0> if there are no files to write.
Returns C<undef> on error.
=head2 manifest
The C<manifest> generates the contents of the manifest file, if it is both
wanted and needed.
Returns the contents of the manifest file as a normal string, false if it
is either not wanted or needed, or C<undef> on error.
=head2 save
$Tests->save;
The C<save> method generates the test files for all classes, and saves them
to the C<output> directory.
Returns the number of test files generated. Returns C<undef> on error.
=head1 TO DO
- Add support for C<example> sections
- Add support for C<=for> sections
=head1 ACKNOWLEDGEMENTS
Thank you to Phase N (L<http://phase-n.com/>) for permitting
the open sourcing and release of this distribution.
=head1 BUGS
The "Extended =begin" syntax used for non-trivial sections is not formalised
as part of the POD spec yet, although it is on the track to being included.
While simple '=begin testing' sections are fine and will pass POD testing,
extended begin sections may cause POD errors.
Bugs may be submitted through L<the RT bug tracker|https://rt.cpan.org/Public/Dist/Display.html?Name=Test-Inline>
(or L<bug-Test-Inline@rt.cpan.org|mailto:bug-Test-Inline@rt.cpan.org>).
=head1 AUTHOR
Adam Kennedy <adamk@cpan.org>
=head1 CONTRIBUTORS
=for stopwords Adam Kennedy Karen Etheridge Ricardo Signes
=over 4
=item *
Adam Kennedy <adam@ali.as>
=item *
Karen Etheridge <ether@cpan.org>
=item *
Ricardo Signes <rjbs@cpan.org>
=back
=head1 COPYRIGHT AND LICENSE
This software is copyright (c) 2003 by Adam Kennedy.
This is free software; you can redistribute it and/or modify it under
the same terms as the Perl 5 programming language system itself.
=cut