Paws::SageMaker::ShuffleConfig
This class represents one of two things:
Use the attributes of this class as arguments to methods. You shouldn't make instances of this class. Each attribute should be used as a named argument in the calls that expect this type of object.
As an example, if Att1 is expected to be a Paws::SageMaker::ShuffleConfig object:
$service_obj->Method(Att1 => { Seed => $value, ..., Seed => $value });
Use accessors for each attribute. If Att1 is expected to be an Paws::SageMaker::ShuffleConfig object:
$result = $service_obj->Method(...); $result->Att1->Seed
A configuration for a shuffle option for input data in a channel. If you use S3Prefix for S3DataType, the results of the S3 key prefix matches are shuffled. If you use ManifestFile, the order of the S3 object references in the ManifestFile is shuffled. If you use AugmentedManifestFile, the order of the JSON lines in the AugmentedManifestFile is shuffled. The shuffling order is determined using the Seed value.
S3Prefix
S3DataType
ManifestFile
AugmentedManifestFile
Seed
For Pipe input mode, when ShuffleConfig is specified shuffling is done at the start of every epoch. With large datasets, this ensures that the order of the training data is different for each epoch, and it helps reduce bias and possible overfitting. In a multi-node training job when ShuffleConfig is combined with S3DataDistributionType of ShardedByS3Key, the data is shuffled across nodes so that the content sent to a particular node on the first epoch might be sent to a different node on the second epoch.
ShuffleConfig
S3DataDistributionType
ShardedByS3Key
Determines the shuffling order in ShuffleConfig value.
This class forms part of Paws, describing an object used in Paws::SageMaker
The source code is located here: https://github.com/pplu/aws-sdk-perl
Please report bugs to: https://github.com/pplu/aws-sdk-perl/issues
To install Paws, copy and paste the appropriate command in to your terminal.
cpanm
cpanm Paws
CPAN shell
perl -MCPAN -e shell install Paws
For more information on module installation, please visit the detailed CPAN module installation guide.