The Perl Toolchain Summit needs more sponsors. If your company depends on Perl, please support this very important event.

TITLE

Parrot's internal data types

VERSION

1.3

CURRENT

     Maintainer: Dan Sugalski <dan@sidhe.org>
     Class: Internals
     PDD Number: 4
     Version: 1.3
     Status: Developing
     Last Modified: 02 July 2001
     PDD Format: 1
     Language: English

HISTORY

Version 1.3, 2 July 2001
Version 1.2, 2 July 2001
Version 1.1, 2 March 2001
Version 1, 1 March 2001

CHANGES

Version 1.3

Fixed some silly typos and dropped phrases.

Took all the underscores out of the field names.

Version 1.2

The string header format has changed some to allow for type tagging. The flags information for strings has changed as well.

Version 1.1

INT and NUM are now concepts rather than data structures, as making them data structures was a Bad Idea.

Version 1

None. First version

ABSTRACT

This PDD describes Parrot's internal data types.

DESCRIPTION

This PDD details the primitive datatypes that the Parrot core knows how to deal with. These types may be at a lower-level than those used by high level languages running on top of Parrot.

IMPLEMENTATION

Integer data types

Integer data types are generically referred to as INTs. INTs are conceptual things and there is no data structure that corresponds to them.

Platform-native integer

These are whatever size native integer was chosen at Parrot configuration time. The C-level typedefs INTVAL and UINTVAL get you a platform-native signed and unsigned integer respectively.

Arbitrary precision integers

Big integers, or bigints, are arbitrary-length integer numbers. The only limit to the number of digits in a bigint is the lesser of the amount of memory available or the maximum value that can be represented by a UINTVAL. This will generally allow at least 4 billion digits, which ought to be far more than enough for anyone.

The C structure that represents a bigint is:

   struct bigint {
     void *buffer;
     UINTVAL length;
     INTVAL exponent;
     UINTVAL flags;
   }

The buffer pointer points to the buffer holding the actual number, length is the length of the buffer, exponent is the base 10 exponent for the number (so 2e4532 doesn't take up much space), and flags are some flags for the bigint.

Note:The flags and exponent fields may be generally unused, but are in to make the base structure identical in size and field types to other structures. They may be removed before the first release of perl 6.

TODO: bring this up to date

Floating point data types

Floating point data types are generically referred to as NUMs. Like INTs, NUMs are conceptual things, not real data structures.

Platform native float

These are whatever size float was chosen when parrot was configured. The C level typedef FLOATVAL will get you one of these.

Arbitrary precision decimal numbers

Arbitrary precision decimal numbers, or bignums, can have any number of digits before and after the decimal point. They are represented by the structure:

   struct bignum {
     void *buffer;
     UINTVAL length;
     INTVAL exponent;
     UINTVAL flags;
   }

and yes, this looks identical to the bigint structure. This isn't accidental. Upgrading a bigint to a bignum should be quick.

TODO: bring this up to date

String data types

Parrot has a single internal string form:

   struct parrot_string_t {
     pobj_t obj;
     UINTVAL bufused;
     void *strstart;
     UINTVAL strlen;
     const ENCODING *encoding;
     const CHARTYPE *type;
     INTVAL language;
   }

The fields are:

obj

A pointer to a Parrot object, Parrot's most general internal data type. In this case, it holds the buffer for the string data, the size of the buffer in bytes, and any applicable flags.

bufused

The amount of the buffer currently in use, in bytes.

strstart

A pointer to the beginning of the actual string (which may not be positioned at the start of the buffer).

strlen

The length of the string, in characters.

encoding

How the data is encoded, for example fixed 8-bit characters, UTF-8, or UTF-32. Note that this specifies encoding only -- it's valid to encode EBCDIC characters with the UTF-8 algorithm. Silly, but valid.

The ENCODING structure specifies the encoding (by index number and by name, for ease of lookup), the maximum number of bytes that a single character will occupy in that encoding, as well as functions for manipulating strings with that encoding.

type

What sort of string data is in the buffer, for example ASCII, EBCDIC, or Unicode.

The CHARTYPE structure specifies the character type (by index number and by name) and provides functions for transcoding to and from that character type.

language

TODO: explain what this is for.

TODO: Parrot's other internal datatypes

ATTACHMENTS

None

REFERENCES

The perl modules Math::BigInt and Math::BigFloat. The Unicode standard at http://www.unicode.org.

GLOSSARY

Type

Type refers to a low-level perl data type, such as a string or integer.

Class

Class refers to a higher-level piece of perl data. Each class has its own vtable, which is a class' distinguishing mark. Classes live one step below the perl source level, and should not be confused with perl packages.

Package

A package is a perl source level construct.