DESCRIPTION

Online evaluation metric module.

DESCRIPTION

    Base class of all evaluation metrics.

update

        Update the internal evaluation.

        Parameters
        ----------
        labels : list of NDArray
            The labels of the data.

        preds : list of NDArray
            Predicted values.

reset

        Clear the internal statistics to initial state.

get

        Get the current evaluation result.

        Returns
        -------
        name : str
           Name of the metric.
        value : float
           Value of the evaluation.

DESCRIPTION

    Manage multiple evaluation metrics.

NAME

AI::MXNet::Perplexity

DESCRIPTION

    Calculate perplexity

    Parameters
    ----------
    ignore_label : int or undef
        index of invalid label to ignore when
        counting. usually should be -1. Include
        all entries if undef.

DESCRIPTION

    Custom evaluation metric that takes a NDArray function.

    Parameters
    ----------
    eval_function : subref
        Customized evaluation function.
    name : str, optional
        The name of the metric
    allow_extra_outputs : bool
        If true, the prediction outputs can have extra outputs.
        This is useful in RNN, where the states are also produced
        in outputs for forwarding.

create

    Create an evaluation metric.

    Parameters
    ----------
    metric : str or callable
        The name of the metric, or a function
        providing statistics given pred, label NDArray.