Author image Ted Pedersen
and 1 contributors

NAME - perl script used to score allwords.

SYNOPSIS --ansfile FILE --keyfile FILE


This perl script is similar to the scorer2 C program. Given an answer file and a key file, this program scores the answers against the key and gives the overall precision, recall and F-measure. It also gives results for different part of speech tags. At the end it displays the confusion matrix which presents the errors in identifying part of speech tags.


name of a file containing formatted answers


name of an answer-key file


specific instance to score

For example, --ansfile FILE --keyfile FILE --word have


score allinstances except for these instances. Give a comma separated list of words if you want to use multiple words. For example,

./ --ansfile test.out --keyfile test.key --exceptword have, make, see


Score only specific instances. Valid options are

--score poly score only polysemes instances --score s1nc score only the instances where the most frequent sense is not correct --score polys1c Scoring only the instances where the most frequent sense is correct and the word is polysemes. --score n score only the instances having n number of sense


scorer2 is a C program used to score entries to Senseval. The source code is available for downloading:


 Varada Kolhatkar, University of Minnesota, Duluth
 <kolha002 at>

 Ted Pedersen, University of Minnesota, Duluth
 <tpederse at>

This document last modified by : $Id:,v 1.12 2009/05/24 14:50:37 kvarada Exp $


 L<> L<> L<> L<>


Copyright (C) 2005-2008 by Jason Michelizzi and Ted Pedersen

This program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation; either version 2 of the License, or (at your option) any later version.

This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.

2 POD Errors

The following errors were encountered while parsing the POD:

Around line 417:

'=item' outside of any '=over'

Around line 449:

You forgot a '=back' before '=head1'