NAME

allwords-scorer2.pl - perl script used to score allwords.

SYNOPSIS

allwords-scorer2.pl --ansfile FILE --keyfile FILE

DESCRIPTION

This perl script is similar to the scorer2 C program. Given an answer file and a key file, this program scores the answers against the key and gives the overall precision, recall and F-measure. It also gives results for different part of speech tags. At the end it displays the confusion matrix which presents the errors in identifying part of speech tags.

--ansfile

name of a file containing formatted answers

--keyfile

name of an answer-key file

--word

specific instance to score

For example, allwords-scorer2.pl --ansfile FILE --keyfile FILE --word have

--exceptword

score allinstances except for these instances. Give a comma separated list of words if you want to use multiple words. For example,

./allwords-scorer2.pl --ansfile test.out --keyfile test.key --exceptword have, make, see

--score

Score only specific instances. Valid options are

--score poly score only polysemes instances --score s1nc score only the instances where the most frequent sense is not correct --score polys1c Scoring only the instances where the most frequent sense is correct and the word is polysemes. --score n score only the instances having n number of sense

scorer2

scorer2 is a C program used to score entries to Senseval. The source code is available for downloading:

http://www.senseval.org/senseval3/scoring

AUTHORS

 Varada Kolhatkar, University of Minnesota, Duluth
 <kolha002 at d.umn.edu>

 Ted Pedersen, University of Minnesota, Duluth
 <tpederse at d.umn.edu>

This document last modified by : $Id: allwords-scorer2.pl,v 1.12 2009/05/24 14:50:37 kvarada Exp $

SEE ALSO

 L<scorer2-format.pl> L<semcor-reformat.pl> L<wsd-experiments.pl> L<scorer2-sort.pl>

COPYRIGHT

Copyright (C) 2005-2008 by Jason Michelizzi and Ted Pedersen

This program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation; either version 2 of the License, or (at your option) any later version.

This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.