NAME
CHANGES - Revision history for WordNet::SenseRelate::AllWords
DESCRIPTION
0.19
Date : May 27, 2009
1) Added --backoff option to wsd.pl. This option backs off to
WordNet sense1 if the measure can't assign any sense.
2) semcor-reformat.pl used querySense and reformatted the original
text that contained the first word in the synset instead of the
original word. It no more uses querySense and the formatted text
contains the original semcor lemmas.
3) Added scripts utils/extract-semcor-plaintext.pl,
utils/extract-semcor-contentwords.pl and
utils/convert-PENN-to-WN.pl.
utils/extract-semcor-plaintext.pl extracts plain text from a
semcor formatted file. The text contains function words, content
words as well as punctuation marks. This text is used for
part-of-speech tagging.
utils/extract-semcor-contentwords.pl extracts content words
given an answer file (typically a plain text file extracted
using extract-semcor-plaintext.pl which has been tagged using a
part of speech tagger) and a key file extracted using
extract-semcor-plaintext.pl --key option.
utils/convert-PENN-to-WN.pl takes PENN treeb bank tagged text
(format word PENNPOS per line) and converts it to WordNet tagged
text.
4) Added default config files
web/cgi-bin/allwords/user_data/lesk-stoplist.conf and
web/cgi-bin/allwords/user_data/vector-stoplist.conf to the web
folder. This is important because if the default config
stoplists are not used for lesk and vector , they end up giving
unexpected results.
5) Changed scorer2-format.pl to format the string only if it is in
word#pos#sense format.
0.18
Date : April 30, 2009
1) Added following options to wsd.pl
--usemono enable assigning the only available sense to monosemy
words
This is a change in AllWords.pm, where we assign the available
sense to monosemy words. This results in increased precision and
overall fmeasure because many measures can not get these words
right as they can't find relatedness with the surrounding words.
2) Added following options to allwords-scorer2.pl
1. --word score only this specific instance
2. --exceptword score all instances except for these instances
3. --score poly score only polysemes instances
4. --score s1nc score only the instances where the most frequent
sense is not correct
5. --score n score only the instances having n number of senses
These options are added in order to carry different experiments.
3) Fixed the script calculate-corpus-stats.pl. This is a perl
script that gives corpus statistics given a semcor-reformatted
corpus file.
0.17
Date : April 2, 2009
1) Fixed AllWords.pm for window=2. If it is the first word in a
sentence and the window size is 2, we now consider a word at the
right of the target word. Otherwise it will not be assigned any
sense. In the previous version we were simply doing sense1 for
such scenario.
2) Added a script calculate-corpus-stats.pl to utils/ which gives
statistics of the reformatted corpus.
0.16
Date : March 16, 2009
1) Fixed wsd.pl and the web interface output for multiword
compounds ( for example, by_and_large).
2) Punctuation fix for the raw format. If the format is raw and if
the context contains words i.e. or el_al., then the period is
not removed.
3) If format is raw and the context contains user identified
compound words (for example St._Petersburg), then the
punctuation is not removed. Please refer README for details.
4) Mapped Penn Treebank IN tag to WordNet 'r'(adverb) part of
speech tag because most of the words in this class have adverb
sense in WordNet.
0.15
Date : February 14, 2009
1) Fixed the links of the default stoplist and nocompoundify option
on the web interface.
0.14
Date : February 13, 2009
1) Added allwords-scorer2.pl script for scoring. This script is
modeled after score2 C program
(http://www.senseval.org/senseval3/scoring). scorer2 C program
is no more used for scoring.
2) Changed wsd.pl and the web interface output format. The output
now displays the original text. For example, if the input text
is 'parking_ticket#n are#v expensive#a' then the output will be
'parking_tickets#n#1 are#v#1 expensive#a#1'. Modified t/wsd.t
for this change.
3) Removed config file option from the web interface
4) Added --nocompoundify option in wsd.pl and the web interface
5) Modified the default stoplist used by the web interface
(web/cgi-bin/allwords/user_data/default-stoplist-raw.txt) and
replicated it to samples/default-stoplist-raw.txt to be used by
wsd.pl.
6) Fixed the ForcePos option on the webinterface.
7) Fixed the web interface crash when the user didn't provide any
stoplist
8) Modified scorer2-format.pl to skip the entries where no sense is
assigned.
9) --scorer2 option is no more provided in wsd-experiments.pl and
the script calls utils/allwords-scorer2.pl.
0.13
Date : January 22, 2009
1) Setup for wsd.pl experiments. Added 2 scripts scorer2-sort.pl
and wsd-experiments.pl. scorer2-sort.pl sorts the output of
scorer2-format.pl so that it can be used as input to the
Senseval scorer2 program. wsd-experiments.pl runs wsd
experiments.
2) Documentation changes in wsd.pl, scorer2-format.pl,
semcor-reformat.pl.
3) Makefile changes to install newly added perl scripts.
0.12
Date : November 03, 2008
1) Fixed client server model for the web interface. The allwords
server can run on a different machine, from where your web
server is running.
2) User data is now stored on the client machine so that it is
easily accessible to the user.
3) Added a mandatory --logfile parameter alomg with other optional
parameters to allwords_server.pl
4) Removed --outfile option from wsd.pl and added --glosses options
to display glosses
5) Moved default-stoplist-raw.txt from
WordNet-SenseRelate-AllWords/web/cgi-bin/allwords to
/WordNet-SenseRelate-AllWords/web/cgi-bin/allwords/user_data
0.11
Date : June 17, 2008
1) Removed compounding logic from AllWords.pm. Compounding is now
done using WordNet::Tools compoundify. The clients, wsd.pl and
allwords_server.pl don't call compoundify any more. They creat
WordNet::Tools object and pass it as a parameter while creating
AllWords object.
2) Moved sentence splitter from wsd.pl to a util program,
sentence_split.pl. All input formats will now assume that input
is one sentence per line, one line per sentence.
3) Removed parsed format test case from t/wsd.t
4) Context was considered as a single line if more than one line
was entered in the textarea on the web interface. Now the input
is considered as one sentence per line, one line per sentence.
0.10
Date : May 29, 2008
1) Added proper error messages for the words which are ignored
during disambiguation. A suffix is attached to the word in order
to indicate why it is ignored for disambiguation. For example,
the word 'the' is not defined in WordNet and hence is ignored.
We attach the#ND to indicate that this word is not defined in
WordNet
2) Added context file and config file option to the Web interface
3) Removed --compounds option from wsd.pl as we decided to use
centralized compoundify module WordNet::Tools
4) Added compoundify in wsd.pl. This is done using the centralized
WordNet::Tools module
5) Removed WordNet::SenseRelate dependency of the Web interface.
Now compoundifying is done using WordNet::Tools
0.09
Date : April 10, 2008 (all changes by TDP)
1) Modified test cases further to check for WordNet version using
WordNet::Tools. Changes introduced in 0.08 testing were based on
WordNet::QueryData's deprecated version test. Now skip all tests
if we don't find version 2.0, 2.1, or 3.0, and introduce version
specific tests within those as needed (if results change from
one version of WordNet to the next).
2) Added reference to Jason Michelizzi's MS thesis, which gives
many details about the AllWords approach, plus experimental
results
0.08
Date : March 20, 2008 (all changes by TDP)
1) Fixed bug in AllWords.pm that caused disambiguate to fail when
window not specified. we now default to window size 3.
2) Fixed synopsis in AllWords.pm to provide a cut and paste program
that should run
3) Modified Makefile.PL to allow for use of 'make dist' and create
META.yml
4) Changed release procedure, now using 'make dist' in order to
avoid CVS export, and also create a directory that unpacks with
a version number.
0.07
Date : March 17, 2008
1) Added web interface support for AllWords (see /web for details)
(vk)
2) Updated version information in AllWords.pm to 0.07 (vk)
3) changed Changes file to CHANGES.pod (tdp)
4) added INSTALL.pod to /web (tdp)
5) updated version, copyright, and author info in README.pod (tdp)
0.06
Thu May 19 14:06:10 2005 (all changes by JM)
1) added fixed mode
0.05
Mon May 02 16:12:36 2005 (all changes by JM)
1) changed definition of context window to be total number of words
2) cleaned up errors in documentation
3) renamed reformat-for-senseval.pl as scorer2-format.pl
4) added command-line help to scorer2-format.pl and
semcor-reformat.pl and expanded documentation
5) changed the compound-finding function so that only collocations
of length MAX_COMPOUND_LENGTH or less are considered.
MAX_COMPOUND_LENGTH is a constant defined in AllWords.pm.
6) added new wntagged format
0.04
Tue Apr 12 10:40:48 2005 (all changes by JM)
1) fixed serious bug that often prevented higher numbered senses of
target words from being considered
2) fixed errors in wsd.pl when --format is omitted
3) added diagnostic messages when stoplist is malformed
4) fixed bug in windowing that prevented window from expanding
under certain circumstances
5) added new traces levels for displaying semantic relatedness
scores and making ouput of zero values optional
6) fixed bug where sense1 and random schemes would fail when used
with a stoplist or tagged text
7) clarified description of window in documentation
8) added sample stoplist
9) suppress irrelevant configuration information when wsd.pl is run
under sense1 or random
10) updated test scripts to reflect recent changes
11) renamed as WordNet::SenseRelate::AllWords
0.03
Fri Mar 11 15:25:18 2005 (all changes by JM)
1) added scripts for converting semcor files and formatting the
output for Senseval
2) added another test script
3) changed the input format(s) to wsd.pl
4) expanded documentation
0.02
Mon Jan 17 10:01:00 2005 (all changes by JM)
1) added part of speech coercion option
2) expanded discussions in README
0.01
Wed Nov 3 12:52:33 2004 (all changes by JM)
1) original version; created by h2xs 1.23 with options -n
WordNet::SenseRelate -X -b 5.6.0
AUTHORS
Varada Kolhatkar, University of Minnesota, Duluth
kolha002 at d.umn.edu
Ted Pedersen, University of Minnesota, Duluth
tpederse at d.umn.edu
This document last modified by : $Id: CHANGES.pod,v 1.23 2009/05/27
21:18:12 kvarada Exp $
SEE ALSO
README, INSTALL, TODO
COPYRIGHT AND LICENSE
Copyright (c) 2008, Varada Kolhatkar, Ted Pedersen, Jason Michelizzi
Permission is granted to copy, distribute and/or modify this document
under the terms of the GNU Free Documentation License, Version 1.2 or
any later version published by the Free Software Foundation; with no
Invariant Sections, no Front-Cover Texts, and no Back-Cover Texts.
Note: a copy of the GNU Free Documentation License is available on the
web at <http://www.gnu.org/copyleft/fdl.html> and is included in this
distribution as FDL.txt.