<?xml version="1.0"?><!DOCTYPE article SYSTEM "/project/take/software/searchbench_offline_processing/paperxml_generator/aclextractor/src/python/../resource/dtd/paperxml.dtd"><article><header><firstpageheader><page local="1" global="398"/><title>UNIBA: JIGSAW algorithm for Word Sense Disambiguation</title><pubinfo>Proceedings of the 4th International Workshop on Semantic Evaluations (SemEval-2007),pages 398-401, Prague, June 2007. ©2007 Association for Computational Linguistics</pubinfo><author surname="Basile" givenname="Pierpaolo"><org  name="University of Bari" country="Italy" city="Bari"/></author><author surname="Gentile" givenname="Anna Lisa"><org  name="University of Bari" country="Italy" city="Bari"/></author><author surname="Lops" givenname="Pasquale"><org  name="University of Bari" country="Italy" city="Bari"/></author><author surname="Semeraro" givenname="Giovanni"><org  name="University of Bari" country="Italy" city="Bari"/></author><author surname="de Gemmis" givenname="Marco"><org  name="University of Bari" country="Italy" city="Bari"/></author></firstpageheader><frontmatter><p><b>UNIBA: JIGSAW algorithm for Word Sense Disambiguation</b></p><p><b>P.</b><b> Basile </b>and <b>M. de Gemmis </b>and <b>A.L. Gentile </b>and <b>P.</b><b> Lops </b>and <b>G. Semeraro</b></p><p>Department of Computer Science - University of Bari - Via E. Orabona, 4 70125 Bari ITALY</p><p>{basilepp,  degemmis,  al.gentile,  lops, semeraro}@di.uniba.it</p></frontmatter><abstract>Word Sense Disambiguation (WSD) is tra­ditionally considered an AI-hard problem. A breakthrough in this field would have a significant impact on many relevant web-based applications, such as information re­trieval and information extraction. This pa­per describes JIGSAW, a knowledge-based WSD system that attemps to disambiguate all words in a text by exploiting WordNet<footnote anchor="1"/>senses. The main assumption is that a spe­cific strategy for each Part-Of-Speech (POS) is better than a single strategy. We evalu­ated the accuracy of JIGSAW on SemEval-2007 task 1 competition<footnote anchor="2"/>. This task is an application-driven one, where the applica­tion is a fixed cross-lingual information re­trieval system. Participants disambiguate text by assigning WordNet synsets, then the system has to do the expansion to other lan­guages, index the expanded documents and run the retrieval for all the languages in batch. The retrieval results are taken as a measure for the effectiveness of the disam­biguation. </abstract></header><body><section number="1" title="The JIGSAW algorithm"><p>The goal of a WSD algorithm consists in assigning a word <i>wi </i>occurring in a document <i>d </i>with its appro­priate meaning or sense s, by exploiting the <i>context C </i>in where <i>wi </i>is found. The context <i>C </i>for <i>wi </i>is de­fined as a set of words that precede and follow wi. The sense <i>s </i>is selected from a predefined set of pos­sibilities, usually known as <i>sense inventory. </i>In the proposed algorithm, the sense inventory is obtained from WordNet 1.6, according to SemEval-2007 task 1 instructions. JIGSAW is a WSD algorithm based on the idea of combining three different strategies to disambiguate nouns, verbs, adjectives and adverbs. The main motivation behind our approach is that the effectiveness of a WSD algorithm is strongly influenced by the POS tag of the target word. An adaptation of Lesk dictionary-based WSD algorithm has been used to disambiguate adjectives and ad­verbs (Banerjee and Pedersen, 2002), an adaptation of the Resnik algorithm has been used to disam-biguate nouns (Resnik, 1995), while the algorithm we developed for disambiguating verbs exploits the nouns in the <i>context </i>of the verb as well as the nouns both in the glosses and in the phrases that WordNet utilizes to describe the usage of a verb. JIGSAW takes as input a document <i>d </i>= {wi, w2,<i>wh} </i>and returns a list of WordNet synsets <i>X </i>= {s1, <i>s2</i>, <i>sk </i><i>} </i>in which each element <i>si </i>is obtained by disam­biguating the <i>target word wi </i>based on the informa­tion obtained from WordNet about a few immedi­ately surrounding words. We define the <i>context C </i>of the target word to be a window of <i>n </i>words to the left and another <i>n </i>words to the right, for a total of 2n surrounding words. The algorithm is based on three different procedures for nouns, verbs, adverbs and adjectives, called <i>JIGSAWnouns, JIGSAWverbs, JIGSAW</i><i>others, </i>respectively. More details for each one of the above mentioned procedures follow.</p><footnote label="1"> http://wordnet.princeton.edu/  2 http://www.senseval.org/</footnote><subsection number="1.1" title="JIGSAW nouns"><p>The procedure is obtained by making some varia­tions to the algorithm designed by Resnik (1995) for disambiguating noun groups. Given a set of nouns <i>W = {w1,w2,...,wn}, </i>obtained from document <i>d, </i>with each <i>w</i><i>i </i>having an associated sense inven­tory <i>Si = {si1,s</i><i>i2</i><i>,...,s</i><i>ik} </i>of possible senses, the goal is assigning each <i>w</i><i>i </i>with the most appropri­ate sense <i>sih </i><i>G </i>Si, according to the <i>similarity </i>of <i>w</i><i>i </i>with the other words in <i>W </i>(the context for <i>w</i><i>i). </i>The idea is to define a function <i>^(wi,s</i><i>ij</i>), <i>wi </i><i>G</i><i> </i><i>W</i>, <i>s</i><i>ij</i><i> </i><i>G</i><i> </i><i>Si, </i>that computes a value in [0,1] representing the confidence with which word <i>wi </i>can be assigned with sense <i>s</i><i>ij.</i><i> </i>The intuition behind this algorithm is essentially the same exploited by Lesk (1986) and other authors: The most plausible assignment of senses to multiple co-occurring words is the one that maximizes <i>relatedness </i>of meanings among the chosen senses.<page local="2" global="399"/> <i>JIGSAWnouns </i>differs from the original algorithm by Resnik (1995) in the similarity mea­sure used to compute relatedness of two senses. We adopted the Leacock-Chodorow measure (Leacock and Chodorow, 1998), which is based on the length of the path between concepts in an IS-A hierarchy. The idea behind this measure is that similarity be­tween two synsets, <i>s1 </i>and s2, is inversely propor­tional to their distance in the WordNet IS-A hierar­chy. The distance is computed by finding the <i>most specific subsumer </i>(MSS) between si and <i>s2 </i>(each ancestor of both <i>s1 </i>and <i>s2 </i>in the WordNet hierar­chy is a subsumer, the MSS is the one at the lowest level) and counting the number of nodes in the path between <i>s1 </i>and <i>s2 </i>that traverse their MSS. We ex­tended this measure by introducing a parameter <i>k </i>that limits the search for the MSS to <i>k </i>ancestors (i.e. that climbs the WordNet IS-A hierarchy until either it finds the MSS or <i>k </i>+ 1 ancestors of both <i>s1 </i>and <i>s2 </i>have been explored). This guarantees that "too abstract" (i.e. "less informative") MSSs will be ig­nored. In addition to the semantic similarity func­tion, <i>JIGSAWnouns </i>differs from the Resnik algo­rithm in the use of:</p><p>1. a Gaussian factor G, which takes into account the dis­tance between the words in the text to be disambiguated;</p><p>2. a factor R, which gives more importance to the synsets that are more common than others, according to the fre­quency score in WordNet;</p><p>3. a <i>parametrized </i>search for the MSS between two concepts (the search is limited to a certain number of ancestors).</p><p>Algorithm 1 describes the complete procedure for the disambiguation of nouns. This algorithm consid­ers the words in <i>W </i>pairwise. For each pair <i>(w</i><i>i</i><i>,w</i><i>j</i>), the most specific subsumer <i>MSS</i><i>j </i>is identified, by reducing the search to <i>depthl </i>ancestors at most. Then, the similarity <i>sim(wi,W</i><i>j</i><i>,depth2) </i>between the two words is computed, by reducing the search for the MSS to <i>depth2 </i>ancestors at most. <i>MSS</i><i>j </i>is considered <i>as supporting evidence </i>for those synsets <i>sik </i>in <i>Si </i>and <i>s</i><i>jh </i>in <i>S</i><i>j </i>that are descendants of <i>MSS</i><i>ij.</i><i> </i>The MSS search is computed choosing the nearest MSS in all pairs of synsets <i>sik</i>,sjh. Like­wise, the similarity for <i>(w</i><i>i</i><i>,w</i><i>j)</i><i> </i>is the max similarity computed in all pairs of <i>sik </i>,sjh and is weighted by a gaussian factor that takes into account the posi­tion of <i>w</i><i>i </i>and <i>w</i><i>j </i>in <i>W </i>(the shorter is the distance <b>Algorithm 1 </b>The procedure for disambiguating nouns derived from the algorithm by Resnik between the words, the higher is the weight). The value <i>&lt;p(i,k) </i>assigned to each candidate synset <i>sik</i>for the word <i>w</i><i>i </i>is the sum of two elements. The first one is the proportion of support it received, out of the support possible, computed as <i>sup</i><i>ik</i><i>/normi</i>in Algorithm 1. The other element that contributes to <i>&lt;p(i,k) </i>is a factor <i>R(k) </i>that takes into account the rank of <i>s</i><i>ik </i>in WordNet, i.e. how common is the sense <i>sik </i>for the word wi. <i>R(k) </i>is computed as:</p><doubt alpha="16.7" length="24" tooSmall="False" monospace="0.0">R(k)= 1-0.8*—k— (1)n — 1</doubt><p>where <i>n </i>is the cardinality of the sense inventory <i>S</i><i>i </i>for wi, and <i>k </i>is the rank of <i>sik </i>in Si, starting from 0.</p><p>Finally, both elements are weighted by two pa­rameters: <i>a, </i>which controls the contribution given to <i>p(i, </i>k) by the normalized support, and <i>ß</i>, which controls the contribution given by the rank of <i>sik</i>.<page local="3" global="400"/> We set <i>a </i>= 0.7 and <i>ß </i>= 0.3. The synset assigned to each word in <i>W </i>is the one with the highest <i>p </i>value. Notice that we used two different parameters, <i>depthl </i>and <i>depth2 </i>for setting the maximum depth for the search of the MSS: <i>depth</i>1 limits the search for the MSS computed in the similarity function, while <i>depth2 </i>limits the computation of the MSS used for assigning support to candidate synsets. We set <i>depth1 = 6 </i>and <i>depth2 = 3.</i></p><table class="main" frame="box" rules="all" border="0" regular="False"><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>1:</p></td><td class="cell"><p><b>procedure </b><i>JIGSAWnouns (W, depthl ,depth2) </i>&gt;</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p></p></td><td class="cell"><p>finds the proper synset for each polysemous noun in the set</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p></p></td><td class="cell"><p><i>W = {wi,w2,...,w„}, depthl </i>and <i>depth2 </i>are used in</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p></p></td><td class="cell"><p>the computation of MSS</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>2:</p></td><td class="cell"><p><b>for all </b><i>wi ,wj </i><i>e </i><i>W </i><b><i>do</i></b></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>3:</p></td><td class="cell"><p><b>if </b><i>i&lt;j</i><i> </i><b>then</b></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>4:</p></td><td class="cell"><p><i>sim         </i><i>—          </i><i>sim(wi,wj ,depth1) </i><i>*</i></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p></p></td><td class="cell"><p><i>G(pos(wi),pos(wj))                &gt;G(x,y) </i>is a Gaussian</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p></p></td><td class="cell"><p>function which takes into account the difference between</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p></p></td><td class="cell"><p>the positions of <i>wi </i>and <i>wj</i></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>5:</p></td><td class="cell"><p><i>MSSij </i><i>— </i><i>MSS(wi,wj ,depth2) </i>&gt;</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p></p></td><td class="cell"><p><i>MSSij </i>is the most specific subsumer between <i>wi </i>and <i>wj</i>,</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p></p></td><td class="cell"><p>search for MSS restricted to <i>depth2 </i>ancestors</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>6:</p></td><td class="cell"><p><b>for all </b><i>sik </i><i>e </i><i>Si </i><b>do</b></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>7:</p></td><td class="cell"><p><b>if </b>is-ancestor(MSSij <i>,sik </i>) <b>then           </b>&gt; if</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p></p></td><td class="cell"><p><i>MSSij </i>is an ancestor of <i>sik</i></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>8:</p></td><td class="cell"><p><i>supik </i><i>— </i><i>supik + sim</i></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>9:</p></td><td class="cell"><p><b>end if</b></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>10:</p></td><td class="cell"><p><b>end for</b></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>11:</p></td><td class="cell"><p><b>for all </b><i>sjh </i><i>e </i><i>Sj</i><i> </i><b>do</b></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>12:</p></td><td class="cell"><p><b>if </b>is-ancestor(MSSij ,sjh) <b>then</b></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>13:</p></td><td class="cell"><p><i>supjh </i><i>— </i><i>supjh </i>+ <i>sim</i></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>14:</p></td><td class="cell"><p><b>end if</b></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>15:</p></td><td class="cell"><p><b>end for</b></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>16:</p></td><td class="cell"><p><i>normi </i><i>— </i><i>normi </i>+ <i>sim</i></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>17:</p></td><td class="cell"><p><i>normj </i><i>— </i><i>normj </i>+ <i>sim</i></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>18:</p></td><td class="cell"><p><b>end if</b></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>19:</p></td><td class="cell"><p><b>end for</b></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>20:</p></td><td class="cell"><p><b>for all </b><i>wi </i><i>e </i><i>W </i><b>do</b></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>21:</p></td><td class="cell"><p><b>for all </b><i>sik </i><i>e </i><i>Si </i><b>do</b></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>22:</p></td><td class="cell"><p><b>if </b><i>normi &gt; </i>0 <b>then</b></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>23:</p></td><td class="cell"><p><i>&lt;p(i, </i><i>k)</i><i> </i><i>— </i><i>a </i><i>* </i><i>supik/normi </i>+ <i>ß </i><i>* </i><i>R(k)</i></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>24:</p></td><td class="cell"><p><b>else</b></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>25:</p></td><td class="cell"><p><i>tp(i,k) </i><i>— </i><i>a/\Si\ + ß </i><i>* </i><i>R(k)</i></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>26:</p></td><td class="cell"><p><b>end if</b></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>27:</p></td><td class="cell"><p><b>end for</b></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>28:</p></td><td class="cell"><p><b>end for</b></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>29:</p></td><td class="cell"><p><b>end procedure</b></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr></table></subsection><subsection number="1.2" title="JIGSAW verbs"><p>Before describing the <i>JIGSAWverbs </i>procedure, the <i>description </i>of a synset must be defined. It is the string obtained by concatenating the gloss and the sentences that WordNet uses to explain the usage of a synset. First, <i>JIGSAWverbs </i>includes, in the context <i>C </i>for the target verb wi, all the nouns in the window of 2<i>n </i>words surrounding <i>w</i><i>i. </i>For each candidate synset <i>sik </i>of wi, the algorithm computes <i>nouns(i, k), </i>that is the set of nouns in the descrip­tion for <i>sik</i>.</p><p><i>max</i><i>jk </i><i>= max</i><i>wlEnouns(i,k) </i>{sim(wj<i>,w</i><i>i,</i><i>depth) </i><i>} </i>(2)</p><p>where sim(<i>w</i><i>j</i><i>,w</i><i>t</i>, <i>depth) </i>is defined as in <i>JIGSAWnouns. </i>In other words, <i>max</i><i>jk </i>is the highest similarity value for <i>w</i><i>j </i>wrt the nouns related to the <i>k</i>-th sense for <i>w</i><i>i. </i>Finally, an overall simi­larity score among <i>sik </i>and the whole context <i>C </i>is computed:</p><doubt alpha="44.8" length="58" tooSmall="False" monospace="0.0">Ew,eoG(pos(wi),pos(wj))■maxjk&lt;p(i,k) = R(k)--j------^- (3)</doubt><doubt alpha="63.2" length="19" tooSmall="True" monospace="0.0">hG(pos(wi),pos(wh))</doubt><p>where <i>R(k)</i><i> </i>is defined as in Equation 1 with a differ­ent constant factor (0.9) and <i>G(pos(wi) ,pos(w</i><i>j</i><i>))</i><i> </i>is the same Gaussian factor used in <i>JIGSAWnouns, </i>that gives a higher weight to words closer to the tar­get word. The synset assigned to <i>w</i><i>i </i>is the one with the highest <i>p </i>value. Algorithm 2 provides a detailed description of the procedure.</p></subsection><subsection number="1.3" title="JIGSAW others"><p>This procedure is based on the WSD algorithm pro­posed by Banerjee and Pedersen (2002). The idea is to compare the glosses of each candidate sense for <b>Algorithm 2 </b>The procedure for the disambiguation of verbs</p><p>1: <b>procedure </b><i>JIGSAWverbs(wi</i><i>,d,</i><i> depth) &gt; </i>finds the proper synset of a polysemous verb <i>w</i><i>i </i>in document <i>d</i> the context for wi. For example, <i>C = </i>{wi,W2,W4,w5}, if the sequence of words <i>{w1,w2,w3,w4,w5} </i>occurs in d, <i>w3 </i>being the target verb, <i>w</i><i>j </i>being nouns, <i>j = 3</i> is the sense inventory for <i>w</i><i>i, </i>that is the set of all candidate</p><doubt alpha="36.8" length="19" tooSmall="False" monospace="0.0">2:C—{w1,...,wn}&gt;Cis</doubt><doubt alpha="45.0" length="20" tooSmall="False" monospace="0.0">3:Si—{si1,...sim}&gt;Si</doubt><p>synsets for <i>w</i><i>i </i>returned by WordNet 4:      <i>s </i><i>— </i><i>null &gt; s </i>is the synset to be returned 5:      <i>score </i><i>—</i><i>--</i><i>MAXDOUBLE &gt; score </i>is the</p><p>similarity score assigned to <i>s </i>6:      <i>p</i><i> </i><i>— </i><i>1</i><i> </i><i>&gt;p</i><i> </i>is the position of the synsets for <i>wi</i></p><doubt alpha="63.4" length="41" tooSmall="False" monospace="0.0">7:for allsikeSido8:max—{max1k,...,maxnk }</doubt><doubt alpha="51.6" length="31" tooSmall="False" monospace="0.0">9:nouns(i,k)—{noun1,...,nounz}&gt;</doubt><p><i>nouns(i, </i><i>k)</i><i> </i>is the set of all nouns in the description of <i>sik</i>10: <i>sumGauss </i><i>— </i><i>0</i> 12: <b>for all </b><i>w</i><i>j </i><i>e </i><i>C </i><b>do  </b><i>&gt; </i>computation of the similarity</p><doubt alpha="54.5" length="11" tooSmall="False" monospace="0.0">11:sumTot—0</doubt><p>between <i>C </i>and <i>sik</i>13: <i>max</i><i>jk </i><i>— </i><i>0 &gt;max</i><i>jk </i>is the highest similarity</p><p>value for <i>w</i><i>j, </i>wrt the nouns related to the <i>k</i>-th sense for <i>w</i><i>i. </i>14: <i>sumGauss </i><i>— </i><i>G(pos(wi) ,pos(w</i><i>j </i><i>))</i><i> </i><i>&gt;</i></p><p>Gaussian function which takes into account the difference</p><p>between the positions of the nouns in <i>d </i>15: <b>for all </b><i>noun</i><i>i </i><i>e </i><i>nouns(i, </i><i>k)</i><i> </i><b>do</b> 16: <i>sim </i><i>— </i><i>sim(w</i><i>j</i><i>,noun</i><i>i</i><i>,depth) &gt;sim</i>is the similarity between the <i>j</i>-th noun in <i>C </i>and <i>l</i>-th noun in</p><p><i>nouns(i, </i><i>k)</i><i> </i>17: <b>if </b><i>sim &gt; max</i><i>jk </i><b>then</b> 22:        <b>for all </b><i>w</i><i>j </i><i>e </i><i>C </i><b>do</b> 25: <i>sumTot </i><i>— </i><i>sumTot/sumGauss</i> <i>JIGSAW</i><i>nouns</i></p><doubt alpha="66.7" length="12" tooSmall="False" monospace="0.0">18:maxjk—sim</doubt><doubt alpha="55.6" length="9" tooSmall="False" monospace="0.0">19:end if</doubt><doubt alpha="60.0" length="10" tooSmall="False" monospace="0.0">20:end for</doubt><doubt alpha="60.0" length="10" tooSmall="False" monospace="0.0">21:end for</doubt><doubt alpha="62.2" length="37" tooSmall="False" monospace="0.0">23:sumTot—sumTot+G(pos(wi) ,pos(wj))*</doubt><doubt alpha="100.0" length="5" tooSmall="False" monospace="0.0">maxjk</doubt><doubt alpha="60.0" length="10" tooSmall="False" monospace="0.0">24:end for</doubt><doubt alpha="61.4" length="44" tooSmall="False" monospace="0.0">26:tp(i,k)—R(k)*sumTot &gt;R(k)is defined as in</doubt><doubt alpha="60.9" length="23" tooSmall="False" monospace="0.0">27:if&lt;p(i,k) &gt;scorethen</doubt><doubt alpha="56.2" length="16" tooSmall="False" monospace="0.0">28:score—tp(i,k)</doubt><doubt alpha="33.3" length="6" tooSmall="False" monospace="0.0">29:p—k</doubt><doubt alpha="55.6" length="9" tooSmall="False" monospace="0.0">30:end if</doubt><doubt alpha="65.9" length="44" tooSmall="False" monospace="0.0">31:end for32:s—sip33:returns34:end procedure</doubt><p>the target word to the glosses of all the words in its context. Let <i>Wi </i>be the sense inventory for the tar­get word wi. For each <i>sik </i>G Wi, <i>JIGSAWothers</i>computes the string <i>targetGlossik </i>that contains the words in the gloss of <i>sik</i>. Then, the procedure computes the string <i>contextGlossi, </i>which contains the words in the glosses of all the synsets corresponding to each word in the context for <i>wi.</i><page local="4" global="401"/><i> </i>Fi­nally, the procedure computes the <i>overlap </i>between <i>contextGlossi </i>and <i>targetGlossik</i>, and assigns the synset with the highest overlap score to <i>wi. </i>This score is computed by counting the words that occur both in <i>targetGlossik </i>and in <i>contextGlossi. </i>If ties occur, the most common synset in WordNet is cho­sen.</p></subsection></section><section number="2" title="Experiment"><p>We performed the experiment following the instruc­tions for SemEval-2007 task 1 (Agirre et al., 2007). <i>JIGSAW </i>is implemented in JAVA, by using JWNL library<footnote anchor="3"/> in order to access WordNet 1.6 dictionary. We ran the experiment on a Linux-based PC with Intel Pentium D processor having a speed of 3 GHz documents, including 300 topics. Results are re­ported in Table 1. Only two systems (PART-A and PART-B) partecipated to the competition, thus the organizers decided to add a third system (ORGA­NIZERS) developed by themselves. The systems were scored according to standard IR/CLIR mea­sures as implemented in the TREC evaluation pack-age<footnote anchor="4"/>. Our system is labelled as PART-A.</p><doubt alpha="63.8" length="47" tooSmall="False" monospace="0.0">and 2 GB of RAM. The dataset consists of 29,681</doubt><p>All systems show similar results in IR tasks, while their behaviour is extremely different on CLIR task. WSD results are reported in Table 2. These re­sults are encouraging as regard precision, consid­ering that our system exploits only WordNet as kwnoledge-base, while ORGANIZERS uses a su­pervised method that exploits SemCor to train a kNN classifier.</p></section><section number="3" title="Conclusions"><p>In this paper we have presented a WSD algorithm that exploits WordNet as knowledge-base and uses three different methods for each part-of-speech. The algorithm has been evaluated by SemEval-2007 task 1. The system shows a good performance in all tasks, but low precision in CLIR evaluation. Prob­ably, the negative result in CLIR task depends on complex interaction of WSD, expansion and index­ing. Contrarily to other tasks, organizers do not plan to provide a ranking of systems on SemEval-2007 task 1. As a consequence, the goal of this task - what is the best WSD system in the context of a CLIR system? - is still open. This is why the organizers stressed in the call that this was <i>"afirst try".</i></p><footnote label="3">http://sourceforge.net/projects/jwordnet  4 http://trec.nist.gov/</footnote><table caption="Table 2: WSD results on all-words task" class="main" frame="box" rules="all" border="1" regular="False"><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p><i>system            | precision | recall | attempted</i></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>SENSEVAL-2</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>ORGANIZERS</p><p>PART-A</p><p>PART-B</p></td><td class="cell"><p>0.584 0.498 0.388</p></td><td class="cell"><p>0.577 0.375 0.240</p></td><td class="cell"><p>93.61% 75.39% 61.92%</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>SENSEVAL-3</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>ORGANIZERS</p><p>PART-A</p><p>PART-B</p></td><td class="cell"><p>0.591 0.484 0.334</p></td><td class="cell"><p>0.566 0.338 0.186</p></td><td class="cell"><p>95.76% 69.98% 55.68%</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr></table><table caption="Table 1: SemEval-2007 task 1 Results" class="main" frame="box" rules="all" border="1" regular="False"><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p><i>system</i></p></td><td class="cell"><p><i>IR documents</i></p></td><td class="cell"><p><i>IR topics</i></p></td><td class="cell"><p><i>CLIR</i></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>no expansion</p></td><td class="cell"><p>0.3599</p></td><td class="cell"><p></p></td><td class="cell"><p>0.1446</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>full expansion</p></td><td class="cell"><p>0.1610</p></td><td class="cell"><p>0.1410</p></td><td class="cell"><p>0.2676</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>1st sense</p></td><td class="cell"><p>0.2862</p></td><td class="cell"><p>0.1172</p></td><td class="cell"><p>0.2637</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>ORGANIZERS</p></td><td class="cell"><p>0.2886</p></td><td class="cell"><p>0.1587</p></td><td class="cell"><p>0.2664</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>PART-A</p></td><td class="cell"><p>0.3030</p></td><td class="cell"><p>0.1521</p></td><td class="cell"><p>0.1373</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>PART-B</p></td><td class="cell"><p>0.3036</p></td><td class="cell"><p>0.1482</p></td><td class="cell"><p>0.1734</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr></table></section><references><p>E. Agirre, B. Magnini, o. Lopez de Lacalle, A. Otegi, G. Rigau, and Vossen. 2007. Semeval-2007 task 1: Evaluating wsd on cross-language information re­trieval. In <i>Proceedings of SemEval-2007. </i>Association for Computational Linguistics.</p><p>S. Banerjee and T. Pedersen. 2002. An adapted lesk algorithm for word sense disambiguation using word­net. In <i>CICLing'02: Proc. 3rd Int'l Conf. on Com­putational Linguistics and Intelligent Text Processing, </i>pages 136-145, London, UK. Springer-Verlag.</p><p>C. Leacock and M. Chodorow. 1998. Combining local context and wordnet similarity for word sense identifi­cation. In <i>C. Fellbaum (Ed.), WordNet: An Electronic Lexical Database, </i>pages 305-332. MIT Press.</p><p>M. Lesk. 1986. Automatic sense disambiguation using machine readable dictionaries: how to tell a pine cone from an ice cream cone. In <i>Proceedings of the 1986 SIGDOC Conference, </i>pages 20-29. ACM Press.</p><p>P. Resnik. 1995. Disambiguating noun groupings with respect to WordNet senses. In <i>Proceedings </i><i>ofthe</i><i> Third Workshop on Very Large Corpora, </i>pages 54-68. Association for Computational Linguistics.</p></references></body></article>