<?xml version="1.0"?><!DOCTYPE article SYSTEM "/project/take/software/searchbench_offline_processing/paperxml_generator/aclextractor/src/python/../resource/dtd/paperxml.dtd"><article><header><firstpageheader><page local="1" global="322"/><title>TKB-UO: Using Sense Clustering for WSD</title><pubinfo>Proceedings of the 4th International Workshop on Semantic Evaluations (SemEval-2007),pages 322-325, Prague, June 2007. ©2007 Association for Computational Linguistics</pubinfo><author surname="Anaya-Sánchez" givenname="Henry"><org  name="Center of Pattern Recognition and Data Mining" country="Cuba"/></author><author surname="Pons-Porrata" givenname="Aurora"><org  name="Universidad de Oriente" country="Spain"/></author><author surname="Berlanga-Llavori" givenname="Rafael"><org  name="Universitat Jaume I" country="Cuba"/></author></firstpageheader><frontmatter><p><b>TKB-UO: Using Sense Clustering for WSD</b></p><p><b>Henry Anaya-Sanchez<footnote anchor="1"/>, Aurora Pons-Porrata<footnote anchor="1"/>, Rafael Berlanga-Llavori<footnote anchor="2"/></b></p><p><footnote anchor="1"/> Center of Pattern Recognition and Data Mining, Universidad de Oriente, Cuba <footnote anchor="2"/> Computer Science, Universitat Jaume I, Spain <footnote anchor="1"/>{henry,aurora}@csd.uo.edu.cu <footnote anchor="2"/> berlanga@lsi.uji.es</p></frontmatter><abstract>This paper describes the clustering-based approach to Word Sense Disambiguation that is followed by the TKB-UO system at SemEval-2007. The underlying disambigua­tion method only uses WordNet as external resource, and does not use training data. Re­sults obtained in both Coarse-grained En­glish all-words task (task 7) and English fine-grained all-words subtask (task 17) are presented. </abstract></header><body><section number="1" title="Introduction"><p>The TKB-UO system relies on the knowledge-driven approach to Word Sense Disambiguation (WSD) presented in (Anaya-Sanchez et al., 2006). Regarding that meaningful senses of words in a tex­tual unit must be coherently related, our proposal uses sense clustering with the aim of determining cohesive groups of senses that reflect the connectiv­ity of the disambiguating words.</p><p>The way this proposal uses clustering for disam­biguation purposes is different from those usages re­ported in other works of the WSD area. For ex­ample, in (Pedersen et al., 2005) textual contexts are clustered in order to represent senses for Word Sense Discrimination. Other works like (Agirre and Lopez, 2003), cluster fine-grained word senses into coarse-grained ones for polysemy reduction. In­stead, our method clusters all possible senses cor­responding to all words in a disambiguating textual unit. Thus, our system implements a novel cluster­ing approach for the contextual disambiguation of words.</p><p>We use the lexical resource WordNet (version 2.1) as the repository of word senses, and also as the provider of sense representations. It is worth men­tioning that our proposal does not require the use of training data.</p></section><section number="2" title="The disambiguation algorithm"><p>Our method starts with a clustering of all possible senses of the disambiguating words. Such a cluster­ing tries to identify cohesive groups of word senses, which are assumed to represent the different mean­ings for the set ofdisambiguating words. Then, clus­ters that match the best with the context are selected via a filtering process. If the selected clusters dis-ambiguate all words, the process is stopped and the senses belonging to the selected clusters are inter­preted as the disambiguating ones. Otherwise, the clustering and filtering steps are performed again (regarding the remaining senses) until the disam­biguation is achieved.</p><p>Algorithm 1 shows the general steps of our pro­posal for the disambiguation of a set of words W. In the algorithm, <i>clustering </i>represents the basic clus­tering method, <i>filter </i>is the function that selects the clusters, and T denotes the intended textual context from which words in <i>W </i>are disambiguated (typi­cally, a broader bag of words than W). Next subsec­tions describe in detail each component of the whole process.</p><subsection number="2.1" title="Sense Representation"><p>For clustering purposes, word senses are repre­sented as topic signatures (Lin and Hovy, 2000). Thus, for each word sense s we define a vector <b>Algorithm 1 </b>Clustering-based approach for the dis­ambiguation of the set of words <i>W </i>in the textual <u>context T</u>_<page local="2" global="323"/></p><p><b>Input: </b>The finite set of words W and the textual context T.</p><p><b>Output: </b>The disambiguated word senses.</p><p>Let S be the set of all senses of words in W, and <i>i = </i>0; <b>repeat</b> <i>(t1 :</i><i> a1,...,tm : am), </i>where each <i>ti </i>is a Word­Net term highly correlated to s with an association weight <i>&lt;7i.</i><i> </i>The set of signature terms for a word sense includes all its WordNet hyponyms, its di­rectly related terms (including coordinated terms) and their filtered and lemmatized glosses. To weight signature terms, the <i>tf</i><i>-idf </i>statistics is used, con­sidering each word as a collection and its senses as its of documents. Topic signatures of senses form a Vector Space Model similar to those defined in In­formation Retrieval Systems. In this way, they can be compared with measures such as cosine, Dice and Jaccard (Salton et al., 1975).</p><doubt alpha="22.2" length="9" tooSmall="False" monospace="0.0">i = i + 1</doubt><doubt alpha="57.4" length="54" tooSmall="False" monospace="0.0">G =clustering(S, ß0(i))G' =filter(G, W, T) S =U{sisGg}</doubt><doubt alpha="48.6" length="37" tooSmall="False" monospace="0.0">until|S| = |W|or ß0(i + 1) = 1returnS</doubt><p>In (Anaya-Sanchez et al., 2006), it is shown that this kind of WordNet-based signatures outperform those Web-based ones developed by the Ixa Re­search Group <footnote anchor="1"/> in the disambiguation of nouns.</p></subsection><subsection number="2.2" title="Clustering Algorithm"><p>Sense clustering is carried out by the Extended Star Clustering Algorithm (Gil et al., 2003), which builds star-shaped and overlapped clusters. Each cluster consists of a star and its satellites, where the star is the sense with the highest connectivity of the clus­ter, and the satellites are those senses connected with the star. The connectivity is defined in terms of the ß0-similarity graph, which is obtained using the co­sine similarity measure between topic signatures and the minimum similarity threshold <i>ß0. </i>The way this clustering algorithm relates word senses resembles the manner in which syntactic and discourse relation links textual elements.</p><footnote label="1">http://ixa.si.ehu.es/Ixa/</footnote></subsection><subsection number="2.3" title="Filtering Process"><p>Once clustering is performed over the senses of words in <i>W,</i><i> </i>a set of sense clusters is obtained. As some clusters can be more appropriate to describe the semantics of <i>W </i>than others, they are ranked ac­cording to a measure w.r.t the textual context T.</p><p>As we represent the context <i>T </i>in the same vector space that the topic signatures of senses, the follow­ing function can be used to score a cluster of senses g regarding T :</p><doubt alpha="57.1" length="14" tooSmall="False" monospace="0.0">/£minjgi.Ti} \</doubt><doubt alpha="65.6" length="32" tooSmall="False" monospace="0.0">^word^lmrn|E5^t},~£segnumber(s)I</doubt><p>where <i>words(g) </i>denotes the set of words having senses in g, g is the centroid of g (computed as the barycenter of the cluster), and <i>number(s) </i>is the WordNet number of sense <i>s </i>according to its corre­sponding word.</p><p>Then, we rank all clusters by using the lexico­graphic order of their scores w.r.t. the above func­tion.</p><p>Once the clusters have been ranked, they are or­derly processed to select clusters for covering the words in <i>W.</i><i> </i>A cluster <i>g</i><i> </i>is selected if it contains at least one sense of an uncovered word and other senses corresponding to covered words are included in the current selected clusters. If <i>g </i>does not con­tain any sense of uncovered words it is discarded. Otherwise, g is inserted into a queue <i>Q. </i>Finally, if the selected clusters do not cover W, clusters in Q adding senses of uncovered words are chosen until all words are covered.</p></subsection><subsection number="2.4" title="ß 0  Threshold and the Stopping Criterion"><p>As a result of the filtering process, a set of senses for all the words in W is obtained (i.e. the union of all the selected clusters). Each word in <i>W </i>that has only a sense in such a set is considered disambiguated. If some word still remains ambiguous, we must refine the clustering process to get stronger cohesive clus­ters of senses. In this case, all the remaining senses must be clustered again but raising the <i>ß</i>0 threshold.</p><page local="3" global="324"/><p>Notice that this process must be done iteratively un­til either all words are disambiguated or when it is impossible to raise <i>ß0</i><i> </i>again. Initially, <i>ß0</i><i> </i>is defined</p><doubt alpha="50.0" length="22" tooSmall="False" monospace="0.0">Iteration*1,ßo = 0.049</doubt><doubt alpha="66.7" length="3" tooSmall="False" monospace="0.0">as:</doubt><doubt alpha="42.9" length="21" tooSmall="False" monospace="0.0">ßo(1)= pth(90,sim(S))</doubt><doubt alpha="66.0" length="50" tooSmall="False" monospace="0.0">and at the i-th iteration (i &gt; 1) it is raised to:</doubt><doubt alpha="35.8" length="53" tooSmall="False" monospace="0.0">ßo(i) =      min     {ß= pth(p, sim(S))\ß &gt; ßo(i -1)}</doubt><doubt alpha="15.4" length="13" tooSmall="False" monospace="0.0">pG{90,95,100&gt;</doubt><p>In these equations, <i>S </i>is the set of current senses, and <i>pth(p,sim(S</i>)) represents the p-th percentile value of the pairwise similarities between senses (i.e. <i>sim(S) = [cos(s</i><i>i</i><i>,S</i><i>j</i>)|si,Sj G S,<i>i</i><i> </i><i>=</i><i> </i><i>j}</i><i> </i><i>U </i>{1}).</p></subsection><subsection number="2.5" title="A Disambiguation Example"><p>In this subsection we illustrate the use of our pro­posal in the disambiguation of the content words appearing in the sentence "The <i>runner won the marathon". </i>In this example, the set of disam­biguating words <i>W </i>includes the nouns <i>runner </i>and <i>marathon, </i>and the verb <i>win </i>(lemma of the verbal form won). Also, we consider that the context is the vector <i>T = (runner : 1,win : 1, marathon </i>: 1). The rest of words are not considered because they are meaningless. As we use WordNet 2.1, we regard that the correct senses for the context are <i>runner#6, win#1 </i>and <i>marathon#2.</i></p><p>Figure 1 graphically depicts the disambiguation process carried out by our method. The boxes in the figure represent the obtained clusters, which are sorted regarding the ranking function (scores are un­der the boxes).</p><p>Initially, all word senses are clustered using ßo=0.049 (the 90th-percentile of the pairwise similarities between the senses). It can be seen in the figure that the first cluster comprises the sense <i>runner#6 </i>(the star), which is the sense refering to a trained athlete who competes in foot races, and <i>runner#4, </i>which is the other sense of <i>runner </i>related with sports. Also, it includes the sense <i>win#1 </i>that concerns to the victory in a race or competition, and <i>marathon#2 </i>that refers to a footrace. It can be easily appreciated that this first cluster includes senses that cover the set of disambiguating words. Hence, it is selected by the filter and all other clusters are</p><p>marathon # <i>3</i></p><doubt alpha="0.0" length="11" tooSmall="True" monospace="0.0">(1,0.17,-3)</doubt><doubt alpha="0.0" length="43" tooSmall="True" monospace="0.0">(1,00,-1)(1.0.0,-3)    (1,0.0,-3)(1.0.0,-9)</doubt><doubt alpha="45.8" length="24" tooSmall="False" monospace="0.0">Iteration #2, po = 0.104</doubt><p>discarded. After this step, <i>S </i>is updated with the set <i>{runner#6, runner#4, win#1, marathon#2}. <footnote anchor="2"/></i></p><p>In this point of the process, the senses of <i>S </i>do not disambiguate <i>W </i>because the noun <i>runner </i>has two senses in <i>S. </i>Therefore, the sttoping criterion does not hold because neither |S| = |W| and ß0(2) = 0.104 = 1. Consequently, a new cluster distribution must be obtained using the current set <i>S.</i></p><p>The boxes in the bottom of Figure 1 represent the new clusters. In this case, all clusters are sin­gles. Obviously, the cluster containing the sense <i>runner#4 </i>is discarded because the cluster that in­cludes the sense <i>runner#6 </i>overlaps better with the context, and therefore precedes it in the order.</p><p>Then, the final set of selected senses is <i>S = {runner#6, win#1, marathon#2}, </i>which in­cludes only one sense for each word in <i>W.</i></p></subsection></section><section number="3" title="SemEval-2007 Results"><p>Our system participated in the Coarse-grained En­glish all-words task (task 7) and in the English fine­grained all-words subtask (task 17). In both cases, the disambiguation process was performed at the sentence level. Thus, we defined the intended tex­tual context <i>T </i>for a sentence to be the bag of all its lemmatized content words. However, <i>W </i>was set up in a different manner for each task.</p><p>We present our results only in terms of the F1 measure. <i>Recall </i>and <i>Precision </i>values are omitted because our method achieves a 100 % of <i>Coverage.</i><page local="4" global="325"/><i></i></p><footnote label="2">In the figure, doubly-boxed clusters depict the selected ones by the filter.</footnote><table class="main" frame="box" rules="all" border="1" regular="False"><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>runner #6 runner # 4 win # <b>1 </b>marathon # 2</p></td><td class="cell"><p>win #4 runner # 4 win # 2 marathon # 1</p></td><td class="cell"><p>runner # S runner # 7</p><p>wm # 2</p></td><td class="cell"><p>wm # 2 runner #2 runner #3 runner #8</p><p>win #4</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>(2,0.0,-17)</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>(3,0.69,-13) (3,0.0,-11)</p></td><td class="cell"><p></p></td><td class="cell"><p><i>(2, </i>0.0, -19)</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr></table><table class="main" frame="box" rules="all" border="1" regular="False"><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>runner # 1</p></td><td class="cell"><p>win # 3</p></td><td class="cell"><p>runner #5</p></td><td class="cell"><p>runner # 9</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr></table><table caption='Figure 1: Disambiguation of words in "Therunner won the marathon".' class="main" frame="box" rules="all" border="1" regular="False"><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>runner # 6</p></td><td class="cell"><p>marathon # 2</p></td><td class="cell"><p>win # 1</p></td><td class="cell"><p>runner # 4</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>(1, 0.567, -6)</p></td><td class="cell"><p>(1, 0.128, -2)</p></td><td class="cell"><p>(1.0 0: -1)</p></td><td class="cell"><p>(1. 0.0, -4)</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr></table><subsection number="3.1" title="Coarse-grained English All-words Task"><p>Firstly, it is worth mentioning that we do not use the coarse-grained inventory provided by the com­petition for this task. Indeed, our approach can be viewed as a method to build such a coarse-grained inventory as it clusters tightly related senses.</p><p>Each <i>W </i>was defined as the set of all tagged words belonging to the sentence under consideration. Ta­ble 3.1 shows the official results obtained by our sys­tem.</p><p>As it can be appreciated, the effectiveness of our method was around the 70%, except in the fifth test document (d005), which is an excerpt ofstories about Italian painters.</p></subsection><subsection number="3.2" title="English Fine-grained All-words Subtask"><p>Similar to previous task, we included into each <i>W </i>those tagged words of the disambiguating sentence. However, as the set of tagged words per sentence was verb-plentiful, with very few nouns, we ex­panded <i>W </i>with the rest of nouns and adjectives of the sentence.</p><p>Table 3.2 summarizes the results (split by word categories) obtained in this subtask. The second col­umn of the table shows the number of disambiguat-ing word occurrences.</p><p>As we can see, in this subtask only nouns and verbs were required to be disambiguated, and over­all, verbs predominate over nouns. The poor per­formance obtained by verbs (w.r.t. nouns) can be explained by its high polysemy degree and its rela­tively small number of relations in WordNet.</p></subsection></section><section number="4" title="Conclusions"><p>In this paper, we have described the TKB-UO sys­tem for WSD at SemEval-2007. This knowledge-driven system relies on a novel way ofusing cluster­ing in the WSD area. Also, it benefits from topic sig­natures built from WordNet, which in combination with the clustering algorithm overcomes the sparse-ness of WordNet relations for associating semanti-cally related word senses. The system participated in both the Coarse-grained English all-words task (task 7) and the English fine-grained all-words sub-task (task 17). Since we use sense clustering, we do not use the coarse-grained sense inventory provided by the competition for task 7. Further work will fo­cus on improving the results of fine-grained WSD.</p><table caption="Table 1: TKB-UO results in Coarse-grained English all-words task." class="main" frame="box" rules="all" border="1" regular="False"><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Test set</p></td><td class="cell"><p>F1</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>d001</p></td><td class="cell"><p>0.78804</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>d002</p></td><td class="cell"><p>0.72559</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>d003</p></td><td class="cell"><p>0.69400</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>d004</p></td><td class="cell"><p>0.70753</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>d005</p></td><td class="cell"><p>0.58551</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Total</p></td><td class="cell"><p>0.70207</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr></table><table caption="Table 2: TKB-UO results in English Fine-grained all-words subtask." class="main" frame="box" rules="all" border="1" regular="False"><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Category</p></td><td class="cell"><p>Instances</p></td><td class="cell"><p>F1</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Noun Verb</p></td><td class="cell"><p>161 304</p></td><td class="cell"><p>0.367 0.303</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>All</p></td><td class="cell"><p>465</p></td><td class="cell"><p>0.325</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr></table></section><references><p>Eneko Agirre and Oier Lopez. 2003. Clustering wordnet word senses. <i>Proceedings of the Conference on Recent Advances on Natural Language Processing, </i>pp. 121— 130</p><p>Henry Anaya-Sanchez, Aurora Pons-Porrata, and Rafael Berlanga-Llavori. 2006. Word sense disambiguation based on word sense clustering. <i>Lecture Notes in Arti­ficial Intelligence, </i>4140:472—481.</p><p>Reynaldo Gil-Garcla, Jose M. Badla-Contelles, and Au­rora Pons-Porrata. 2003 Extended Star Clustering Algorithm. <i>Lecture Notes on Computer Sciences, </i>2905:480—487</p><p>Chin-Yew Lin and Eduard Hovy. 2000. The Automated Acquisition of Topic Signatures for Text Summariza­tion.   <i>Proceedings ofthe COLING Conference, </i>pp.</p><doubt alpha="0.0" length="7" tooSmall="False" monospace="0.0">495—501</doubt><p>Ted Pedersen, Amruta Purandare, and Anagha Kulka-rni. 2005. Name Discrimination by Clustering Sim­ilar Contexts. <i>Lecture Notes in Computer Science, </i>3406:226—237</p><doubt alpha="57.4" length="47" tooSmall="False" monospace="0.0">Gerard Salton, A. Wong, and C.S. Yang.  1975. A</doubt><p>Vector Space Model for Information Retrieval. <i>Jour­nal ofthe American Society for Information Science,</i></p><doubt alpha="0.0" length="14" tooSmall="False" monospace="0.0">18(11):613—620</doubt></references></body></article>