<?xml version="1.0"?><!DOCTYPE article SYSTEM "/project/take/software/searchbench_offline_processing/paperxml_generator/aclextractor/src/python/../resource/dtd/paperxml.dtd"><article><header><firstpageheader><page local="1" global="476"/><title>UofL: Word Sense Disambiguation Using Lexical Cohesion</title><pubinfo>Proceedings of the 4th International Workshop on Semantic Evaluations (SemEval-2007),pages 476-479, Prague, June 2007. ©2007 Association for Computational Linguistics</pubinfo><author surname="Chali" givenname="Yllias"><org  name="University of Lethbridge" country="Canada" city="Lethbridge"/></author><author surname="Joty" givenname="Shafiq R."><org  name="University of Lethbridge" country="Canada" city="Lethbridge"/></author></firstpageheader><frontmatter><p><b>UofL: Word Sense Disambiguation Using Lexical Cohesion</b></p><p><b>Yllias Chali</b></p><p>Department of Computer Science University of Lethbridge</p><p>Lethbridge, Alberta, Canada, T1K 3M4</p><p>chali@cs.uleth.ca</p><p><b>Shafiq R. Joty</b></p><p>Department of Computer Science University of Lethbridge Lethbridge, Alberta, Canada, T1K 3M4</p><p>jotys@cs.uleth.ca</p></frontmatter><abstract>One of the main challenges in the applica­tions (i.e.: text summarization, question an­swering, information retrieval, etc.) of Natural Language Processing is to deter­mine which of the several senses of a word is used in a given context. The problem is phrased as "Word Sense Disambiguation (WSD)" in the NLP community. This paper presents the dictionary based disambigua­tion technique that adopts the assumption of one sense per discourse in the context of SemEval-2007 Task 7: "Coarse-grained English all-words". </abstract></header><body><section number="1" title="Introduction"><p>Cohesion can be defined as the way certain words or grammatical features of a sentence can connect it to its predecessors (and successors) in a text. (Halliday and Hasan, 1976) defined cohesion as "the set of possibilities that exist in the language for making text hang together". Cohesion occurs where the interpretation of some element in the discourse is dependent on that of another. For ex­ample, an understanding of the reference of a pro­noun (i.e.: he, she, it, etc.) requires to look back to something that has been said before. Through this cohesion relation, two text clauses are linked to­gether.</p><p>Cohesion is achieved through the use in the text of semantically related terms, reference, ellipse and conjunctions (Barzilay and Elhadad, 1997). Among the different cohesion-building devices, the most easily identifiable and the most frequent type is lexical cohesion. Lexical cohesion is created by using semantically related words (repetitions, synonyms, hypernyms, hyponyms, meronyms and holonyms, glosses, etc.)</p><p>Our technique used WordNet (Miller, 1990) as the knowledge source to find the semantic relations among the words in a text. We assign weights to the semantic relations. The technique can be de­composed into two steps: (1) building a representa­tion of all possible senses of the words and (2) dis-ambiguating the words based on the highest score. The remainder of this paper is organized as fol­lows. In the next section, we review previous work. In Section 3, we define the semantic relations and their weights. Section 4 presents our two step pro­cedure for WSD. We conclude with the evaluation.</p></section><section number="2" title="Previous Work"><p>Lexical Chaining is the process of connecting se-mantically related words, creating a set of chains that represent different threads of cohesion through the text (Galley and McKeown, 2003). This inter­mediate representation of text has been used in many natural language processing applications, including automatic summarization (Barzilay and Elhadad, 1997; Silber and McCoy, 2003), informa­tion retrieval (Al-Halimi and Kazman, 1998), and intelligent spell checking (Hirst and St-Onge, 1998).</p><p>Morris and Hirst (1991) at first proposed a man­ual method for computing lexical chains and first computational model of lexical chains was intro­duced by Hirst and St-Onge (1997). This linear­time algorithm, however, suffers from inaccurate WSD, since their greedy strategy immediately dis-ambiguates a word as it is first encountered. Later research (Barzilay and Elhadad, 1997) significantly alleviated this problem at the cost of a worse run­ning time (quadratic); computational inefficiency is due to their processing of many possible combina­tions of word senses in the text in order to decide which assignment is the most likely.<page local="2" global="477"/> Silber and McCoy (2003) presented an efficient linear-time algorithm to compute lexical chains, which models Barzilay's approach, but nonetheless has inaccura­cies in WSD.</p><p>More recently, Galley and McKeown (2003) suggested an efficient chaining method that sepa­rated WSD from the actual chaining. It performs the WSD before the construction of the chains. They showed that it could achieve more accuracy than the earlier ones. Our method follows the simi­lar technique with some new semantic relations (i.e.: gloss, holonym, meronym).</p><doubt alpha="0.0" length="1" tooSmall="False" monospace="0.0">3</doubt><p><b>Semantic Relations</b></p><p>We used WordNet2.1<footnote anchor="1"/> (Miller, 1990) and extended WordNet (Moldovan and Mihalcea, 2001) as our knowledge source to find the semantic relations among the words in a context. We assigned a weight to each semantic relation. The relations and their scores are summarized in the table 1.</p><doubt alpha="0.0" length="1" tooSmall="False" monospace="0.0">4</doubt><p><b>System Overview</b></p><p>The global architecture of our system is shown in Figure 1. Each of the modules of the system is de­scribed below.</p><doubt alpha="0.0" length="3" tooSmall="False" monospace="0.0">4.1</doubt><p><b>Context Processing</b></p><p>Context-processing involves preprocessing the con­texts using several tools. We have used the follow­ing tools:</p><p><b>Extracting the main text: </b>This module extracts the context of the target word from the source xml document removing the unnecessary tags and makes the context ready for further processing.</p><p><b>Sentence   Splitting,   Text   Stemming and</b> <b>Chunking:</b><b> </b>This module splits the context into sen­tences, then stems out the words and chunks those. We used OAK systems<footnote anchor="2"/> (Sekine, 2002) for this purpose.</p><p>http:// wordnet.princeton.edu/</p><p><b>Candidate Words Extraction: </b>This module ex­tracts the candidate words (for task 7: noun, verb, adjective and adverb) from the chunked text.</p><subsection number="4.2" title="All Sense Representation"><p>Each candidate word is expanded to all of its senses. We created a hash representation to identify all possible word representations, motivated from Galley and McKeown (2003). Each word sense is inserted into the hash entry having the index value equal to its synsetID. For example, athlete and jock are inserted into the same hash entry (Figure 2).</p><p><b><i>Hypernym/ Hyponym</i></b></p><figure caption="Figure 2. Hash indexed by synsetID"></figure><p>On insertion of the candidate sense into the hash we check to see if there exists an entry into the in­dex value, with which the current word sense has one of the above mentioned relations. No disam­biguation is done at this point; the only purpose is to build a representation used in the next stage of the algorithm. This representation can be shown as a disambiguation graph (Galley and McKeown, 2003) where the nodes represent word instances with their WordNet senses and weighted edges connecting the senses of two different words repre­sent semantic relations (Figure: 3).</p><p><b><i>Food sense</i></b> <b><i>Instrument sense</i></b></p><p>Figure 3. Partial Disambiguation graph, Bass has two senses, 1. Food related 2. Music instrument related sense. The instrument sense dominates over the fish sense as it has more relations (score) with the other words in the context.</p><doubt alpha="66.7" length="27" tooSmall="False" monospace="0.0">'http://nlp.cs.nyu.edu/oak/</doubt><page local="3" global="478"/></subsection><subsection number="4.3" title="Sense Disambiguation"><p>We use the intermediate representation (disam­biguation graph) to perform the WSD. We sum the weight of all edges leaving the nodes under their different senses. The one sense with the highest score is considered the most probable sense. For example in fig: 3 Bass is connected with three words: Pitch, ground bass and sound property by its instrument sense and with one word: Fish by its Food sense. For this specific example all the se­mantic relations are of Hyponym/Hypernym type (score 0.33). So we get the score as in table 2.</p><p>In case of tie between two or more senses, we select the one sense that comes first in WordNet, since WordNet orders the senses of a word by de­creasing order of frequency.</p><figure caption="Figure 1: Overview of WSD System"></figure><table caption='Table 2. Score of the senses of word "Bass"' class="main" frame="box" rules="all" border="1" regular="False"><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p><b>Sense</b></p></td><td class="cell"><p><b>Mne-</b></p></td><td class="cell"><p><b>Score</b></p></td><td class="cell"><p><b>Disambigu-</b></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p></p></td><td class="cell"><p><b>monic</b></p></td><td class="cell"><p></p></td><td class="cell"><p><b>ated Sense</b></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>4928349</p></td><td class="cell"><p>Musical</p></td><td class="cell"><p>3*0.33</p></td><td class="cell"><p>Musical In-</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p></p></td><td class="cell"><p>Instru-</p></td><td class="cell"><p>=0.99</p></td><td class="cell"><p>strument</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p></p></td><td class="cell"><p>ment</p></td><td class="cell"><p></p></td><td class="cell"><p>(4928349)</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>7672239</p></td><td class="cell"><p>Fish or</p></td><td class="cell"><p>0.33</p></td><td class="cell"><p></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p></p></td><td class="cell"><p>Food</p></td><td class="cell"><p></p></td><td class="cell"><p></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr></table><table caption="Table 1: The relations and their associated weights" class="main" frame="box" rules="all" border="1" regular="False"><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p><b>Relation</b></p></td><td class="cell"><p><b>Definition</b></p></td><td class="cell"><p><b>Example</b></p></td><td class="cell"><p><b>Weight</b></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Repetition</p></td><td class="cell"><p>Same occurrences of the word</p></td><td class="cell"><p><b><i>Weather </i></b>is great in Atlanta. Florida is having a really bad <b><i>weather.</i></b></p></td><td class="cell"><p>1</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Synonym</p></td><td class="cell"><p>Words belonging to the same syn-set in WordNet</p></td><td class="cell"><p>Not all <b><i>criminals </i></b>are <b><i>outlaws.</i></b></p></td><td class="cell"><p>1</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Hypernym and Hypo-nym</p></td><td class="cell"><p>F is a hypernym of <i>X </i>if <i>X </i>is a (kind of) <i>Y <b>And</b></i></p><p><i>X </i>is a hyponym of <i>Y </i>if <i>X </i>is a (kind of) Y.</p></td><td class="cell"><p>Peter bought a <b><i>computer. </i></b>It was a Dell <b><i>machine.</i></b></p></td><td class="cell"><p>0.33</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Holonym</p><p>And</p><p>Meronym</p></td><td class="cell"><p><i>Y </i>is a holonym of <i>X </i>if <i>X </i>is a part of <i>Y <b>And</b></i></p><p><i>X </i>is a meronym of <i>Y </i>if <i>X </i>is a part of <i>Y</i></p></td><td class="cell"><p>The <b><i>keyboard </i></b>of this <b><i>computer </i></b>is not working.</p></td><td class="cell"><p>0.33</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Gloss</p></td><td class="cell"><p>Definition and/or example sen­tences for a synset.</p></td><td class="cell"><p>Gloss of word <b><i>"dormitory" </i></b>is {a college or <b><i>university </i></b>building con­taining living quarters for students}</p></td><td class="cell"><p>0.33</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr></table><page local="4" global="479"/></subsection></section><section number="5" title="Evaluation"><p>In SemEval-2007, we participated in Task 7: "Coarse-grained English all-words". The evalua­tion of our system is given below:</p></section><section number="6" title="Conclusion"><p>In this paper, we presented briefly our WSD sys­tem in the context of SemEval 2007 Task 7. Along with normal WordNet relations, our method also included additional relations such as repetition and gloss using semantically enhanced tool, extended WordNet. After disambiguation, the intermediate representation (disambiguation graph) can be used to build the lexical chains which in tern can be used as an intermediate representation for other NLP applications such as text summarization, question answering, text clustering. This method (summing edge weights in selecting the right sense) of WSD before constructing the chain (Gallery and McKe-own, 2003) outperforms the earlier methods of Barzilay and Elhadad (1997) and Silber and McCoy (2003) but this method is highly dependent on the lexical cohesion among words in a context. So the length of context is an important factor for our system to achieve good performance. For the task the context given for a tagged word was not so large to capture the semantic relations among words. This may be the one of the reasons for which our system could not achieve one of the best results.</p><p>Chali, Y. and Kolla, M. 2004. Summarization techniques at DUC 2004. In <i>Proceedings of the Document Understanding Conference, </i>pages 105 -111, Boston. NIST.</p><p>Galley, M. and McKeown, K. 2003. Improving Word Sense Disambiguation in Lexical Chain­ing. In <i>Proceedings of the 18th International Joint Conference on Artificial Intelligence (IJCAI'03), </i>pages 1486-1488, Acapulco, Mex­ico.</p><p>Halliday M. and Hasan R. 1976. Cohesion in Eng­lish. <i>Longman, </i>London.</p><p>Harabagiu S. and Moldovan D. 1998. WordNet: An Electronic Lexical Database, chapter Knowl­edge Processing on an Extended WordNet. <i>MIT press.</i></p><p>Hirst G. and St-Onge D. 1997. Lexical Chains as representation of context for the detection and correction of malapropisms. In <i>Christiane Fell­baum, editor, WordNet: An Electronic Lexical Database and Some of its Applications. MIT Press, </i>pages 305-332.</p><p>Morris J. and Hirst. G. 1991, Lexical Cohesion Computed by Thesaural Relations as an Indica­tor of the Structure of Text <i>.Computational Lin­guistics, </i>17(1):21-48.</p><p>Silber H.G. and McCoy K.F. 2002. Efficiently Com­puted Lexical Chains As an Intermediate Representa­tion for Automatic Text Summarization. <i>Computa­tional Linguistics, </i>28(4):487-496.</p><table class="main" frame="box" rules="all" border="1" regular="False"><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Cases</p></td><td class="cell"><p>Precision</p></td><td class="cell"><p>Recall</p></td><td class="cell"><p>F1-measure</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Average</p></td><td class="cell"><p>0.52592</p></td><td class="cell"><p>0.48744</p></td><td class="cell"><p>0.50595</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Best</p></td><td class="cell"><p>0.61408</p></td><td class="cell"><p>0.59239</p></td><td class="cell"><p>0.60304</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Worst</p></td><td class="cell"><p>0.44375</p></td><td class="cell"><p>0.41159</p></td><td class="cell"><p>0.42707</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr></table></section><references><p>Barzilay, R. and Elhadad, M. 1997. Using Lexical Chains for Text Summarization. In <i>Proceedings of the 35th Annual Meeting of the Association for Computational Linguistics and the 8th Euro­pean Chapter Meeting of the Association for Computational Linguistics, </i>Workshop on Intel­ligent Scalable Test Summarization, pages 10­17, Madrid.</p></references></body></article>