<?xml version="1.0"?><!DOCTYPE article SYSTEM "/project/take/software/searchbench_offline_processing/paperxml_generator/aclextractor/src/python/../resource/dtd/paperxml.dtd"><article><header><firstpageheader><page local="1" global="390"/><title>UMND1: Unsupervised Word Sense Disambiguation Using Contextual Semantic Relatedness</title><pubinfo>Proceedings of the 4th International Workshop on Semantic Evaluations (SemEval-2007),pages 390-393, Prague, June 2007. ©2007 Association for Computational Linguistics</pubinfo><author surname="Patwardhan" givenname="Siddharth"><org  name="University of Utah" country="USA" city="Salt Lake City"/></author><author surname="Banerjee" givenname="Satanjeev"><org  name="Carnegie Mellon University" country="USA" city="Pittsburgh"/></author><author surname="Pedersen" givenname="Ted"><org  name="University of Minnesota Duluth" country="USA" city="Duluth"/></author></firstpageheader><frontmatter><p><b>UMND1: Unsupervised Word Sense Disambiguation Using Contextual</b></p><p><b>Semantic Relatedness</b></p><p><b>Siddharth Patwardhan</b></p><p>School of Computing University of Utah Salt Lake City, UT 84112. sidd@cs.utah.edu</p><p><b>Satanjeev Banerjee</b></p><p>Language Technologies Inst. Carnegie Mellon University</p><p>Pittsburgh, PA 15217. banerjee@cs.cmu.edu</p><p><b>Ted Pedersen</b></p><p>Dept. of Computer Science University of Minnesota</p><p>Duluth, MN 55812. tpederse@d.umn.edu</p></frontmatter><abstract>In this paper we describe an unsuper­vised WordNet-based Word Sense Disam­biguation system, which participated (as UMND1) in the SemEval-2007 Coarse­grained English Lexical Sample task. The system disambiguates a target word by using WordNet-based measures of semantic relat-edness to find the sense of the word that is semantically most strongly related to the senses of the words in the context of the tar­get word. We briefly describe this system, the configuration options used for the task, and present some analysis of the results. </abstract></header><body><section number="1" title="Introduction"><p>WordNet::SenseRelate::TargetWord<footnote anchor="1"/> (Patwardhan et al., 2005; Patwardhan et al., 2003) is an unsuper-vised Word Sense Disambiguation (WSD) system, which is based on the hypothesis that the intended sense of an ambiguous word is related to the words in its context. For example, if the "financial institution" sense of <i>bank </i>is intended in a context, then it is highly likely the context would contain related words such as <i>money, transaction, interest rate, </i>etc. The algorithm, therefore, determines the intended sense of a word <i>(target word) </i>in a given context by measuring the relatedness of each sense of that word with the words in its context. The sense of the target word that is most related to its context is selected as the intended sense of the target word. The system uses WordNet-based measures of semantic relatedness<footnote anchor="2"/> (Pedersen et al., 2004) to measure the relatedness between the different senses of the target word and the words in its context.</p><footnote>'http://senserelate.sourceforge.net</footnote><p>This system is completely unsupervised and re­quires no annotated data for training. The lexical database WordNet (Fellbaum, 1998) is the only re­source that the system uses to measure the related-ness between words and concepts. Thus, our system is classified under the <i>closed track </i>of the task.</p></section><section number="2" title="System Description"><p>Our WSD system consists of a modular framework, which allows different algorithms for the different subtasks to be plugged into the system. We divide the disambiguation task into two primary subtasks: <i>context selection </i>and <i>sense selection. </i>The context selection module tries to select words from the con­text that are most likely to be indicative of the sense of the target word. The sense selection module then uses the set of selected context words to choose one of the senses of the target word as the answer.</p><p>Figure 1 shows a block schematic of the system, which takes SemEval-2007 English Lexical Sample instances as input. Each instance is a made up of a few English sentences, and one word from these sentences is marked as the target word to be dis-ambiguated. The system processes each instance through multiple modules arranged in a sequential pipeline. The final output of the pipeline is the sense that is most appropriate for the target word in the given context.</p><footnote label="2">http://wn-similarity.sourceforge.net</footnote><page local="2" global="391"/><p><b>Format Filter</b> <b>Preprocessing</b></p><p>Target Sense <b>Sense Selection</b> <b>Postprocessing</b> <b>Relatedness Measure</b> <b>Context Selection</b></p><figure caption="Figure 1: System Architecture"></figure><subsection number="2.1" title="Data Preparation"><p>The input text is first passed through a <i>format fil­ter, </i>whose task is to parse the input XML file. This is followed by a <i>preprocessing </i>step. Each instance passed to the preprocessing stage is first segmented into words, and then all compound words are iden­tified. Any sequence of words known to be a com­pound in WordNet is combined into a single entity.</p></subsection><subsection number="2.2" title="Context Selection"><p>Although each input instance consists of a large number of words, only a few of these are likely to be useful for disambiguating the target word. We use the context selection algorithm to select a subset of the context words to be used for sense selection. By removing the unimportant words, the computa­tional complexity of the algorithm is reduced.</p><p>In this work, we use the <i>NearestWords </i>context selection algorithm. This algorithm algorithm se­lects 2n + 1 content words surrounding the target word (including the target word) as the context. A stop list is used to identify closed-class non-content words. Additionally, any word not found in Word­Net is also discarded. The algorithm then selects n content words before and n content words follow­ing the target word, and passes this unordered set of 2n + 1 words to the Sense Selection module.</p></subsection><subsection number="2.3" title="Sense Selection Algorithm"><p>The sense selection module takes the set of words output by the context selection module, one ofwhich is the target word to be disambiguated. For each of the words in this set, it retrieves a list of senses from WordNet, based on which it determines the intended sense of the target word.</p><p>The package provides two main algorithms for Sense Selection: the <i>local </i>and the <i>global </i>algorithms, as described in previous work (Banerjee and Peder-sen, 2002; Patwardhan et al., 2003). In this work, we use the <i>local </i>algorithm, which is faster and was shown to perform as well as the <i>global </i>algorithm.</p><p>The <i>local </i>sense selection algorithm measures the semantic relatedness of each sense of the target word with the senses of the words in the context, and se­lects that sense of the target word which is most re­lated to the context word-senses. Given the 2n + 1 context words, the system scores each sense of the target word. Suppose the target word t has T senses, enumerated as <i>t\, t2,</i>..., tT. Also, suppose <i>w\, w2, </i>..., w2n are the words in the context of t, each hav­ing <i>W\, W2,</i>..., <i>W2n </i>senses, respectively. Then for each <i>t</i><i>i </i>a score is computed as where wjk is the <i>kth </i>sense of word <i>Wj</i>. The sense tiof target word <i>t </i>with the highest score is selected as the intended sense of the target word.</p><doubt alpha="50.0" length="2" tooSmall="False" monospace="0.0">2n</doubt><doubt alpha="54.5" length="44" tooSmall="False" monospace="0.0">score(ti) =        max  (relatedness^, wjk))</doubt><doubt alpha="45.5" length="11" tooSmall="False" monospace="0.0">—' k=1to Wj</doubt><doubt alpha="33.3" length="3" tooSmall="False" monospace="0.0">j=1</doubt><p>The relatedness between two word senses is com­puted using a measure of semantic relatedness de­fined in the WordNet::Similarity software package (Pedersen et al., 2004), which is a suite of Perl mod­ules implementing a number WordNet-based mea­sures of semantic relatedness. For this work, we used the Context Vector measure (Patwardhan and Pedersen, 2006). The relatedness of concepts is computed based on word co-occurrence statistics derived from WordNet glosses. Given two WordNet senses, this module returns a score between 0 and 1, indicating the relatedness of the two senses.</p><p>Our system relies on WordNet as its sense inven­tory. However, this task used OntoNotes (Hovy et al., 2006) as the sense inventory. OntoNotes word senses are groupings of similar WordNet senses. Thus, we used the training data answer key to gen­erate a mapping between the OntoNotes senses of the given lexical elements and their corresponding WordNet senses. We had to manually create the mappings for some of the WordNet senses, which had no corresponding OntoNotes senses. The sense selection algorithm performed all of its computa­tions with respect to the WordNet senses, and finally the OntoNotes sense corresponding to the selected WordNet sense of the target word was output as the</p><p>Instance<page local="3" global="392"/></p><p>answer for each instance.</p></subsection></section><section number="3" title="Results and Analysis"><p>For this task, we used the freely available Word-Net::SenseRelate::TargetWord v0.10 and the Word-Net::Similarity v1.04 packages. WordNet v2.1 was used as the underlying knowledge base for these. The context selection module used a window size of five (including the target word). The semantic re-latedness of concepts was measured using the Con­text Vector measure, with configuration options as defined in previous research (Patwardhan and Ped-ersen, 2006). Since we always predict exactly one sense for each instance, the precision and recall val­ues of all our experiments were always the same. Therefore, in this section we will use the name "ac­curacy" to mean both precision and recall.</p><subsection number="3.1" title="Overall Results, and Baselines"><p>The overall accuracy of our system on the test data is 0.538. This represents 2,609 correctly disam-biguated instances, out of a total of 4,851 instances.</p><p>As baseline, we compare against the <i>random </i>al­gorithm where for each instance, we randomly pick one of the WordNet senses for the lexical element in that instance, and report the OntoNotes senseid it maps to as the answer. This algorithm gets an ac­curacy of 0.417. Thus, our algorithm gets an im­provement of 12% absolute (29% relative) over this random baseline.</p><p>Additionally, we compare our algorithm against the <i>WordNet SenseOne </i>algorithm. In this algorithm, we pick the <i>first </i>sense among the WordNet senses of the lexical element in each instance, and report its corresponding OntoNotes sense as the answer for that instance. This algorithm leverages the fact that (in most cases) the WordNet senses for a particular word are listed in the database in descending order of their frequency of occurrence in the corpora from which the sense inventory was created. If the new test data has a similar distribution of senses, then this algorithm amounts to a "majority baseline". This algorithm achieves an accuracy of 0.681 which is 15% absolute (27% relative) better than our algo­rithm. Although this seemingly naive algorithm out­performs our algorithm, we choose to avoid using this information in our algorithms because it represents a large amount of human supervision in the form of manual sense tagging of text, whereas our goal is to create a purely unsupervised algorithm. Additionally, our algorithms can, with little change, work with other sense inventories besides WordNet that may not have this information.</p></subsection><subsection number="3.2" title="Results Disaggregated by Part of Speech"><p>In our past experience, we have found that av­erage disambiguation accuracy differs significantly between words of different parts of speech. For the given test data, we separately evaluated the noun and verb instances. We obtained an accuracy of 0.399 for the noun targets and 0.692 for the verb targets. Thus, we find that our algorithm performs much bet­ter on verbs than on nouns, when evaluated using the OntoNotes sense inventory. This is different from our experience with S ENSEVAL data from previous years where performance on nouns was uniformly better than that on verbs. One possible reason for the better performance on verbs is that the OntoNotes sense inventory has, on average, fewer senses per verb word (4.41) than per noun word (5.71). How­ever, additional experimentation is needed to more fully understand the difference in performance.</p></subsection><subsection number="3.3" title="Results Disaggregated by Lexical Element"><p>To gauge the accuracy of our algorithm on different words (lexical elements), we disaggregated the re­sults by individual word. Table 1 lists the accuracy values over instances of individual verb lexical ele­ments, and Table 2 lists the accuracy values for noun lexical elements. Our algorithm gets all instances correct for 13 verb lexical elements, and for none of the noun lexical elements. More generally, our al­gorithm gets an accuracy of 50% or more on 45 out of the 65 verb lexical elements, and on 15 out of the 35 noun lexical elements. For nouns, when the ac­curacy results are viewed in sorted order (as in Table 2), one can observe a sudden degradation of results between the accuracy of the word <i>system.n </i>- 0.443 - and the word <i>source.n </i>- 0.257. It is unclear why there is such a jump; there is no such sudden degra­dation in the results for the verb lexical elements.</p></subsection></section><section number="4" title="Conclusions"><p>This paper describes our system UMND1, which participated in the SemEval-2007 Coarse-grained<page local="4" global="393"/></p><p>English Lexical Sample task. The system is based on WordNet::SenseRelate::TargetWord, which is a freely available unsupervised Word Sense Disam­biguation software package. The system uses WordNet-based measures of semantic relatedness to select the intended sense of an ambiguous word. The system required no training data and using WordNet as its only knowledge source achieved an accuracy of 54% on the blind test set.</p></section><section title="Acknowledgments"><p>This research was partially supported by a National Science Foundation Early CAREER Development award (#0092784).</p><table caption="Table 1: Verb Lexical Element Accuracies" class="main" frame="box" rules="all" border="1" regular="False"><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p><b>Word</b></p></td><td class="cell"><p><b>Accuracy</b></p></td><td class="cell"><p><b>Word</b></p></td><td class="cell"><p><b>Accuracy</b></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>remove</p></td><td class="cell"><p>1.000</p></td><td class="cell"><p>purchase</p></td><td class="cell"><p>1.000</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>negotiate</p></td><td class="cell"><p>1.000</p></td><td class="cell"><p>improve</p></td><td class="cell"><p>1.000</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>hope</p></td><td class="cell"><p>1.000</p></td><td class="cell"><p>express</p></td><td class="cell"><p>1.000</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>exist</p></td><td class="cell"><p>1.000</p></td><td class="cell"><p>estimate</p></td><td class="cell"><p>1.000</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>describe</p></td><td class="cell"><p>1.000</p></td><td class="cell"><p>cause</p></td><td class="cell"><p>1.000</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>avoid</p></td><td class="cell"><p>1.000</p></td><td class="cell"><p>attempt</p></td><td class="cell"><p>1.000</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>affect</p></td><td class="cell"><p>1.000</p></td><td class="cell"><p>say</p></td><td class="cell"><p>0.969</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>explain</p></td><td class="cell"><p>0.944</p></td><td class="cell"><p>complete</p></td><td class="cell"><p>0.938</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>disclose</p></td><td class="cell"><p>0.929</p></td><td class="cell"><p>remember</p></td><td class="cell"><p>0.923</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>allow</p></td><td class="cell"><p>0.914</p></td><td class="cell"><p>announce</p></td><td class="cell"><p>0.900</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>kill</p></td><td class="cell"><p>0.875</p></td><td class="cell"><p>occur</p></td><td class="cell"><p>0.864</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>do</p></td><td class="cell"><p>0.836</p></td><td class="cell"><p>replace</p></td><td class="cell"><p>0.800</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>maintain</p></td><td class="cell"><p>0.800</p></td><td class="cell"><p>complain</p></td><td class="cell"><p>0.786</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>believe</p></td><td class="cell"><p>0.764</p></td><td class="cell"><p>receive</p></td><td class="cell"><p>0.750</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>approve</p></td><td class="cell"><p>0.750</p></td><td class="cell"><p>buy</p></td><td class="cell"><p>0.739</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>produce</p></td><td class="cell"><p>0.727</p></td><td class="cell"><p>regard</p></td><td class="cell"><p>0.714</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>propose</p></td><td class="cell"><p>0.714</p></td><td class="cell"><p>need</p></td><td class="cell"><p>0.714</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>care</p></td><td class="cell"><p>0.714</p></td><td class="cell"><p>feel</p></td><td class="cell"><p>0.706</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>recall</p></td><td class="cell"><p>0.667</p></td><td class="cell"><p>examine</p></td><td class="cell"><p>0.667</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>claim</p></td><td class="cell"><p>0.667</p></td><td class="cell"><p>report</p></td><td class="cell"><p>0.657</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>find</p></td><td class="cell"><p>0.607</p></td><td class="cell"><p>grant</p></td><td class="cell"><p>0.600</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>work</p></td><td class="cell"><p>0.558</p></td><td class="cell"><p>begin</p></td><td class="cell"><p>0.521</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>build</p></td><td class="cell"><p>0.500</p></td><td class="cell"><p>keep</p></td><td class="cell"><p>0.463</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p></p></td><td class="cell"><p>0.459</p></td><td class="cell"><p>contribute</p></td><td class="cell"><p>0.444</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>rush</p></td><td class="cell"><p>0.429</p></td><td class="cell"><p>start</p></td><td class="cell"><p>0.421</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>raise</p></td><td class="cell"><p>0.382</p></td><td class="cell"><p>end</p></td><td class="cell"><p>0.381</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>prove</p></td><td class="cell"><p>0.364</p></td><td class="cell"><p>enjoy</p></td><td class="cell"><p>0.357</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>see</p></td><td class="cell"><p>0.296</p></td><td class="cell"><p>set</p></td><td class="cell"><p>0.262</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>promise</p></td><td class="cell"><p>0.250</p></td><td class="cell"><p>hold</p></td><td class="cell"><p>0.250</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>lead</p></td><td class="cell"><p>0.231</p></td><td class="cell"><p>prepare</p></td><td class="cell"><p>0.222</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>join</p></td><td class="cell"><p>0.222</p></td><td class="cell"><p>ask</p></td><td class="cell"><p>0.207</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>come</p></td><td class="cell"><p>0.186</p></td><td class="cell"><p>turn</p></td><td class="cell"><p>0.048</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>fix</p></td><td class="cell"><p>0.000</p></td><td class="cell"><p></p></td><td class="cell"><p></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr></table><table caption="Table 2: Noun Lexical Element Accuracies" class="main" frame="box" rules="all" border="1" regular="False"><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p><b>Word</b></p></td><td class="cell"><p><b>Accuracy</b></p></td><td class="cell"><p><b>Word</b></p></td><td class="cell"><p><b>Accuracy</b></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>policy</p></td><td class="cell"><p>0.949</p></td><td class="cell"><p>people</p></td><td class="cell"><p>0.904</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>future</p></td><td class="cell"><p>0.870</p></td><td class="cell"><p>drug</p></td><td class="cell"><p>0.870</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>space</p></td><td class="cell"><p>0.857</p></td><td class="cell"><p>capital</p></td><td class="cell"><p>0.789</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>effect</p></td><td class="cell"><p>0.767</p></td><td class="cell"><p>condition</p></td><td class="cell"><p>0.765</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>job</p></td><td class="cell"><p>0.692</p></td><td class="cell"><p>bill</p></td><td class="cell"><p>0.686</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>area</p></td><td class="cell"><p>0.676</p></td><td class="cell"><p>base</p></td><td class="cell"><p>0.650</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>management</p></td><td class="cell"><p>0.600</p></td><td class="cell"><p>power</p></td><td class="cell"><p>0.553</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>development</p></td><td class="cell"><p>0.517</p></td><td class="cell"><p>chance</p></td><td class="cell"><p>0.467</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>exchange</p></td><td class="cell"><p>0.459</p></td><td class="cell"><p>order</p></td><td class="cell"><p>0.456</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>part</p></td><td class="cell"><p>0.451</p></td><td class="cell"><p>president</p></td><td class="cell"><p>0.446</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>system</p></td><td class="cell"><p>0.443</p></td><td class="cell"><p>source</p></td><td class="cell"><p>0.257</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>network</p></td><td class="cell"><p>0.218</p></td><td class="cell"><p>state</p></td><td class="cell"><p>0.208</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>share</p></td><td class="cell"><p>0.192</p></td><td class="cell"><p>rate</p></td><td class="cell"><p>0.186</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>hour</p></td><td class="cell"><p>0.167</p></td><td class="cell"><p>plant</p></td><td class="cell"><p>0.109</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>move</p></td><td class="cell"><p>0.085</p></td><td class="cell"><p>point</p></td><td class="cell"><p>0.080</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>value</p></td><td class="cell"><p>0.068</p></td><td class="cell"><p>defense</p></td><td class="cell"><p>0.048</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>position</p></td><td class="cell"><p>0.044</p></td><td class="cell"><p>carrier</p></td><td class="cell"><p>0.000</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>authority</p></td><td class="cell"><p>0.000</p></td><td class="cell"><p></p></td><td class="cell"><p></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr></table></section><references><p>S. Banerjee and T. Pedersen. 2002. An Adapted Lesk Al­gorithm for Word Sense Disambiguation Using Word-Net. In <i>Proceedings of the Third International Con-</i> <i>ference on Intelligent Text Processing and Computa­tional Linguistics, </i>pages 136-145, Mexico City, Mex­ico, February.</p><p>C. Fellbaum, editor. 1998. <i>WordNet: An electronic lexi­cal database. </i>MIT Press.</p><doubt alpha="65.2" length="46" tooSmall="False" monospace="0.0">E. Hovy, M. Marcus, M. Palmer, L. Ramshaw, and</doubt><p>R. Weischedel. 2006. OntoNotes: The 90% Solu­tion. In <i>Proceedings ofthe Human Language Tech­nology Conference ofthe North American Chapter of theACL, </i>pages 57-60, New York, NY, June.</p><p>S. Patwardhan and T. Pedersen. 2006. Using WordNet-based Context Vectors to Estimate the Semantic Relat-edness of Concepts. In <i>Proceedings of the EACL 2006 Workshop on Making Sense ofSense: Bringing Com­putational Linguistics and Psycholinguistics Together, </i>pages 1-8, Trento, Italy, April.</p><p>S. Patwardhan, S. Banerjee, and T. Pedersen. 2003. Us­ing Measures of Semantic Relatedness for Word Sense Disambiguation. In <i>Proceedings </i><i>ofthe</i><i> Fourth In­ternational Conference on Intelligent Text Processing and Computational Linguistics, </i>pages 241-257, Mex­ico City, Mexico, February.</p><p>S. Patwardhan, T. Pedersen, and S. Banerjee. 2005. SenseRelate::TargetWord - A Generalized Framework for Word Sense Disambiguation. In <i>Proceedings of the Twentieth National Conference on Artificial In­telligence (Intelligent Systems Demonstrations), </i>pages 1692-1693, Pittsburgh, PA, July.</p><p>T. Pedersen, S. Patwardhan, and J. Michelizzi. 2004. WordNet::Similarity - Measuring the Relatedness of Concepts. In <i>Human Language Technology Confer­ence ofthe North American Chapter ofthe Association for Computational Linguistics Demonstrations, </i>pages 38-41, Boston, MA, May.</p></references></body></article>