<?xml version="1.0"?><!DOCTYPE article SYSTEM "/project/take/software/searchbench_offline_processing/paperxml_generator/aclextractor/src/python/../resource/dtd/paperxml.dtd"><article><header><firstpageheader><page local="1" global="111"/><title>Using Domain Information for Word Sense Disambiguation</title><author surname="Magnini" givenname="Bernardo"><org  name="Istituto la Ricerca Scientifica e Tecnologica" country="per"/></author><author surname="Strapparava" givenname="Carlo"><org  name="Istituto la Ricerca Scientifica e Tecnologica" country="per"/></author><author surname="Pezzulo" givenname="Giovanni"><org  name="Istituto la Ricerca Scientifica e Tecnologica" country="per"/></author><author surname="Gliozzo" givenname="Alfio"><org  name="Istituto la Ricerca Scientifica e Tecnologica" country="per"/></author></firstpageheader><frontmatter><p>Using Domain Information for Word Sense Disambiguation</p><p><b>Bernardo Magnini, Carlo Strapparava, Giovanni Pezzulo </b>and <b>Alfio Gliozzo</b></p><p>ITC-irst, Istituto per la Ricerca Scientifica e Tecnologica, 1-38050 Trento, ITALY email: {magnini, strappa, pezzulo, gliozzo}@itc.it</p></frontmatter><abstract>The major goal in ITC-irst's participation at Senseval-2 was to test the role of domain in­formation in word sense disambiguation. The underlying working hypothesis is that domain labels, such as Medicine, Architecture and Sport provide a natural way to establish se­mantic relations among word senses, which can be profitably used during the disambiguation process. For each task in which we participated (i.e. English all words, English 'lexical sample' and Italian 'lexical sample') a different mix of knowledge based and statistical techniques were implemented. </abstract></header><body><section number="1" title="Introduction"><p>Current investigation in Word Sense Disam­biguation (WSD) at ITC-irst focuses on the role of <i>domain information. </i>The hypothesis is that domain labels (such as Medicine, Architec­ture and Sport) provide a natural and pow­erful way to establish semantic relations among word senses, which can be profitably used dur­ing the disambiguation process. In particular, domains constitute a fundamental feature of text coherence, such that word senses occurring in a coherent portion of text tend to maximize domain similarity. The importance of domain information in WSD has been remarked in sev­eral works, including (Gonzalo et al., 1998) and (Buitelaar and Sacaleanu, 2001). In (Magnini and Strapparava, 2000) we introduced "Word Domain Disambiguation" (WDD) as a variant of WSD where for each word in a text a <i>domain </i>label (among those allowed by the word) has to be chosen instead of a <i>sense </i>label. We also ar­gued that WDD can be applied to disambigua­tion tasks that do not require fine grained sense distinctions, such as information retrieval and content-based user modeling.   For Senseval2 the goal was to evaluate the role of domain information in WSD: no other syntactic or se­mantic information has been used (e.g. seman­tic relations in Word Net) except domain la­bels. Three systems have been implemented, in­tegrating knowledge-based and statistical tech­niques, for the three tasks we participated in, i.e. English 'all words', English 'lexical sample' and Italian 'lexical sample'. The main lexical resource for domains is "WordNet Domains", an extension of English Wordnet 1.6 (Fellbaum, 1998) developed at ITC-irst, where synsets have been annotated with domain information.</p></section><section number="2" title="WordNet Domains"><p>The basic lexical resource we used in Senseval-2 is "WordNet Domains", an extension of WordNet 1.6 where each synset has been an­notated with at least one domain label, se­lected from a set of about two hundred la­bels hierarchically organized (see (Magnini and Cavaglià, 2000) for the annotation methodol­ogy and for the evaluation of the resource). The information from the domains that we added is complementary to what is already in WordNet. First of all a domain may in­clude synsets of different syntactic categories: for instance Medicine groups together senses from Nouns, such as <b>doctor#l </b>and <b>hospital#l, </b>and from Verbs such as <b>operate#7. </b>Sec­ond, a domain may include senses from dif­ferent WordNet sub-hierarchies (i.e. deriv­ing from different "unique beginners" or from different "lexicographer files"). For example, Sport contains senses such as <b>athlete#l, </b>de­riving from <b>lifejform#l, game_equipment#l </b>from <b>physical_ob</b>j <b>ect# 1, sport</b>#lfrom <b>act#2, </b>and <b>playingjfield#l </b>from <b>location#l. </b>Fi­nally, domains may group senses of the same word into homogeneous clusters, with the side effect of reducing word polysemy in WordNet.<page local="2" global="112"/> Table 1 shows an example. The word "bank" has ten different senses in WordNet 1.6: three of them (i.e. sense 1, 3 and 6) can be grouped under the Economy domain, while sense 2 and 7 both belong to Geography and Geology, causing the reduction of the polysemy from 10 to 7 senses. For the purposes of Senseval-2 we have considered 41 disjoint labels which al­low a good level of abstraction without loosing relevant information (i.e. in the experiments we have used Sport in place of Volley or Bas­ketball, which are subsumed by Sport).</p><p>Table 1: WordNet senses, domains and occur­rences in Semcor for the word "bank"</p><p>Two mapping procedures have been imple­mented for Senseval-2 in order to use do­main information. For the English tasks a map­ping from WordNet 1.6 to the WordNet 1.7 pre-release made available to participants; for the Italian task a mapping from Word-Net 1.6 to WordNet 1.5, because the inter­lingual index of EuroWordNet (Vossen, 1998) is in that version. The mapping to WordNet 1.7 is based on a set of heuristics (e.g. corre­spondences between synonyms, glosses and hy-pernyms) which discover corresponding synset pairs. Then, an inheritance algorithm is ap­plied to WordNet 1.7 in order to fill unas-signed synsets with domain labels. As far as the Italian wordnet is concerned the same pro­cedure used for the WordNet 1.7 mapping has been applied to WordNet 1.5, resulting in the annotation of the Interlingual Index. Then the equivalence links (we excluded eqJiyperonym and eq_hyphonym) from the ILI to the Italian synsets were used to bring the domain informa­tion to Italian words.</p><p>There was no time for a complete evaluation of the quality of the mapping procedures.</p></section><section number="3" title="Algorithms"><p>The starting point in the algorithm design was the previous work in word domain disambigua­tion reported in (Magnini and Strapparava, 2000). One drawback of that approach is that, for rather long texts, it does not consider do­main variations. To overcome this problem we have introduced <i>contexts </i>within which domains are calculated. A second direction of work has been the acquisition of domain information from annotated texts (i.e. Semcor and the training data). The following sections presents details of the disambiguation procedures implemented for Senseval-2.</p><subsection number="3.1" title="Linguistic Processing"><p>XML files made available by the task organizers have been processed with an XML parser. As for lemmatization and part-of-speech tagging the Tree Tagger, developed at the University of Stuttgart (Schmid, 1994) has been used, both for English and Italian. The WordNet mor­phological analyser has also been used in order to resolve ambiguities and lemmatization mis­takes. After this process texts are represented as vectors of triples: word lemma, WordNet part of speech and position in the text.</p></subsection><subsection number="3.2" title="Scoring Domains for a Lemma"><p>The basic procedure in domain driven disam­biguation is a function that, given a lemma L, associates a score to each domain defined for that lemma in Wordnet Domains.<page local="3" global="113"/> Such a score is the relative frequency of the domain in L, computed on the basis of the occurrences of the synsets of L in Semcor. Semcor occurrences for synsets with multiple domain annotations are repeated for each domain (e.g. if a synset has 2 occurrences and 2 labels it is counted as having 4 occurrences), while synsets with 0 occurrences are counted as 0.5. As an example, consider the lemma "bank" in Table 1. According to our scoring method, it has 57 total occurrences in Semcor. The Geology domain collects contri­butions from senses 2 and 7, for a total of 16 occurrences in Semcor, which corresponds to a frequency .28 (i.e. <i>fq[DGeoiogy](bank) </i>= 0.28).</p><table caption='Table 1: WordNet senses, domains and occurrences in Semcor for the word "bank"' class="main" frame="box" rules="all" border="1" regular="False"><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p><i>Sense</i></p></td><td class="cell"><p><i>Synset &amp; Gloss</i></p></td><td class="cell"><p><i>Domains</i></p></td><td class="cell"><p><i>Semcor occurr.</i></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>#i</p></td><td class="cell"><p>depository finan­cial institution, bank, banking concern, bank­ing company (a financial institu­tion. .. )</p></td><td class="cell"><p>Economy</p></td><td class="cell"><p>20</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>#2</p></td><td class="cell"><p>bank (sloping land. .. )</p></td><td class="cell"><p>Geography, Geology</p></td><td class="cell"><p>14</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>#3</p></td><td class="cell"><p>bank (a supply or stock held in re­serve. .. )</p></td><td class="cell"><p>Economy</p></td><td class="cell"><p></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>#4</p></td><td class="cell"><p>bank, bank building (a build­ing. .. )</p></td><td class="cell"><p>Architecture Economy</p></td><td class="cell"><p></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>#5</p></td><td class="cell"><p>bank (an arrange­ment of similar objects...)</p></td><td class="cell"><p>Factotum</p></td><td class="cell"><p>1</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>#6</p></td><td class="cell"><p>savings bank, coin bank, money box, bank (a container. .. )</p></td><td class="cell"><p>Economy</p></td><td class="cell"><p></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>#7</p></td><td class="cell"><p>bank (a long ridge or pile... )</p></td><td class="cell"><p>Geography, Geology</p></td><td class="cell"><p>2</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>#8</p></td><td class="cell"><p>bank (the funds held by a gam­bling house. .. )</p></td><td class="cell"><p>Economy, Play</p></td><td class="cell"><p></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>#9</p></td><td class="cell"><p>bank, cant, cam­ber (a slope in the turn of a road... )</p></td><td class="cell"><p>Architecture</p></td><td class="cell"><p></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>#10</p></td><td class="cell"><p>bank (a flight ma­neuver. .. )</p></td><td class="cell"><p>Transport</p></td><td class="cell"><p>-</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr></table></subsection><subsection number="3.3" title="Domain Vectors"><p>The data structure that collects domain infor­mation is called a <i>Domain Vector </i>(DV). Intu­itively a DV represents the domains that are relevant for a certain lemma (or word sense) in a certain context. We have considered three kinds of DV's: a DV for a lemma L within a context C <i>(DV£), </i>for the case of test data; a DV for a synset S of a lemma L within a context C <i>(DV$),</i><i> </i>for the case of training data; and a DV for a synset S of a lemma L in WordNet <i>(DVs)</i>, which is used when no training data are available.</p><p><b>DV for a lemma in context </b><i>(DV£).</i><i> </i>Given a set of domains <i>D\ </i>... Z?n, a DV for a lemma <i>L </i>in a position <i>K </i>within a text represents the rele­vance of those domains for that lemma, i.e. each component <i>DVi[i] </i>gives the degree of relevance of the domain <i>D{ </i>for the lemma <i>L.</i><i> </i>Given a con­text of <i>±C </i>words before and after the lemma <i>L </i>in the position if, each component of the do­main vector is defined with the following for­mula:</p><doubt alpha="50.0" length="2" tooSmall="False" monospace="0.0">+c</doubt><doubt alpha="57.7" length="26" tooSmall="False" monospace="0.0">dvl[{\=EFq[Di](Lk) * gauss</doubt><doubt alpha="50.0" length="4" tooSmall="False" monospace="0.0">k=~C</doubt><p>where <i>gauss </i>is the normal distribution cen­tered on the position <i>K.</i><i> </i>In the current al­gorithms <i>C </i>is set to 50 because our experi­ments with Semcor showed that the precision decreases below that thresold.</p><p>Intuitively, the above formula takes into ac­count the contribution of the lemmas in the con­text <i>C </i>to the sense of the target lemma L. In addition a DV actually selects a set of relevant domains rather than just one domain.</p><p><b>DV for a synset in context </b><i>(DVg)</i><i> </i>In case a training corpus is available where lemmas are annotated with the correct sense, Domain Vec­tors are computed with the formula above. In­stead of considering a lemma in a position <i>K </i>within a text, we have a sense for that lemma (i.e. a synset). <i>DV$ </i>represents a "typical" vec­tor for a sense <i>S</i><i> </i>of a lemma <i>L.</i></p><p><b>DV for a synset without context </b><i>(DVs)</i><i> </i>When a training corpus is not available (as for the 'all words' task), a simpler way to build a DV for a certain synset is to compute it with respect to WordNet Domains. Given a synset <i>S </i>in WordNet Domains, the domain vector <i>DVs </i>is a vector that has l's in the position of its domain(s) and 0's otherwise. A more accurate DV could be obtained by considering contextual information such as the synset gloss.</p></subsection><subsection number="3.4" title="Comparing Domain Vectors"><p>To disambiguate a lemma L (i.e. the target lemma) in a text, first its <i>DV£ </i>is computed. The next step consists of comparing the DV of the target lemma <i>L </i>with the domain vec­tors for each sense of <i>L </i>derived either from the training set, when available, or from WordNet Domains, when training data are not available. The sense vector <i>DVs </i>which maximizes the sim­ilarity is selected as the appropriate sense of <i>L </i>in that text. The similarity between two DV's is calculated with the standard scalar product: <b><i>DVx </i></b>• <i>DV2 = </i><b>Et </b><b><i>DVX[%\ * DVx[i\.</i></b></p></subsection></section><section number="4" title="Results and Discussion"><p>Table 2 presents the results, in terms of pre­cision and recall, obtained at the Senseval-2 initiative for the three tasks in which we partic­ipated.</p><table caption="Table 2: Final results of ITC-irst systems atSenseval-2"></table><table caption="Table 2: Final results of ITC-irst systems at Senseval-2" class="main" frame="box" rules="all" border="1" regular="False"><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p><i>Task</i></p></td><td class="cell"><p><i>Precision</i></p></td><td class="cell"><p><i>Recall</i></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>English All Words (fine g.)</p></td><td class="cell"><p>.748</p></td><td class="cell"><p>.357</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>English All Words (coarse g.)</p></td><td class="cell"><p>.748</p></td><td class="cell"><p>.357</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>English Lexical Sample (fine g.)</p></td><td class="cell"><p>.665</p></td><td class="cell"><p>.249</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>English Lexical Sample (coarse g.)</p></td><td class="cell"><p>.720</p></td><td class="cell"><p>.269</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Italian Lexical Sample (fine g.)</p></td><td class="cell"><p>.375</p></td><td class="cell"><p>.371</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr></table><page local="4" global="114"/><subsection number="4.1" title="English 'All Words'"></subsection></section><section number="5" title="Conclusions"><p>The 'all words' task seems to benefit from the domain approach. One reason for this is that texts are enough long to provide an accurate context (as mentioned in section 3.3, we used a window of 100 content words around the tar­get word) within which domains are coherent. The rather low degree of recall reflects the fact that few words in a text carry relevant domain information. Most of the words actually be­have such as a "factotum" (see (Magnini and Cavaglià, 2000) for a preliminary discussion on this problem) that can equally occur in almost every domain. Some words lie outside the do­main approach and their senses could be cap­tured with the integration of local (e.g. syntac­tic) information.</p><subsection number="4.2" title="English 'Lexical Sample'"><p>From the point of view of domain driven dis­ambiguation, the 'lexical sample' task was in­herently more difficult than the 'all words' task for two reasons. First the context provided for disambiguation was generally shorter than the 100 words we used to build a semantic vector. Second, the high number of "factotum" words to be disambiguated resulted in a recall even lower (i.e. about 0.24) than for the 'all words' task. The improvement of performance from the fine grained to the coarse grained evalua­tion seems to confirm that, at least to some de­gree, domain clustering corresponds to the sense grouping created by the task organizers.</p></subsection><subsection number="4.3" title="Italian 'Lexical Sample'"><p>The low results obtained for the Italian 'lexical sample' task may have several causes. First of all, the absence of a training set and the ab­sence of any tagged text for Italian forced us to use a similarity function (see 3.4) trained to an English corpus. This was possible be­cause we maintained the mappings between the English and the Italian wordnets. However, these multiple mappings (i.e. from Word-NetI.6 to WordNet1.5 and then to the Ital­ian synsets through the equivalence links) are another source of possible errors, especially con­cerning the domain information associated with Italian synsets.</p><p>We have described an approach to word sense disambiguation based on domain information. The underlying assumption is that domains con­stitute a fundamental feature of text coherence. As a consequence, word senses occurring in a co­herent portion of text tend to maximize domain similarity. Three systems have been imple­mented, integrating knowledge-based and sta­tistical techniques, for the three task we partic­ipated in. As for lexical resources, the systems make use of WordNet Domains, an extension of English Wordnet 1.6, where synsets have been annotated with domain information. The dis­ambiguation algorithm is based on domain vec­tors that collect contextual information with re­spect to the target word. At this moment only domain information is used in our system. A promising research direction is the use of local information (e.g. syntax) to capture word be­haviors that lie outside the domain approach.</p></subsection></section><references><p>P. Buitelaar and B. Sacaleanu. 2001. Ranking and selecting synsets by domain relevance. In <i>Proc. of NAACL Workshop on WordNet and Other Lexical Resources: Applications, Extensions and Customization, </i>Pittsburgh, PA, June.</p><p>C. Fellbaum. 1998. <i>WordNet. An Electronic Lexical Database. </i>The MIT Press.</p><p>J. Gonzalo, F. Verdejio, C. Peters, and N. Cal-zolari. 1998. Applying eurowordnet to cross-language text retrieval. <i>Computers and Hu­manities, </i>32 (2-3): 185-207.</p><p>B. Magnini and G. Cavaglià. 2000. Integrat­ing subject field codes into WordNet. In <i>Pro­ceedings of LREC-2000, Second International Conference on Language Resources and Eval­uation, </i>Athens, Greece, June.</p><p>B. Magnini and C. Strapparava. 2000. Exper­iments in word domain disambiguation for parallel texts. In <i>Proc. of SIGLEX Workshop on Word Senses and Multi-linguality, </i>Hong-Kong, October.</p><p>H. Schmid. 1994. Probabilistic part-of-speech tagging using decision trees. In <i>Proceedings of the International Conference on New Meth­ods in Language Processing.</i></p><p>P. Vossen. 1998. Special issue on eurowordnet. <i>^Computers and Humanities, </i>32.</p></references></body></article>