<?xml version="1.0"?><!DOCTYPE article SYSTEM "/project/take/software/searchbench_offline_processing/paperxml_generator/aclextractor/src/python/../resource/dtd/paperxml.dtd"><article><header><firstpageheader><page local="1" global="103"/><title>Primitive-Based Word Sense Disambiguation for SENSEVAL-2</title><author surname="Tat" givenname="Lim Beng"><org  name="Universiti Sains Malaysia" country="Malaysia" city="Pulau Pinang"/></author><author surname="Yusoff" givenname="Zaharin"><org  name="Universiti Sains Malaysia" country="Malaysia" city="Pulau Pinang"/></author><author surname="Kong" givenname="Tang Enya"><org  name="Universiti Sains Malaysia" country="Malaysia" city="Pulau Pinang"/></author><author surname="Ming" givenname="Guo Cheng"><org  name="Universiti Sains Malaysia" country="Malaysia" city="Pulau Pinang"/></author></firstpageheader><frontmatter><p><b>Primitive-Based Word Sense Disambiguation For SENSEVAL-2</b></p><p><b>Lim Beng Tat, Prof Zaharin Yusoff, Dr Tang Enya Kong </b>and <b>Dr Guo Cheng Ming</b></p><p>Unit Terjemahan Melalui Komputer, Universiti Sains Malaysia, 11800, PulauPinang. {btlim, zarin, enyakong, cmguo}@cs.usm.my</p></frontmatter><abstract>This paper describes a descriptive-semantic-primitive-based method for word sense disambiguation (WSD) with a machine-tractable dictionary and conceptual distance data among primitives. This approach is using unsupervised learning algorithm and focuses only on the immediately surrounding words and basis morphological form to disambiguate a word sense. This approach also agrees with past observations that human only requires a small window of a few words to perform WSD. (Choueka &amp; Lusignan, 1985). In additional, this paper also describes our experience in doing the English all-word task in SENSEVAL-2. Then, we will discuss the results in the SENSEVAL-2 evaluation. Apart from the description of current system, possibilities for future work are explored </abstract></header><body><section number="1" title="Primitive-Based Word Sense Disambiguation"><p>This system consists of three important components: machine-tractable dictionary, conceptual distance data and sense tagger that uses a simple summation algorithm.</p><subsection number="1.1" title="Machine-Tractable Dictionary"><p>The first one is Machine-Tractable Dictionary (MTD) such as WordNet and LDOCE (Longman Dictionary of Contemporary English) especially LDOCE has been used extensively in NLP research and provide a broad set of senses for sense tagging. MTD contains word senses and their definitions are defined in term of descriptive and tagged primitives (words attached with sense number). Primitives are a set of words derived from dictionary (Guo, 1989b) and it is used to define the definition of a word sense. (For further information about primitives, please refer to Wilks.Y (1977)). For example, father#l has a definition defined by using four primitives that are '<i>titlel\'respect2\ 'priest3' </i>and <i>'church^ </i>(refer figure 1).</p><p>For SENSEVAL-2 competition, the pre­release WordNetl.7 was used for this purpose. After WordNetl.7 was downloaded, the entries including their definition, sense number and sense id in WordNet was extracted and written into a temporary file. Primitives (not tagged) were derived from the words used in the word senses' definition. Then, the first 7 words of the definition text of the WordNet dictionary were disambiguated using the information from an existing MTD (LDOCE) and the derived primitives (Guo, 1998a). The existing MTD (LDOCE) contained word senses and the words in their definition are already tagged.</p><p>Thus, a new MTD (the pre-release WordNet 1.7) was ready for the usage of tagging process.</p></subsection><subsection number="1.2" title="Conceptual Distance Data"><p>Conceptual distance data is showing the relatedness between two tagged primitives.</p><p>Basically, the conceptual distance data is calculated by using content terms in the definition to determine the relatedness measure between two primitives layer by layer. The definitions of the primitives are getting from the existing MTD (LDOCE). It is important to note that a tagged primitive is also a word sense. For example, the first and second layer of referential definition for word sense <i>förecast2' </i>is:</p><p>forecast2 [def] predict 1 in2 advance3 predict 1 [def] makel a2 prediction3 about4; telll in2 advance3 1- referential layer: forecast2 predict 1 advance3 2- referential layer: predictl makel prediction3 telll (note:'advance3'   is omitted because it has been counted in the first layer)<page local="2" global="104"/></p><p>Formula used to compute the relatedness percentage:</p><doubt alpha="55.9" length="345" tooSmall="False" monospace="0.0">% for first layer of the first target word sense and first layer of the second target word sense: if q&lt;(nl+n2)/2 then pi = (q/((nl+n2)/2)*70% if q&gt;(nl+n2)/2 then pi = 70% % for other layers:xl=ql/((n3+n4)/2) x2 = q2/((nl+n4)/2) x3 = q3 / ((n2+n3)/2) p2=((xl+x2+x3)/3)*30% The total value = pl+p2nl= no. of the element in the first layer of first</doubt><p>target word sense n2 = no. of the element in the first layer of</p><p>second target word sense n3 = no. of the element in the second layer of</p><p>first target word sense n4 = no. of the element in the second layer of</p><p>second target word sense q, ql, q2, q3 = no. of common content terms</p><p>for each comparison pi, p2 = final value of the relatedness measure</p></subsection><subsection number="1.3" title="Sense Tagger"><p>The third one is sense tagger. Sense tagger will get the input from MTD and its conceptual distance data among primitives to do the word sense disambiguation. Currently, the tagger consists of three processes:</p><p>• Preprocess process.</p><p>• Dictionary look-up process</p><p>• Numerical calculation algorithm</p><p>In the preprocess process, test data, which is downloaded for the usage of SENSEVAL-2, is going through several processes before tagging process takes place. The first process is separating the given text into sentences using full stops as separator. After that, the words in the sentences that do not require tagging will be removed, leaving only the heads (words to be sense-tagged) behind. Then, each word in the sentences will be stemmed, leaving only morphological root. The list of heads is then cut into chunks of three successive heads to be tagged in seconds.</p><p>In dictionary look-up module, word senses with their definition for each of the words in a chunk is extracted from MTD.</p><p>After that, sense tagger will use numerical calculation algorithm to choose the suitable word sense for the words in the sentence. This algorithm is to compute the path value among the definition of the word senses in a sentence. This is done first, by summing up the semantic data from conceptual distance data when comparison among primitives in the definitions for the word sense pairs in the sentence. After that, the result of summation has to be multiplied with the distance value between the two words in the sentence. This distance value basically depends on total words in a sentence. For example, sentence "Father marry couple", the distance value for <i>'father' </i>and <i>'marry' </i>is 2 whereas the distance value for <i>'father </i>and <i>'couple' </i>is 1. This is because word <i>father' </i>is closer to the word <i>'marry' </i>than <i>'couple'</i>. Then this computation continues for the other of word sense pairs.</p><p>Finally, this algorithm will compare the path values for the combination of word senses in a sentence and find the highest path value. Then this algorithm assigns the best combination of senses to each word in the sentence.</p><p>For example, with reference to Figure 1, assume that words such as <i>'father', 'marry' </i>and <i>'couple' </i>have two senses only.</p><p>In the first step, definition of sense 1 from <i>'father' </i>will compare with definition of sense 1 from <i>'marry'.</i></p><p>father 1 (Note: xl, x2, ....xl2 are the values accessed from conceptual data. )</p><doubt alpha="100.0" length="5" tooSmall="False" monospace="0.0">value</doubt><p>In the second step, definition of sense 1 from <i>'father' </i>will compare with definition of sense 1 from <i>'couple'. </i>The total comparison is 4*4=16 and total value extracted from conceptual distance data is Y. Then in the third step, definition of sense 1 from <i>'couple' </i>will compare with definition of sense 1 from <i>'marry'. </i>The total comparison is 4*3=12 and total value extracted from conceptual distance data is Z. The calculations for second step and third are as same as the step.</p><table class="main" frame="box" rules="all" border="1" regular="False"><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>title 1</p></td><td class="cell"><p>takel</p></td><td class="cell"><p>xl</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p></p></td><td class="cell"><p>person2</p></td><td class="cell"><p>x2</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p></p></td><td class="cell"><p>marri age3</p></td><td class="cell"><p>x3</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>respect2</p></td><td class="cell"><p>takel</p></td><td class="cell"><p>x4</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p></p></td><td class="cell"><p>person2</p></td><td class="cell"><p>x5</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p></p></td><td class="cell"><p>marri age3</p></td><td class="cell"><p>x6</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>priest3</p></td><td class="cell"><p>takel</p></td><td class="cell"><p>x7</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p></p></td><td class="cell"><p>person2</p></td><td class="cell"><p>x8</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p></p></td><td class="cell"><p>marri age3</p></td><td class="cell"><p>x9</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>church4</p></td><td class="cell"><p>takel</p></td><td class="cell"><p>xlO</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p></p></td><td class="cell"><p>person2</p></td><td class="cell"><p>xll</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p></p></td><td class="cell"><p>marri age3</p></td><td class="cell"><p>xl2</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Total</p></td><td class="cell"><p>xl+x2+...xl2=X</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Total comparison</p></td><td class="cell"><p>12</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr></table><page local="3" global="105"/><doubt alpha="63.9" length="108" tooSmall="False" monospace="0.0">So, the path value for fatherl marry 1 couplel= 2(X/12) +Y/16 + 2(Z/12).Formula used to compute path value:n</doubt><p>Path value<b>=X</b>(distance)(s_/ / total comparison) i=l where n = the total of words sense pairs , s = the total summation of values getting from conceptual distance data for i-th of word sense pairs.</p><p>This   process   will   continue   for other combination of word senses: father 1 marry 1 couple2 fatherl marry 2 couplel fatherl marry 2 couple2 father2 marry 1 couplel father2 marry 1 couple2 father2 marry 2 couplel father2 marry2 couple2</p><p>The total combination of word sense for this example is 2*2*2=8. Finally, this algorithm will compare the path values for the combination of word senses in a sentence and find the most suitable combination of word senses. (Please refer to Figure 2)</p></subsection></section><section number="2" title="Result"><p>With reference to the above table, usml, usm2 and usm3 are three systems that are different in the number of primitives used in MTD as well as in the conceptual distance data and also MTD used. MTD used in usml is less comprehensive compare to MTD used in usm2 and usm3. More comprehensive is meaning that each of the entries is represented by a more complete set of primitives. MTD used in usm2 and usm3 is the same. Because of we are focusing more on speed of the system, overall of the results decreases when only the head words are considered.</p></section><section number="3" title="Future extension of the system"><p>In order to improve the existing algorithm, we need to avoid repeated calculation especially repeated comparison among the primitives. The concept of dynamic programming is needed to reduce the calculation. Basically, by using this method, result of the calculation is stored in memory so that the result can be accessed easily later when it is needed. As a result, although this method will increase the memory usage, it can also increase speed of the calculation significantly especially when a long sentence is processed. This is important because since the speed of the algorithm is increasing, it can be used in the real time application such information retrieval system especially in the Internet.</p><p>In additional, the accuracy of the system can be increased because more words in a sentence can be considered when a target word is tagged.</p><p>It is also important to note that this system not only can be used for English language, it can also be used in the other languages such Bahasa Malaysia, Chinese and Japanese.</p><p><b>Conclusion</b></p><p>In this paper, we have illustrated the overall architecture of our application of unsupervised learning technique to word sense disambiguation. Besides that, we have also presented that how our application in handling the given sentence and how we manage to complete the English all task given by SENSEVAL-2 competition. In additional, we illustrated the improvement over the algorithm we have presented in this paper. This is to make the algorithm becoming more efficient and practical to implement in real time application.</p><table caption="Table 1: SENSEVAL-2 English All Word Results(note:usm = Universiti Sains Malaysia)" class="main" frame="box" rules="all" border="1" regular="False"><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p></p></td><td class="cell"><p>Number</p></td><td class="cell"><p>Course</p></td><td class="cell"><p>Fine Grained</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>System</p></td><td class="cell"><p>of</p></td><td class="cell"><p>Grained</p></td><td class="cell"><p>Precision/</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p></p></td><td class="cell"><p>primitives</p></td><td class="cell"><p>Precision/</p></td><td class="cell"><p>Recall</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p></p></td><td class="cell"><p></p></td><td class="cell"><p><b>llllii</b></p></td><td class="cell"><p></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>usml</p></td><td class="cell"><p>492</p></td><td class="cell"><p>35.5%/ 34.7%</p></td><td class="cell"><p>34.5%/33.8%</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>usm2</p></td><td class="cell"><p>478</p></td><td class="cell"><p>37.0% / 37.0%</p></td><td class="cell"><p>36.0% / <i>36.0%</i></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>usm3</p></td><td class="cell"><p>4000</p></td><td class="cell"><p>34.4% / 34.4%</p></td><td class="cell"><p>33.6%/33.6%</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr></table><figure caption="Figure 2: Sense Tagger"></figure><table class="main" frame="box" rules="all" border="1" regular="False"><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Sense 1</p></td><td class="cell"><p>- takel person2</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p></p></td><td class="cell"><p>marri age3</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Sense 2</p></td><td class="cell"><p></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr></table></section><references><p>Guo, C-M (1989a) "Constructing a Machine-Tractable Dictionary from Longman Dictionary of Contemporary English.". Doctoral dissertation. New Mexico State University.</p><p>Guo, C-M (1989b) "Deriving a natural set of semantic primitives from Longman Dictionary of Contemporary English." Proceedings of the Second Irish Conference on Artificial Intelligence and Cognitive Science. 218-227</p><p>Wilks, Y. (1977) "Good and Bad Arguments About Semantic Primitives." In Communication and Cognition, Vol 10, No 3/4.</p><p>Y. Choueka and S.Lusigna. (1985). "Disambiguation by Short Contexts". Computer and the Humanities. 19:147-157.</p><page local="4" global="106"/><p>Father Definitions marry Definitions</p><p>Sense 1- title 1 respect2 priest3 church4 Sense 2- ....</p><p>couple Definitions</p><doubt alpha="100.0" length="6" tooSmall="False" monospace="0.0">Values</doubt><p>Sense 1- manl woman2 husband3 wife4 Sense 2 -.....</p><p>Figure 1 : Example for sense-pair comparison among the words in a sentence.</p><p>Input: A chunk of words output: A list of word senses (each correspond to an input word)</p><doubt alpha="35.7" length="14" tooSmall="False" monospace="0.0">a1 b2 c3....zN</doubt></references></body></article>