<?xml version="1.0"?><!DOCTYPE article SYSTEM "/project/take/software/searchbench_offline_processing/paperxml_generator/aclextractor/src/python/../resource/dtd/paperxml.dtd"><article><header><firstpageheader><page local="1" global="338"/><title>UA-ZSA: Web Page Clustering on the basis of Name Disambiguation</title><pubinfo>Proceedings of the 4th International Workshop on Semantic Evaluations (SemEval-2007),pages 338-341, Prague, June 2007. ©2007 Association for Computational Linguistics</pubinfo><author surname="Kozareva" givenname="Zornitsa"><org  name="University of Alicante" country="Spain" city="Alicante"/></author><author surname="Vazquez" givenname="Sonia"><org  name="University of Alicante" country="Spain" city="Alicante"/></author><author surname="Montoyo" givenname="Andres"><org  name="University of Alicante" country="Spain" city="Alicante"/></author></firstpageheader><frontmatter><p><b>UA-ZSA: Web Page Clustering on the basis of Name Disambiguation</b></p><p><b>Zornitsa Kozareva, Sonia Vazquez, Andres Montoyo</b></p><p>DLSI, University of Alicante Carretera de San Vicente S/N Alicante, Spain 03080</p><p>zkozareva,svazquez,montoyo@dlsi.ua.es</p></frontmatter><abstract>This paper presents an approach for web page clustering. The different underlying meanings of a name are discovered on the basis of the title of the web page, the body content, the common named entities across the documents and the sub-links. This in­formation is feeded into a K-Means cluster­ing algorithm which groups together the web pages that refer to the same individual. </abstract></header><body><section number="1" title="Introduction"><p>Ambiguity is the task of building up multiple alter­native linguistic structures for a single input. Most of the approaches focus on word sense disambigua­tion (WSD), where the sense of a word has to be determined depending on the context in which it is used.</p><p>The same problem arises for named entities shared by different people or for grandsons named after their grandparents. For instance, querying the name "Michael Hammond" in the World Wide Web where there are huge quantities of massive and un­structured data, a search engine retrieves thousands of documents related to this name. However, there are several individuals sharing the name "Michael Hammon". One is a biology professor at the Univer­sity of Arizona, another is at the University of War­wick, there is a mathematician from Toronto among others. The question is which one of these refer­ents we are actually looking for and interested in. Presently, to be able to answer to this question, we have to skim the content of the documents and re­trieve the correct answers on our own.</p><p>To automate this process, the named entities can be disambiguated and the different underlying meanings of the name can be found. On the basis of this information, the web pages can be clustered together and organized in a hierarchical structure which can ease the documents' browsing. This is also the objective of the Web People Search (WePS) task (Artiles et al., 2007). What makes the WePS task even more challenging is the fact that in con­trast to WSD where the number of senses of a word are predefined, in WePS we do not know the exact number of different individuals.</p><p>For the resolution of the WePS task, we have de­veloped a web page clustering approach using the title and the body content of the web pages. In ad­dition, we group together the documents that share many location, person and organization names, as well as those that point out to the same sub-links.</p><p>The rest of the paper is organized as follows. In Section 2 we describe various approaches for name disambiguation and discrimination. Our approach is shown in Section 3, the obtained results and a dis­cussion are provided in Section 4 and finally we con­clude in Section 5.</p></section><section number="2" title="Related Work"><p>Early work in the field of name disambiguation is that of (Bagga and Baldwin, 1998) who pro­posed cross-document coreference resolution algo­rithm which uses vector space model to resolve the ambiguities between people sharing the same name. The approach is evaluated on 35 different mentions of John Smith and reaches 85% f-score.</p><p>Mann and Yarowski (2003) developed an unsupervised approach to name discrimination where bi­ographical features (age, date of birth), familiar re­lationships (wife, son, daughter) and associations (country, company, organization) are considered.<page local="2" global="339"/> Therefore, in our approach we use person, organiza­tion and location names in order to construct a social similarity network between two documents.</p><figure caption="Figure 1: Architecture of the WePS System"></figure><p>Another unsupervised clustering technique for name discrimination of web pages is that of Peder-sen and Kulkarni (2007). They used contextual vec­tors derived from bigrams, and measured the impact of several association measures. During the evalu­ation, some names were easily discriminable com­pared to others categories for which was even diffi­cult to find and obtain discriminative feature. We worked with their unigram model (Purandare and Pedersen, 2004) to cluster the web pages using the text content between the title tags.</p></section><section number="3" title="Web Person Disambiguation"><p>Our web people clustering approach is presented in Figure 1 and consists of the following steps:</p><p>• HTML cleaning:  all <i>html </i>tags are stripped</p><p>away, the <i>javascript </i>code is eliminated, the non closed WePS tags are repaired, the missing be­gin/end body tags are included and then the content between the title, the body and the an­chor tags is extracted.</p><p>• name matching: the location, person and orga­nization names in the body texts are identified with the GATE<footnote anchor="1"/> system (Cunningham, 2005). Each named entity of a document is matched with its corresponding named entity category from the rest of the web pages. This infor­mation is used to calculate the social semantic similarity of the person, the location and the or­ganization names. Our hypothesis is that doc­uments with similar names tend to refer to the same individual. The output of this module is a matrix with binary values, where 1 stands for the documents which share more than the half of their proper names, and 0 otherwise.</p><p>• links: for each document, we extract the links situated between the anchor tags. Since the links are too specific, we wrote an url function which transform a given web page <i>d1</i><i> </i>with URL http://www.cs.ualberta.ca/~lindek/index.htm into www.cs.ualberta.ca/~lindek, and the web page <i>d2</i><i> </i>with URL http://www.cs.ualberta.ca/~ lindek/demos.htm into www.cs.ualberta.ca/~lindek. According to our approach, the two web pages d<b>i </b>and <i>d2</i><i></i>are linked to each other if their link structures (LS) intersect, that is LS(d1) <i>f </i>LS(d2) = 0. The output of this module is a matrix with binary values, where 1 stands for two web pages having more than 3 links in common and 0 otherwise.</p><p>• titles: for each document, we extract the text between the title tags. We create a unigram matrix which is feed into SenseClusters<footnote anchor="2"/>. We use automatic cluster stopping criteria with the gap statistics which groups the web pages into several clusters according to the context of the titles. From the obtained clusters, we generate a new matrix with binary values, where 1 corre­sponds to the documents which were put in the</p><footnote label="1"> http://sourceforge.net/projects/gate  2 http://marimba.d.umn.edu/cgi-bin/SC-cgi/index.cgi</footnote><page local="3" global="340"/><p>same cluster according to SenseClusters and 0 otherwise.</p><p><i>• </i>bodies: the text between the body tags is ex­tracted, tokenized and the part-of-speech (POS) tags <footnote anchor="3"/> are determined. The original text is trans­formed by encoding the POS tag information as follows: <i>"water#v the#det flowers#n and#conj pass#v me#pron the#det glass#n of#prep wa-ter#n". </i>This corpus transformation is done, be­cause we want the Latent Semantic Analysis (LSA) module to consider the syntactic cate­gories of the words and to construct a more reliable semantic space. For instance, in the example above, there are two different repre­sentations of <i>water: </i>the noun and the verb, while without the corpus transformation LSA sees only the string <i>water.</i></p><p><i>• </i>LSA<footnote anchor="4"/>: the semantic similarity score for the web-pages is calculated with Latent Semantic Analysis (LSA). From the encoded body texts, we build up a matrix, where the rows repre­sent the words of the web-page collection, the columns stand for the web-pages we want to cluster and the cells show the number oftimes a word of the corpus occurs in a web page. In or­der to reduce the noise and the data sparsity, we apply the Singular Value Decomposition algo­rithm by reducing the original vector space into 300 dimensions. The output of the LSA mod­ule is a matrix, which represents the semantic similarity among the web pages.</p><p><i>• </i>knowledge combination: the outputs of the name matching, link, title and body modules are combined into a new matrix 100 <i>x </i>400 di­mensional matrix. The rows correspond to the number of web pages and the columns repre­sent the obtained values of the link, title, body and name modules. This matrix is fed into the K-means clustering algorithm which deter­mines the final web page clustering.</p><p><i>• </i>K-means<footnote anchor="5"/>: the clustering of <i>N </i>web pages into <i>K</i><i> </i>disjoint subsets <i>Sj</i><i> </i>containing <i>Nj</i><i> </i>data</p><footnote label="3">http://www.ims.uni-stuttgart.de/projekte/corplex/TreeTagger/</footnote><footnote label="4">infomap-nlp.sourceforge.net/</footnote><footnote label="5"> http://www.cs.waikato.ac.nz/ml/weka/</footnote><p>points is done by the minimization of the sum-of-squares criterion <i>J = f</i><i>=1Y,</i><i>nesj \xn — muj </i>\<footnote anchor="2"/>, where <i>xn </i>is a vector representing the nth data point and <i>muj </i>is the geometric cen-troid of the data points in <i>Sj.</i><i> </i>The informa­tion matrix from which the web page cluster­ing is performed includes the similarity infor­mation for the title, link, proper name and body. The current implementation of K-means (Wit­ten and Frank, 2005) does not have an au­tomatic cluster stopping criteria, therefore the number of clusters is set up manually.</p></section><section number="4" title="Results and Discussion"><p>Table 1 shows the obtained results for the test data set. The average performance of our system is 56% and we ranked on 10-th position from 16 participat­ing teams. Although, we have used different sources of information and various approximations, in the future we have to surmount a number of obstacles.</p><p>One of the limitations comes from the usage of the text snippets situated between the body tags. There are a number of web pages which do not contain any text. The semantic space for these documents cannot be built with LSA and their similarity score is zero.</p><p>Despite the fact that we have eliminated the stop words from the documents and we have transformed the web pages by encoding the syntactic categories, the classification power of LSA was different for the ambiguous names and for the web pages. To some extend this is due to the varying number of words in the web pages. In the future, we want to con­duct experiments with a fixed context windows for all documents.</p><p>In this task, the number of senses (e.g. number of different individuals that share the same name) is unknown, and one of the major drawbacks in our approach is related to the setting up of the number of clusters. The K-Means clustering algorithm we used, did not include an automatic cluster stopping criteria, and we had to set up the number of clus­ters manually. To be able to do that, we have ob­served the average number of clusters per name in the trial data. We have evaluated the performance of our approach with several different numbers of clusters. According to the obtained results, the best clusters are 25 and 50. We used the same number of clusters for the test data, however this is a rough parameter estimation.<page local="4" global="341"/></p></section><section number="5" title="Conclusion"><p>Person name disambiguation is a very importanttask whose resolution can improve the performance of the search engine by grouping together web pages which refer to different individuals that share the same name.</p><p>For our participation in the WePS task, we pre­sented a name disambiguation approach which uses only the information extracted from the web pages. We conducted an experimental study with the trail data set, according to which the combination of the title, the body, the proper names and sub-links reaches the best performance. Our current approach can be improved with the incorporation ofautomatic cluster stopping criteria.</p><p>So far we did not take advantage of the document ranking and the returned snippets, but we want to incorporate this information by measuring the snippet similarity on the basis of relevant domain informa­tion (Kozareva et al., 2007).</p></section><section title="Acknowledgements"><p>Many thanks to Ted Pedersen for useful comments and suggestions. This work was partially funded by the European Union under the project QALLME number FP6 IST-033860 and by the Spanish Min­istry of Science and Technology under the project TEX-MESS number TIN2006-15265-C06-01.</p><table caption="Table 1: Evaluation results" class="main" frame="box" rules="all" border="1" regular="False"><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p><b>Name</b></p></td><td class="cell"><p><b>Purity</b></p></td><td class="cell"><p><b>Inverse Purity</b></p></td><td class="cell"><p><b>F</b></p><p><b>a=0.5</b></p></td><td class="cell"><p><b>F</b></p><p>q<b>=0.2</b></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p><b>Mark Johnson</b></p></td><td class="cell"><p>0,55</p></td><td class="cell"><p>0,74</p></td><td class="cell"><p>0,63</p></td><td class="cell"><p>0,69</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p><b>Sharon Goldwater</b></p></td><td class="cell"><p>0,96</p></td><td class="cell"><p>0,23</p></td><td class="cell"><p>0,37</p></td><td class="cell"><p>0,27</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p><b>Robert Moore</b></p></td><td class="cell"><p>0,36</p></td><td class="cell"><p>0,67</p></td><td class="cell"><p>0,47</p></td><td class="cell"><p>0,57</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p><b>Leon Barrett</b></p></td><td class="cell"><p>0,62</p></td><td class="cell"><p>0,51</p></td><td class="cell"><p>0,56</p></td><td class="cell"><p>0,52</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p><b>Dekang Lin</b></p></td><td class="cell"><p>0,99</p></td><td class="cell"><p>0,43</p></td><td class="cell"><p>0,60</p></td><td class="cell"><p>0,49</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p><b>Stephen Clark</b></p></td><td class="cell"><p>0,52</p></td><td class="cell"><p>0,75</p></td><td class="cell"><p>0,62</p></td><td class="cell"><p>0,69</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p><b>Frank Keller</b></p></td><td class="cell"><p>0,38</p></td><td class="cell"><p>0,67</p></td><td class="cell"><p>0,48</p></td><td class="cell"><p>0,58</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p><b>Jerry Hobbs</b></p></td><td class="cell"><p>0,54</p></td><td class="cell"><p>0,63</p></td><td class="cell"><p>0,58</p></td><td class="cell"><p>0,61</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p><b>James Curran</b></p></td><td class="cell"><p>0,53</p></td><td class="cell"><p>0,61</p></td><td class="cell"><p>0,57</p></td><td class="cell"><p>0,59</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p><b>Chris Brockett</b></p></td><td class="cell"><p>0,73</p></td><td class="cell"><p>0,40</p></td><td class="cell"><p>0,51</p></td><td class="cell"><p>0,44</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p><b>Thomas Fraser</b></p></td><td class="cell"><p>0,66</p></td><td class="cell"><p>0,57</p></td><td class="cell"><p>0,61</p></td><td class="cell"><p>0,58</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p><b>John Nelson</b></p></td><td class="cell"><p>0,68</p></td><td class="cell"><p>0,76</p></td><td class="cell"><p>0,72</p></td><td class="cell"><p>0,74</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p><b>James Hamilton</b></p></td><td class="cell"><p>0,56</p></td><td class="cell"><p>0,60</p></td><td class="cell"><p>0,58</p></td><td class="cell"><p>0,59</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p><b>William Dickson</b></p></td><td class="cell"><p>0,59</p></td><td class="cell"><p>0,78</p></td><td class="cell"><p>0,67</p></td><td class="cell"><p>0,73</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p><b>James Morehead</b></p></td><td class="cell"><p>0,36</p></td><td class="cell"><p>0,64</p></td><td class="cell"><p>0,46</p></td><td class="cell"><p>0,56</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p><b>Patrick Killen</b></p></td><td class="cell"><p>0,56</p></td><td class="cell"><p>0,69</p></td><td class="cell"><p>0,62</p></td><td class="cell"><p>0,66</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p><b>George Foster</b></p></td><td class="cell"><p>0,46</p></td><td class="cell"><p>0,70</p></td><td class="cell"><p>0,56</p></td><td class="cell"><p>0,64</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p><b>James Davidson</b></p></td><td class="cell"><p>0,58</p></td><td class="cell"><p>0,71</p></td><td class="cell"><p>0,64</p></td><td class="cell"><p>0,68</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p><b>Arthur Morgan</b></p></td><td class="cell"><p>0,77</p></td><td class="cell"><p>0,47</p></td><td class="cell"><p>0,59</p></td><td class="cell"><p>0,51</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p><b>Thomas Kirk</b></p></td><td class="cell"><p>0,26</p></td><td class="cell"><p>0,90</p></td><td class="cell"><p>0,41</p></td><td class="cell"><p>0,60</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p><b>Patrick Killen</b></p></td><td class="cell"><p>0,56</p></td><td class="cell"><p>0,69</p></td><td class="cell"><p>0,62</p></td><td class="cell"><p>0,66</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p><b>Harry Hughes</b></p></td><td class="cell"><p>0,66</p></td><td class="cell"><p>0,54</p></td><td class="cell"><p>0,59</p></td><td class="cell"><p>0,56</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p><b>Jude Brown</b></p></td><td class="cell"><p>0,64</p></td><td class="cell"><p>0,63</p></td><td class="cell"><p>0,64</p></td><td class="cell"><p>0,63</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p><b>Stephan Johnson</b></p></td><td class="cell"><p>0,56</p></td><td class="cell"><p>0,80</p></td><td class="cell"><p>0,66</p></td><td class="cell"><p>0,73</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p><b>Marcy Jackson</b></p></td><td class="cell"><p>0,40</p></td><td class="cell"><p>0,73</p></td><td class="cell"><p>0,52</p></td><td class="cell"><p>0,63</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p><b>Karen Peterson</b></p></td><td class="cell"><p>0,56</p></td><td class="cell"><p>0,72</p></td><td class="cell"><p>0,63</p></td><td class="cell"><p>0,68</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p><b>Neil Clark</b></p></td><td class="cell"><p>0,68</p></td><td class="cell"><p>0,36</p></td><td class="cell"><p>0,47</p></td><td class="cell"><p>0,40</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p><b>Jonathan Brooks</b></p></td><td class="cell"><p>0,53</p></td><td class="cell"><p>0,76</p></td><td class="cell"><p>0,63</p></td><td class="cell"><p>0,70</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p><b>Violet Howard</b></p></td><td class="cell"><p>0,58</p></td><td class="cell"><p>0,75</p></td><td class="cell"><p>0,65</p></td><td class="cell"><p>0,71</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p><b>Global average</b></p></td><td class="cell"><p>0,58</p></td><td class="cell"><p>0,64</p></td><td class="cell"><p>0,58</p></td><td class="cell"><p>0,60</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr></table></section><references><p>J. Artiles, J. Gonzalo, and S. Sekine. 2007. The semeval-2007 weps evaluation: Establishing a benchmark for the web people search task. In <i>Proceedings ofSemeval 2007, Association for Computational Linguistics.</i></p><p>A. Bagga and B. Baldwin. 1998. Entity-based cross-document coreferencing using the vector space model. In <i>Proceedings of ACL, </i>pages 79-85.</p><p>H. Cunningham. 2005. Information Extraction, Auto­matic. <i>Encyclopedia ofLanguage andLinguistics, 2nd Edition.</i></p><p>Z. Kozareva, S. Vazquez, and A. Montoyo. 2007. The usefulness of conceptual representation for the iden­tification of semantic variability expressions. In <i>Pro­ceedings </i><i>ofthe</i><i> Eighth International Conference on In­telligent Text Processing and Computational Linguis­tics, (CICLing-2007).</i></p><p>G. Mann and D. Yarowsky. 2003. Unsupervised per­sonal name disambiguation. In <i>Proceedings </i><i>ofthe</i><i> sev­enth conference on Natural language learning atHLT-NAACL 2003, </i>pages 33-40.</p><p>T. Pedersen and A. Kulkarni. 2007. Discovering identi­ties in web contexts with unsupervised clustering. In <i>Proceedings ofthe IJCAI-2007 Workshopon Analytics for Noisy Unstructured Text Data.</i><i></i></p><p>A. Purandare and T. Pedersen. 2004. Senseclusters -finding clusters that represent word senses. In <i>AAAI,</i> pages 1030-1031.</p><p>I. Witten and E. Frank. 2005. <i>Data Mining: Practi­cal machine learning tools and techniques, </i>volume 2. Morgan Kaufmann.</p></references></body></article>