<?xml version="1.0"?><!DOCTYPE article SYSTEM "/project/take/software/searchbench_offline_processing/paperxml_generator/aclextractor/src/python/../resource/dtd/paperxml.dtd"><article><header><firstpageheader><page local="1" global="104"/><title>BART: A Multilingual Anaphora Resolution System</title><pubinfo>Proceedings of the 5th International Workshop on Semantic Evaluation, ACL 2010,pages 104-107, Uppsala, Sweden, 15-16 July 2010. ©2010 Association for Computational Linguistics</pubinfo><author surname="Broscheit" givenname="Samuel"><org  name="University of Tubingen" country="Germany" city="Tubingen"/></author><author surname="Poesio" givenname="Massimo"><org  name="University of Trento" country="Italy" city="Trento"/></author><author surname="Ponzetto" givenname="Simone Paolo"><org  name="University of Heidelberg" country="Germany" city="Heidelberg"/></author><author surname="Rodriguez" givenname="Kepa Joseba"><org  name="University of Tubingen" country="Germany" city="Tubingen"/></author><author surname="Romano" givenname="Lorenza"><org  name="Fondazione Bruno Kessler" country="Italy" city="Trento"/></author><author surname="Uryupina" givenname="Olga"><org  name="University of Tubingen" country="Germany" city="Tubingen"/></author><author surname="Versley" givenname="Yannick"><org  name="University of Tubingen" country="Germany" city="Tubingen"/></author><author surname="Zanoli" givenname="Roberto"><org  name="Fondazione Bruno Kessler" country="Italy" city="Trento"/></author></firstpageheader><frontmatter><p><b>BART: A Multilingual Anaphora Resolution System</b></p><p><b>Samuel Broscheit*, Massimo Poesio*, Simone Paolo Ponzetto*, Kepa Joseba Rodriguez*, Lorenza Romano*, Olga Uryupina*, Yannick Versley<footnote anchor="0"/>, Roberto Zanoli*</b></p><p>*Seminar für Computerlinguistik, University of Heidelberg ^CiMeC, University of Trento *Fondazione Bruno Kessler °SFB 833, University of Tübingen broscheit@cl.uni-heidelberg.de, massimo.poesio@unitn.it, ponzetto@cl.uni-heidelberg.de, kepa.rodriguez@unitn.it, romano@fbk.eu, uryupina@gmail.com, versley@sfs.uni -tuebingen.de,  zanoli@fbk.eu</p></frontmatter><abstract>BART (Versley et al., 2008) is a highly mod­ular toolkit for coreference resolution that supports state-of-the-art statistical approaches and enables efficient feature engineering. For the SemEval task 1 on Coreference Resolu­tion, BART runs have been submitted for Ger­man, English, and Italian. BART relies on a maximum entropy-based classifier for pairs of mentions. A novel entity-mention approach based on Semantic Trees is at the moment only supported for English. </abstract></header><body><section number="1" title="Introduction"><p>This paper presents a multilingual coreference reso­lution system based on BART (Versley et al., 2008). BART is a modular toolkit for coreference resolution that supports state-of-the-art statistical approaches to the task and enables efficient feature engineer­ing. BART has originally been created and tested for English, but its flexible modular architecture en­sures its portability to other languages and domains. In SemEval-2010 task 1 on Coreference Resolution, BART has shown reliable performance for English, German and Italian.</p><p>In our SemEval experiments, we mainly focus on extending BART to cover multiple languages. Given a corpus in a new language, one can re-train BART to obtain baseline results. Such a language-agnostic system, however, is only used as a starting point: substantial improvements can be achieved by incor­porating language-specific information with the help of the <i>Language Plugin. </i>This design provides ef­fective separation between linguistic and machine learning aspects of the problem.</p></section><section number="2" title="BART Architecture"><p>The BART toolkit has five main components: pre­processing pipeline, mention factory, feature extrac­tion module, decoder and encoder. In addition, an independent <i>LanguagePlugin </i>module handles all the language specific information and is accessible from any component. The architecture is shown on Figure 1. Each module can be accessed independently and thus adjusted to leverage the system's performance on a particular language or domain.</p><p>The preprocessing pipeline converts an input doc­ument into a set of lingustic layers, represented as separate XML files. The mention factory uses these layers to extract mentions and assign their basic properties (number, gender etc). The fea­ture extraction module describes pairs of mentions {Mi, <i>Mj}, i &lt; j </i>as a set of features.</p><p>The decoder generates training examples through a process of sample selection and learns a pairwise classifier. Finally, the encoder generates testing ex­amples through a (possibly distinct) process of sam­ple selection, runs the classifier and partitions the mentions into coreference chains.</p></section><section number="3" title="Language-specific issues"><p>Below we briefly describe our language-specific ex­tensions to BART. These issues are addressed in more details in our recent papers (Broscheit et al, 2010; Poesio et al, 2010).</p><subsection number="3.1" title="Mention Detection"><p>Robust mention detection is an essential component of any coreference resolution system. BART sup­ports different pipelines for mention detection. The<page local="2" global="105"/></p><doubt alpha="100.0" length="14" tooSmall="True" monospace="0.0">LanguagePlugin</doubt><doubt alpha="81.2" length="32" tooSmall="True" monospace="0.0">Mention (with basic properties):</doubt><doubt alpha="89.7" length="58" tooSmall="True" monospace="0.0">Basic features Syntactic features Knowledge-based features</doubt><p>Figure 1 : BART architecture choice of a pipeline depends crucially on the avail­ability of linguistic resources for a given language.</p><p>For English and German, we use the <i>Parsing Pipeline and Mention Factory </i>to extract mentions. The parse trees are used to identify minimal and maximal noun projections, as well as additional fea­tures such as number, gender, and semantic class.</p><p>For <b>English, </b>we use parses from a state-of-the-art constituent parser (Petrov et al, 2006) and extract all base noun phrases as mentions. For <b>German, </b>the SemEval dependency tree is transformed to a constituent representation and minimal and maxi­mal phrases are extracted for all nominal elements (pronouns, common nouns, names), except when the noun phrase is in a non-referring syntactic position (for example, expletive "es", predicates in copula constructions).</p><p>For <b>Italian, </b>we use the <i>EMD Pipeline and Men­tion Factory. </i>The Typhoon (Zanoli et al., 2009) and DEMention (Biggio et al, 2009) systems were used to recognize mentions in the test set. For each mention, its head and extension were considered. The extension was learned by using the mention an­notation provided in the training set (13th column) whereas the head annotation was learned by exploit­ing the information produced by MaltParser (Nivre et al., 2007). In addition to the features extracted from the training set, such as prefixes and suffixes (1-4 characters) and orthographic information (capi­talization and hyphenation), a number of features ex­tracted by using external resources were used: men­tions recognized by TextPro (http://textpro.fbk.eu), gazetteers of generic proper nouns extracted from the Italian phone-book and Wikipedia, and other fea­tures derived from WordNet. Each of these features was extracted in a local context of ±2 words. <b>3.2 Features</b></p><p>We view coreference resolution as a binary classifi­cation problem. Each classification instance consists of two markables, i.e. an anaphor and potential an­tecedent. Instances are modeled as feature vectors (cf. Table 1) and are handed over to a binary clas­sifier that decides, given the features, whether the anaphor and the candidate are coreferent or not. All the feature values are computed automatically, with­out any manual intervention.</p><p><b>Basic feature set. </b>We use the same set of rela­tively language-independent features as a backbone of our system, extending it with a few language-specific features for each subtask. Most of them are used by virtually all the state-of-the-art coreference resolution systems. A detailed description can be found, for example, in (Soon et al., 2001).</p><p><b>English. </b>Our English system is based on a novel model of coreference. The key concept of our model is a <i>Semantic Tree </i>- a filecard associated with each discourse entity containing the following fields:</p><p><b>• Types: </b>the list of types for mentions of a given entity. For example, if an entity contains the mention "software from India", the shallow predicate "software" is added to the types.</p><p><b>• Attributes: </b>this field collects the premodifiers. For instance, if one of the mentions is "the ex­pensive software" the shallow attribute "expen­sive" is added to the list of attributes.</p><p><b>• Relations: </b>this field collects the prepositional postmodifiers. If an entity contains the men­tion "software from India", the shallow relation "from(India)" is added to the list of relations.</p><table class="main" frame="box" rules="all" border="1" regular="False"><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p></p></td><td class="cell"><p>Parser</p></td><td class="cell"><p></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p><b>*</b></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p></p></td><td class="cell"><p>Dep-to-Const</p></td><td class="cell"><p></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p></p></td><td class="cell"><p>Converter</p></td><td class="cell"><p></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p><i>t</i></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p></p></td><td class="cell"><p>Morphology</p></td><td class="cell"><p></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Preprocessing</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr></table><table class="main" frame="box" rules="all" border="1" regular="False"><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p></p></td><td class="cell"><p></p></td><td class="cell"><p></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>MaxEnt Classifier</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr></table><page local="3" global="106"/><p>For each mention BART creates such a filecard using syntactic information. If the classifier decides that both mentions are corefering, the filecard of the anaphora is merged into the filecard of the an­tecedent (cf. Section 3.3 below).</p><p>The SemanticTreeCompatibility feature extractor checks whether individual slots of the anaphor's filecard are compatible with those of the antecedent's.</p><p>The StrudelRelatedness feature relies on Strudel - a distributional semantic model (Baroni et al., 2010). We compute Strudel vectors for the sets of types of the anaphor and the antecedent. The re-latedness value is determined as the cosine between the two.</p><p><b>German. </b>We have tested extra features for Ger­man in our previous study (Broscheit et al., 2010).</p><p>The NodeDistance feature measures the num­ber of clause nodes (simpx, r-simpx) and preposi­tional phrase nodes (px) along the path between <i>Mj </i>and <i>Mi</i><i> </i>in the parse tree.</p><p>The PartialMorphMatch feature is a sub­string match with a morphological extension for common nouns. In German the frequent use of noun composition makes a simple string match for common nouns unfeasible. The feature checks for a match between the noun stems of <i>Mi</i><i> </i>and <i>Mj. </i>We extract the morphology with SMOR/Morphisto (Schmid et al, 2004).</p><p>The GermanetRelatedness feature uses the Pathfinder library for GermaNet (Finthammer and Cramer, 2008) that computes and discretizes raw scores into three categories of semantic relatedness. In our experiments we use the measure from Wu and Palmer (1994), which has been found to be the best performing on our development data.</p><p><b>Italian. </b>We have designed a feature to cover Ital­ian aliasing patterns. A list of company/person des­ignators (e.g., "S.p.a" or "D.ssa") has been manually crafted. We have collected patterns of name variants for locations. Finally, we have relaxed abbreviation constraints, allowing for lower-case characters in the abbreviations. Our pilot experiments suggest that, although a universal aliasing algorithm is able to re­solve some coreference links between NEs, creating a language-specific module boosts the system's per­formance for Italian substantially.</p><p>Basic feature set MentionType(Mj ),MentionType(Mj ) SemanticClass(Mj), SemanticClass(Mj) GenderAgreement(Mi, <i>Mj ) </i>NumberAgreement(Mj <i>,Mj) </i>AnimacyAgreement(Mj <i>,Mj) </i>StringMateh(Mi,MJ-) <u>Distance^,</u><u>Mj)</u>_</p><p>Basic features used for English and Italian Alias(Mi,Mi) Apposition(Mi,M7) FirstMention(Mj)</p><doubt alpha="100.0" length="7" tooSmall="False" monospace="0.0">English</doubt><p>IsSubject(Mi)</p><p>SemanticTreeCompatibility(Mi,M7) StrudelRelatedness(Mj <i>,Mj) </i>German</p><p>InQuotedSpeech(Mj ), InQuotedSpeech(Mj ) NodeDistance(Mj <i>,Mj) </i>PartialMorphMatch(Mi <i>,Mj) </i>GermanetRelatedness(Mj <i>,Mj)</i></p><p>Italian AliasItalian(Mi,Mi)</p><p>Table 1 : Features used by BART: each feature describes a pair of mentions {Mj, <i>Mj}, i &lt; j, </i>where Mj is a can­didate antecedent and <i>Mj </i>is a candidate anaphor</p></subsection><subsection number="3.3" title="Resolution Algorithm"><p>The BART toolkit supports several models of coref­erence (pairwise modeling, rankers, semantic trees), as well as different machine learning algorithms. Our final setting relies on a pairwise maximum en­tropy classifier for Italian and German.</p><p>Our English system is based on an entity-mention model of coreference. The key concept of our model is a Semantic Tree - a filecard associated to each dis­course entity (cf. Section 3.2). Semantic trees are used for both computing feature values and guiding the resolution process.</p><p>We start by creating a Semantic Tree for each mention. We process the document from left to right, trying to find an antecedent for each men­tion (candidate anaphor). When the antecedent is found, we extend its Semantic Tree with the types, attributes and relations of the anaphor, provided they are mutually compatible.   Consider, for example, a list of mentions, containing, among oth­ers, "software from India", "the software" and "soft­ware from China".<page local="4" global="107"/> Initially, BART creates the fol­lowing semantic trees: "(type: software) (relation: from(India))", "(type: software)" and "(type: soft­ware) (relation: from(China))" When the second mention gets resolved to the first one, their seman­tic trees are merged to "(type: software) (relation: from(India)". Therefore, when we attempt to resolve the third mention, both candidate antecedents are re­jected, as their relation attributes are incompatible with "from(China)" This approach helps us avoid erroneous links (such as the link between the second and the third mentions in our example) by leveraging entity-level information.</p></subsection></section><section number="4" title="Evaluation"><p>The system was evaluated on the SemEval task 1 corpus by using the SemEval scorer.</p><p>First, we have evaluated our mention detection modules: the system's ability to recognize both the mention extensions and the heads in the <i>regular </i>set­ting. BART has achieved the best score for men­tion detection in German and has shown reliable figures for English. For Italian, the moderate per­formance level is due to the different algorithms for identifying the heads: the MaltParser (trained on TUT: http://www.di.unito.it/tutreeb) produces a more semantic representation, while the SemEval scorer seems to adopt a more syntactic approach.</p><p>Second, we have evaluated the quality of our coreference resolution modules. For German, BART has shown better performance than all the other sys­tems on the <i>regular </i>track.</p><p>For English, the only language targeted by all sys­tems, BART shows good performance over all met­rics in the <i>regular </i>setting, usually only outperformed by systems that were tuned to a particular metric.</p><p>Finally, the Italian version of BART shows re­liable figures for coreference resolution, given the mention alignment problem discussed above.</p></section><section number="5" title="Conclusion"><p>We have presented BART - a multilingual toolkit for coreference resolution. Due to its highly modu­lar architecture, BART allows for efficient language-specific feature engineering.  Our effort represents the first steps towards building a freely available coreference resolution system for many languages.</p></section><references><p>Marco Baroni, Brian Murphy, Eduard Barbu, and Mas­simo Poesio. 2010. Strudel: A corpus-based semantic model based on properties and types. <i>Cognitive Sci­ence, </i>34(2):222-254.</p><p>Silvana Marianela Bernaola Biggio, Claudio Giuliano, Massimo Poesio, Yannick Versley, Olga Uryupina, and Roberto Zanoli. 2009. Local entity detection and recognition task. In <i>Proc. of Evalita-09.</i></p><p>Samuel Broscheit, Simone Paolo Ponzetto, Yannick Ver-sley, and Massimo Poesio. 2010. Extending BART to provide a coreference resolution system for German. In <i>Proc. ofLREC '10.</i></p><p>Marc Finthammer and Irene Cramer. 2008. Explor­ing and navigating: Tools for GermaNet. In <i>Proc. of LREC '08.</i></p><p>Joakim Nivre, Johan Hall, Jens Nilsson, Atanas Chanev, Gulsen Eryigit, Sandra Kubler, Svetoslav Marinov, and Erwin Marsi. 2007. Maltparser: A language-independent system for data-driven dependency pars­ing. <i>Natural Language Engineering, </i>13(2):95-135.</p><p>Slav Petrov, Leon Barett, Romain Thibaux, and Dan Klein. 2006. Learning accurate, compact, and inter­pretable tree annotation. In <i>Proc. of COLING-ACL-06.</i></p><p>Massimo Poesio, Olga Uryupina, and Yannick Versley. 2010.  Creating a coreference resolution system for</p><p>Italian. In <i>Proc. ofLREC '10.</i></p><p>Helmut Schmid, Arne Fitschen, and Ulrich Heid. 2004. SMOR: A German computational morphology cover­ing derivation, composition and inflection. In <i>Proc. of LREC '04.</i></p><p>Wee Meng Soon, Hwee Tou Ng, and Daniel Chung Yong Lim. 2001. A machine learning approach to corefer-ence resolution of noun phrases. <i>Computational Lin­guistics (Special Issue on Computational Anaphora Resolution), </i>27(4):521-544.</p><p>Yannick Versley, Simone Paolo Ponzetto, Massimo Poe-sio, Vladimir Eidelman, Alan Jern, Jason Smith, Xiaofeng Yang, and Alessandro Moschitti. 2008. BART: A modular toolkit for coreference resolution. In <i>Proceedings of the Linguistic Coreference Work­shop at the International Conference on Language Re­sources and Evaluation (LREC-2008)</i>.</p><p>Zhibiao Wu and Martha Palmer. 1994. Verb semantics and lexical selection. In <i>Proc. ofACL-94, </i>pages 133­138.</p><p>Roberto Zanoli, Emiliano Pianta, and Claudio Giuliano. 2009. Named entity recognition through redundancy driven classifier. In <i>Proc. of Evalita-09.</i></p></references></body></article>