<?xml version="1.0"?><!DOCTYPE article SYSTEM "/project/take/software/searchbench_offline_processing/paperxml_generator/aclextractor/src/python/../resource/dtd/paperxml.dtd"><article><header><firstpageheader><page local="1" global="488"/><title>XRCE-M: A Hybrid System for Named Entity Metonymy Resolution</title><pubinfo>Proceedings of the 4th International Workshop on Semantic Evaluations (SemEval-2007),pages 488-491, Prague, June 2007. ©2007 Association for Computational Linguistics</pubinfo><author surname="Maud" givenname="Ehrmann"><org  name="Xerox Research Centre Europe" country="France" city="Grenoble"/></author><author surname="Caroline" givenname="Brun"><org  name="Xerox Research Centre Europe" country="France" city="Grenoble"/></author><author surname="Guillaume" givenname="Jacquet"><org  name="Xerox Research Centre Europe" country="France" city="Grenoble"/></author></firstpageheader><frontmatter><p><b>XRCE-M: A Hybrid System for Named Entity Metonymy Resolution</b></p><p><b>*Caroline Brun *Maud Ehrmann *Guillaume Jacquet</b></p><p>* Xerox Research Centre Europe 6, chemin de Maupertuis 38240 Meylan France</p><p>*{Caroline.Brun,  Maud.Ehrmann, Guillaume.Jacquet}@xrce.xerox.com</p></frontmatter><abstract>This paper describes our participation to the Metonymy resolution at SemEval 2007 (task #8). In order to perform named entity me­tonymy resolution, we developed a hybrid system based on a robust parser that extracts deep syntactic relations combined with a non-supervised distributional approach, also relying on the relations extracted by the parser. </abstract></header><body><section number="1" title="Description of our System"><p>SemEval 2007 introduces a task aiming at resolving metonymy for named entities, for location and or­ganization names (Markert and Nissim 2007). Our system addresses this task by combining a symbolic approach based on robust deep parsing and lexical semantic information, with a distributional method using syntactic context similarities calculated on large corpora. Our system is completely unsuper-vised, as opposed to state-of-the-art systems (see (Market and Nissim, 2005)).</p><subsection number="1.1" title="Robust and Deep Parsing Using XIP"><p>We use the Xerox Incremental Parser (XIP, (Aït et al., 2002)) to perform robust and deep syntactic analysis. Deep syntactic analysis consists here in the construction of a set of syntactic relations<footnote anchor="1"/> from an input text. These relations, labeled with deep syn­tactic functions, link lexical units of the input text and/or more complex syntactic domains that are constructed during the processing (mainly chunks, see (Abney, 1991)).</p><footnote label="1">inspired from dependency grammars, see (Mel'cuk, 1998), and (Tesnière, 1959).</footnote><p>Moreover, together with surface syntactic relations, the parser calculates more sophisticated relations using derivational morphologic properties, deep syntactic properties<footnote anchor="2"/>, and some limited lexical se­mantic coding (Levin's verb class alternations, see (Levin, 1993)), and some elements of the Framenet<footnote anchor="3"/>classification, (Ruppenhofer et al., 2006)). These deep syntactic relations correspond roughly to the agent-experiencer roles that is subsumed by the SUBJ-N relation and to the patient-theme role sub­sumed by the OBJ-N relation, see (Brun and Ha-gège, 2003). Not only verbs bear these relations but also deverbal nouns with their corresponding argu­ments.</p><p>Here is an example of an output (chunks and deep syntactic relations):</p><p><i>Lebanon still wanted to see the implementation of a UN resolution</i> <i>TOP{SC{NP{Lebanon} FV{still wanted}} IV{to see} NP{the implementation} PP{of NP{a UN resolution}} .</i><i>}</i></p><p>MOD_PRE(wanted,still)</p><p>MOD_PRE(resolution,UN)</p><p>MOD_POST(implementation,resolution)</p><p>COUNTRY(Lebanon)</p><p>ORGANISATION(UN)</p><p>EXPERIENCER_PRE(wanted,Lebanon)</p><p>EXPERIENCER(see,Lebanon)</p><p>CONTENT(see,implementation)</p><p>EMBED_INFINIT(see,wanted)</p><p>OBJ-N(implement,resolution)</p></subsection><subsection number="1.2" title="Adaptation to the Task"><p>Our parser includes a module for "standard" named entity recognition, but needs to be adapted to handle named entity metonymy. Following the guidelines of the SemEval task #8, we performed a corpus study on the trial data in order to detect lexi­cal and syntactic regularities triggering a metonymy, for both location names and organization names.<page local="2" global="489"/> For example, we examined the subject relation be­tween organizations or locations and verbs and we then classify the verbs accordingly: we draw hy­pothesis like "if a location name is the subject of a verb referring to an economic action, like <i>import, provide, refund, repay, </i>etc., then it is a place-for-people". We adapted our parser by adding dedicated lexicons that encode the information collected from the corpus and develop rules modifying the interpre­tation of the entity, for example:</p><footnote label="2">Subject and object of infinitives in the context of con­trol verbs.</footnote><footnote label="3">http ://framenet.icsi.berkeley.edu/</footnote><doubt alpha="52.3" length="65" tooSmall="False" monospace="0.0">If (LOCATION(#1) &amp; SUBJ-N(#2[v_econ],#1))4-» PLACE-FOR-PEOPLE(#1)</doubt><p>We focus our study on relations like subject, object, experiencer, content, modifiers (nominal and prepo­sitional) and attributes. We also capitalize on the already-encoded lexical information attached to verbs by the parser, like communication verbs like <i>say, deny, comment, </i>or categories of the FrameNet Experiencer subject frame, i.e. verbs like <i>feel, sense, se</i>e. This information was very useful since experi-encers denote persons, therefore all organizations or locations having an experiencer role can be consid­ered as organization-for-members or place-for-people. Here is an example of output<footnote anchor="5"/>, when apply­ing the modified parser on the following sentence: <i>"It was the largest <b>Fiat </b>everyone had ever seen".</i></p><p><b>ORG-FOR-PRODUCT(Fiat)</b></p><p>MOD_PRE(seen,ever)</p><p>SUBJ-N_PRE(was,It)</p><p>EXPERIENCER_PRE(seen,everyone)</p><p>SUBJATTR(It,Fiat) <b>QUALIF(Fiat,largest)</b></p><p>Here, the relation QUALIF(Fiat, largest) triggers the metonymical interpretation of "Fiat" as org-for-product.</p><p>This first development step is the starting point of our methodology, which is completed by a non-supervised distributional approach described in the next section.</p><footnote label="4">Which read as "if the parser has detected a location name (#1), which is the subject of a verb (#2) bearing the feature "v-econ", then create a PLACE-FOR-PEOPLE unary predicate on #1.</footnote><footnote label="5">Only dependencies are shown.</footnote></subsection><subsection number="1.3" title="Hybridizing with a Distributional Approach"><p>The distributional approach proposes to establish a distance between words depending on there syntac­tic distribution.</p><p>The distributional hypothesis is that words that ap­pear in similar contexts are semantically similar (Harris, 1951): the more two words have the same distribution, i.e. are found in the same syntactic con­texts, the more they are semantically close. We propose to apply this principle for metonymy resolution. Traditionally, the distributional approach groups words like <i>USA, Britain, France, Germany </i>because there are in the same syntactical contexts:</p><p><i>(1) Someone live in Germany.</i></p><p><i>(2) Someone works in Germany.</i></p><p><i>(3) Germany declares something.</i></p><p><i>(4) Germany signs something.</i></p><p>The metonymy resolution task implies to distin­guish the literal cases, (1) &amp; (2), from the meto-nymic ones, (3) &amp; (4). Our method establishes these distinctions using the syntactic context distribution. We group contexts occurring with the same words: the syntactic contexts <i>live in </i>and <i>work in </i>are occur­ring with <i>Germany, France, country, city, place, </i>when syntactic contexts <i>subject-of-declare </i>and sub-ject-of<i>-sign </i>are occurring with <i>Germany, France, someone, government, president. </i>For each Named Entity annotation, the hybrid method consists in using symbolic annotation if there is (§1.2), else using distributional annotation (§1.3) as presented below.</p><p><b>Method: </b>We constructed a distributional space with the 100M-word BNC. We prepared the corpus by lemmatizing and then parsing with the same robust parser than for the symbolic approach (XIP, see sec­tion 3.1). It allows us to identify triple instances. Each triple have the form w1.R.w2 where w1 and w2 are lexical units and R is a syntactic relation (Lin, 1998; Kilgarriff &amp; <i>al. </i>2004). Our approach can be distinguished from classical distributional approach by different points. First, we use triple occurrences to build a distribu­tional space (one triple implies two contexts and two lexical units), but we use the transpose of the classical space: each point <i>xi </i>of this space is a syn­tactical context (with the form R.w.), each dimen­sion <i>j </i>is a lexical units, and each value <i>xi(j) </i>is the frequency of corresponding triple occurrences. Second, our lexical units are words but also complex nominal groups or verbal groups.<page local="3" global="490"/> Third, contexts can be simple contexts or composed contexts<footnote anchor="6"/>. We illustrate these three points on the phrase <i>pro­vide Albania with food aid. </i>The XIP parser gives the following triples where for example, <i>food aid </i>is considered as a lexical unit:</p><p>OBJ-N('VERB:provide','NOUN: Albania'). PREP_WITH('VERB: provide ','NOUN:aid'). PREP_WITH('VERB: provide ','NP:food aid').</p><p>From these triples, we create the following lexical units and contexts (in the context <i>1.VERB: provide. OBJ-N, </i>"1" mean that the verb <i>provide </i>is the gov­ernor of the relation OBJ-N): Words: Contexts:</p><p>VERB:provide  1.VERB: provide. OBJ-N NOUN:Albania 1.VERB: provide. PREPWITH NOUN:aid       2.NOUN: Albania.OBJ-N NP:food aid      2.NOUN: aid. PREPWITH 2.NP: food aid. PREP_WITH 1.VERB:provide.OBJ-N+2.NOUN:aid. PREPWITH 1.VERB:provide.OBJ-N+2.NP:food aid. PREPWITH 1.VERB:provide.PREP_WITH +2.NO:Albania.OBJ-N</p><p>We use a heuristic to control the high productivity of these lexical units and contexts. Each lexical unit and each context should appear more than 100 times in the corpus. From the 100M-word BNC we ob­tained 60,849 lexical units and 140,634 contexts. Then, our distributional space has 140,634 units and 60,849 dimensions.</p><p>Using the global space to compute distances be­tween each context is too consuming and would induce artificial ambiguity (Jacquet, Venant, 2005). If any named entity can be used in a metonymic reading, in a given corpus each named entity has not the same distribution of metonymic readings. The country <i>Vietnam </i>is more frequently used as an event than <i>France </i>or <i>Germany, </i>so, knowing that a context is employed with <i>Vietnam </i>allow to reduce the meto-nymic ambiguity.</p><p>For this, we construct a singular sub-space de­pending to the context and to the lexical unit (the ambiguous named entity):</p><p>For a given couple context <i>i </i>+ lexical unit <i>j </i>we construct a subspace as follows:</p><p>Subcontexts = list of contexts which are occur­ring with the word <i>i. </i>If there are more than k con­texts, we take only the <i>k </i>more frequents.</p><p>Sub_dimension = list of lexical units which are occurring with at least one of the contexts from the</p><p>Sub_contexts list. If there are more than <i>n </i>words, we take only the <i>n </i>more frequents (relative fre­quency) with the Sub_contexts list (for this applica­tion, <i>k </i>= 100 and <i>n </i>= 1,000).</p><p>We reduce dimensions of this sub-space to 10 dimensions with a PCA (Principal Components Analysis).</p><p>In this new reduced space <i>(k</i>*10), we compute the closest context of the context <i>j </i>with the Euclid­ian distance.</p><p>At this point, we use the results of the symbolic approach described before as starting point. We at­tribute to each context of the Sub_contexts list, the annotation, if there is, attributed by symbolic rules. Each kind of annotation (literal, place-for-people, place-for-event, etc) is attributed a score corre­sponding to the sum of the scores obtained by each context annotated with this category. The score of a context <i>i </i>decreases in inverse proportion to its dis­tance from the context <i>j: </i>score(context <i>i)</i><i> </i>= 1/d(context i, context <i>j)</i><i> </i>where d(ij) is the Euclidian distance between <i>i </i>and <i>j.</i></p><p>We illustrate this process with the sentence <i>pro­vide Albania with food aid. </i>The unit <i>Albania </i>is found in 384 different contexts (|Sub_contexts| = 384) and 54,183 lexical units are occurring with at least one of the contexts from the Sub_contexts list (|Sub_dimension| = 54,183).</p><p>After reducing dimension with PCA, we obtain the context list below ordered by closeness with the given context (1.VERB:provide.OBJ-N):</p><p><b>Contexts d symb. annot.</b></p><doubt alpha="63.6" length="66" tooSmall="False" monospace="0.0">1.VERB:provide.OBJ-N 0.00 1.VERB:allow.OBJ-N 0.76 place-for-people</doubt><doubt alpha="57.7" length="26" tooSmall="False" monospace="0.0">1. VERB:include.OBJ-N 0.96</doubt><doubt alpha="50.0" length="46" tooSmall="False" monospace="0.0">2. ADJ:new.MOD_PRE 1.02 1. VERB:be.SUBJ-N 1.43</doubt><p>1.VERB:supply.SUBJ-N_PRE 1.47 literal 1.VERB:support.SUBJ-N_PRE 1.70 place-for-people etc.</p><doubt alpha="62.1" length="29" tooSmall="False" monospace="0.0">1.VERB:become.SUBJ-N_PRE 1.64</doubt><doubt alpha="59.3" length="27" tooSmall="False" monospace="0.0">1.VERB:come.SUBJ-N_PRE 1.69</doubt><p>Score for each metonymic annotation of <i>Albania:</i></p><doubt alpha="66.7" length="21" tooSmall="False" monospace="0.0">place-for-people 3.11</doubt><doubt alpha="58.3" length="12" tooSmall="False" monospace="0.0">literal 1.23</doubt><p>place-for-event</p><doubt alpha="0.0" length="9" tooSmall="False" monospace="0.0">0.00 0.00</doubt><p>The score obtained by each annotation type al­lows annotating this occurrence of <i>Albania </i>as a <i>place-for-people </i>metonymic reading. If we can't choose only one annotation (all score = 0 or equal­ity between two annotations) we do not annotate.</p><footnote label="6">For our application, one context can be composed by two simple contexts.</footnote><page local="4" global="491"/></subsection></section><section number="2" title="Evaluation and Results"><p>The following tables show the results on the <b>test </b>corpus:</p><p>The results obtained on the test corpora are above the baseline for both location and organization names and therefore are very encouraging for the method we developed. However, our results on the test corpora are below the ones we get on the train corpora, which indicates that there is room for im­provement for our methodology.</p><p>Identified errors are of different nature: <u>Parsing errors</u>: For example in the sentence <i>"Many galleries in the States, England and France de­clined the invitation.", </i>because the analysis of the coordination is not correct, <i>France </i>is calculated as subject of <i>declined, </i>a context triggering a place-for-people interpretation, which is wrong here. <u>Mixed cases</u>: These phenomena, while relatively frequent in the corpora, are not properly treated.</p><p><u>Uncovered contexts</u>: some of the syntactico-semantic contexts triggering a metonymy are not covered by the system at the moment.</p></section><section number="3" title="Conclusion"><p>This paper describes a system combining a sym­bolic and a non-supervised distributional approach, developed for resolving location and organization names metonymy. We plan to pursue this work in order to improve the system on the already-covered phenomenon as well as on different names entities.</p><table caption="Table 1: Global Results" class="main" frame="box" rules="all" border="1" regular="False"><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>type</p></td><td class="cell"><p>Nb.</p><p>samp</p></td><td class="cell"><p>accuracy</p></td><td class="cell"><p>coverage</p></td><td class="cell"><p>Baseline accuracy</p></td><td class="cell"><p>Baseline coverage</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Loc/coarse</p></td><td class="cell"><p>908</p></td><td class="cell"><p>0.851</p></td><td class="cell"><p></p></td><td class="cell"><p>0.794</p></td><td class="cell"><p></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Loc/medium</p></td><td class="cell"><p>908</p></td><td class="cell"><p>0.848</p></td><td class="cell"><p></p></td><td class="cell"><p>0.794</p></td><td class="cell"><p></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Loc /fine</p></td><td class="cell"><p>908</p></td><td class="cell"><p>0.841</p></td><td class="cell"><p></p></td><td class="cell"><p>0.794</p></td><td class="cell"><p></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Org/coarse</p></td><td class="cell"><p>842</p></td><td class="cell"><p>0.732</p></td><td class="cell"><p></p></td><td class="cell"><p>0.618</p></td><td class="cell"><p></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Org/medium</p></td><td class="cell"><p>842</p></td><td class="cell"><p>0.711</p></td><td class="cell"><p></p></td><td class="cell"><p>0.618</p></td><td class="cell"><p></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Org/fine</p></td><td class="cell"><p>842</p></td><td class="cell"><p>0.700</p></td><td class="cell"><p></p></td><td class="cell"><p>0.618</p></td><td class="cell"><p></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr></table><table class="main" frame="box" rules="all" border="1" regular="False"><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p></p></td><td class="cell"><p>Nb occ.</p></td><td class="cell"><p>Prec.</p></td><td class="cell"><p>Recall</p></td><td class="cell"><p>F-score</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Literal</p></td><td class="cell"><p>721</p></td><td class="cell"><p>0.867</p></td><td class="cell"><p>0.960</p></td><td class="cell"><p>0.911</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Place-for-people</p></td><td class="cell"><p>141</p></td><td class="cell"><p>0.651</p></td><td class="cell"><p>0.490</p></td><td class="cell"><p>0.559</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Place-for-event</p></td><td class="cell"><p>10</p></td><td class="cell"><p>0.5</p></td><td class="cell"><p>0.1</p></td><td class="cell"><p>0.166</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Place-for-product</p></td><td class="cell"><p>1</p></td><td class="cell"><p></p></td><td class="cell"><p>0</p></td><td class="cell"><p>0</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Object-for-name</p></td><td class="cell"><p>4</p></td><td class="cell"><p>1</p></td><td class="cell"><p>0.5</p></td><td class="cell"><p>0.666</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Object-for-representation</p></td><td class="cell"><p>0</p></td><td class="cell"><p></p></td><td class="cell"><p></p></td><td class="cell"><p></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Othermet</p></td><td class="cell"><p>11</p></td><td class="cell"><p></p></td><td class="cell"><p>0</p></td><td class="cell"><p>0</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>mixed</p></td><td class="cell"><p>20</p></td><td class="cell"><p></p></td><td class="cell"><p>0</p></td><td class="cell"><p>0</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p><b>Table 2: Detailed Results for Locations</b></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p></p></td><td class="cell"><p>Nb occ.</p></td><td class="cell"><p>Prec.</p></td><td class="cell"><p>Recall</p></td><td class="cell"><p>F-score</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Literal</p></td><td class="cell"><p>520</p></td><td class="cell"><p>0.730</p></td><td class="cell"><p>0.906</p></td><td class="cell"><p>0.808</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Organization-for-members</p></td><td class="cell"><p>161</p></td><td class="cell"><p>0.622</p></td><td class="cell"><p>0.522</p></td><td class="cell"><p>0.568</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Organization-for-event</p></td><td class="cell"><p>1</p></td><td class="cell"><p></p></td><td class="cell"><p>0</p></td><td class="cell"><p>0</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Organization-for-product</p></td><td class="cell"><p>67</p></td><td class="cell"><p>0.550</p></td><td class="cell"><p>0.418</p></td><td class="cell"><p>0.475</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Organization-for-facility</p></td><td class="cell"><p>16</p></td><td class="cell"><p>0.5</p></td><td class="cell"><p>0.125</p></td><td class="cell"><p>0.2</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Organization-for-index</p></td><td class="cell"><p>3</p></td><td class="cell"><p></p></td><td class="cell"><p>0</p></td><td class="cell"><p>0</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Object-for-name</p></td><td class="cell"><p>6</p></td><td class="cell"><p>1</p></td><td class="cell"><p>0.666</p></td><td class="cell"><p>0.8</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Othermet</p></td><td class="cell"><p>8</p></td><td class="cell"><p></p></td><td class="cell"><p>0</p></td><td class="cell"><p>0</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Mixed</p></td><td class="cell"><p>60</p></td><td class="cell"><p></p></td><td class="cell"><p>0</p></td><td class="cell"><p>0</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p><b>Table 3: Detailed Results for Organizations</b></p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr></table></section><references><p>Abney S. 1991. <i>Parsing by Chunks. </i>In Robert Berwick, Steven Abney and Carol Teny (eds.). Principle-based Parsing, Klu-wer Academics Publishers.</p><p>Aït-Mokhtar S., Chanod, J.P., Roux, C. 2002. <i>Robustness be­yond Shallowness: Incremental Dependency Parsing. </i>Spe­cial issue of NLE journal.</p><p>Brun, C., Hagège C., 2003. <i>Normalization and Paraphrasing Using Symbolic Methods, </i>Proceeding of the Second Interna­tional Workshop on Paraphrasing. ACL 2003, Vol. 16, Sap­poro, Japan.</p><p>Harris Z. 1951. <i>Structural Linguistics, </i>University of Chicago Press.</p><p>Jacquet G.,Venant F. 2003. <i>Construction automatique de clas­ses de sélection distributionnelle, </i>In Proc. TALN 2003, Dourdan.</p><p>Kilgarriff A., Rychly P., Smrz P., Tugwell D. 2004. <i>The sketch engine. </i>In Proc. EURALEX, pages 105-116.</p><p>Levin, B. 1993. <i>English Verb Classes and Alternations — A preliminary Investigation. </i>The University of Chicago Press.</p><p>Nissim, M. and Markert, K. 2005. <i>Learning to buy a Renault and to talk to a BMW: A supervised approach to conven­tional metonymy. </i>Proceedings of the 6th International Work­shop on Computational Semantics, Tilburg.</p><doubt alpha="65.2" length="112" tooSmall="False" monospace="0.0">Nissim, M. and Markert, K. 2007.SemEval-2007 Task 08: Me­tonymy Resolution at SemEval-2007.In Proceedings of Se-</doubt><p>mEval-2007.</p><p>Lin D. 1998. <i>Automatic retrieval and clustering of similar</i> <i>words.</i><i> </i>In COLING-ACL, pages 768-774.</p><p>Mel'cuk I. 1988. <i>Dependency Syntax. </i>State University of New York, Albany.</p><p>Ruppenhofer, J. Michael Ellsworth, Miriam R. L. Petruck, Christopher R Johnson and Jan Scheffczyk. 2006. <i>Framenet II: Extended Theory and Practice.</i></p><p>Tesnière L. 1959. <i>Eléments de Syntaxe Structurale. </i>Klincksiek Eds. (Corrected edition Paris 1969).</p></references></body></article>