<?xml version="1.0"?><!DOCTYPE article SYSTEM "/project/take/software/searchbench_offline_processing/paperxml_generator/aclextractor/src/python/../resource/dtd/paperxml.dtd"><article><header><firstpageheader><page local="1"/><title>Annotating "tense" in a Tense-less Language</title><author surname="Xue" givenname="Nianwen"><org  name="University of Oslo" country="Norway" city="Oslo"/></author><author surname="Zhong" givenname="Hua"><org  name="University of Oslo" country="Norway" city="Oslo"/></author><author surname="Chen" givenname="Kai-Yun"><org  name="University of Oslo" country="Norway" city="Oslo"/></author></firstpageheader><frontmatter><p><b>Annotating "tense" in a tense-less language</b></p><p><b>Nianwen Xue*, Hua Zhong</b>j <b>and Kai-Yun Chen|</b></p><p>University of Colorado The Center for Computational Language and Education Research Boulder, CO 80309-0594, USA Nianwen.Xuecolorado.edu*, Hua.Zhongcolorado.edut, Kaiyun.Chencolorado.edu!</p></frontmatter><abstract>In the context of Natural Language Processing, annotation is about recovering implicit information that is useful for natural language applications. In this paper we describe a "tense" annotation task for Chinese, a language that does not have grammatical tense, that is designed to infer the temporal location of a situation in relation to the temporal deixis, the moment of speech. If successful, this would be a highly rewarding endeavor as it has application in many natural language systems. Our preliminary experiments show that while this is a very challenging annotation task for which high annotation consistency is very difficult but not impossible to achieve. We show that guidelines that provide a conceptually intuitive framework will be crucial to the success of this annotation effort. </abstract></header><body><section number="1." title="Introduction"><p>The notion of tense is a subject of lively debate in recent theoretical Chinese linguistics literature. Much of the con­troversy surrounds the question of whether tense is a use­ful theoretical construct. Huang (1984) and Li (1990) sug­gest there is a finite-nonfinite distinction in Chinese syn­tax which implies the existence of a phonologically empty tense category in the syntactic representation of a clause. Other researchers (Hu et al., 2001; Lin, 2003; Lin, 2006; Smith and Erbaugh, 2005) contend that such an abstract notion of tense is not justified for Chinese. In spite of this controversy, there is a general agreement that Chinese does not have grammatical tense. That is, Chinese does not have tense morphemes that are dedicated to mark the tempo­ral location of situations, like English. However, Chinese speakers, like speakers of other world languages, use the moment of speech as the temporal deixis to temporally lo­cate situations in their communication. One piece of ev­idence for this is that temporal adverbials like <b>4</b>A ("to­day"), sji A ("tomorrow") and <i>t </i>A ("yesterday") all as­sume a temporal deixis that is the moment ofspeech.</p><p>Corpus annotation provides a new perspective from which we can look into how Chinese speakers interpret situations temporally. Through linguistic annotation, we can deter­mine whether Chinese speakers consistently identify the temporal locations of situations. To the extent that they do, this information would be highly useful for natural lan­guage processing systems that can learn from the human interpretations through statistical and machine learning ap­proaches. For example, this information would be highly valuable to Machine Translation. To translate a language like Chinese into a language like English in which tense is grammatically marked with inflectional morphemes, an MT system will have to infer the necessary temporal informa­tion to determine the correct tense for verbs. Statistical MT systems, the currently dominant research paradigm, typi­cally do not address this issue directly. As a result, when evaluated for tense, current MT systems often perform mis­erably. For example, when a simple sentence like "Whe BJf A/tomorrow <i>H</i><i>L </i>® /return _L ^/Shanghai" is given to</p><p>Google's state-of-the-art Machine Translation system<footnote anchor="1"/>, it produces the output "He returned to Shanghai tomorrow", instead of the correct "he will return to Shanghai tomor­row". The past tense on the verb "returned" contradicts the temporal expression "tomorrow". Ye et al (2006), for ex­ample, reported that the best MT systems only get the tense correct 47% of the time, worse than the 69.5% when the most frequent tense (which is the past tense) is assigned. In this paper we report a preliminary study in which we ask Chinese native speakers to temporally locate situations denoted by verbs in naturally occurring text and assign a label that indicates their temporal relations to the document creation time.</p></section><section number="2." title="Deciding on a tag set"><p>The three temporal points, Speech Time, Reference Time and Situation Time are generally accepted as important to temporal interpretation since Reichenbach (1947) first pro­posed them. Speech Time and Reference Time are impor­tant to the interpretation of tense. Speech Time is the mo­ment of speech, and Reference time is the temporal per­spective from which the speaker invites his audience to con­sider a situation, and Situation Time is the time at which the situation actually occurs. In the "tense" annotation study we report here, we annotate the relation between Speech Time and Situation Time instead of the relation between Speech Time and Reference time, which in our judgment is too subtle to be annotated consistently. In determining the different values of tense, one important question to ask is whether one should use the tense taxonomy of a partic­ular language like English, or use a tag set that abstracts away from the language-specific properties. In a previous pilot tense annotation study motivated by Chinese-English machine translation, Ye (2007) used a tagset that is a di­rect reflection of the English tense system. She used a set of 11 tags that represent different combinations of the three tenses (present, past and future) and aspect (perfect, pro­gressive). However, there are reasons for not borrowing the English tense taxonomy directly. First, the English system does not consistently encode the relation between Speech time and Situation time. For example, in "He will call me after he gets here", while his "getting here" happens at a time in the future, it is assigned the present tense because it is in a clause introduced by "after".<page local="2"/> The annotation of the Chinese tense should not be bound by such English id­iosyncrasies. Instead it should annotate temporal notions that are more universal. Similarly, in English one can ei­ther use an infinitive marker or the future tense to indicate that the temporal location of a situation is in the future. For example, in "He hopes to leave", one can infer that leav­ing is something in the future, much like the leaving in "he hopes that she will leave", where the future tense is explic­itly marked. In a language like Chinese that lacks overt tense markers, if the task is to annotate tense as it is used in English, the choice will be indeterminate in such situa­tions. It makes more sense to annotate the abstract relation between Speech Time and Situation Time which is more deterministic. Adopting the English tense taxonomy also limits the pool of potential annotators, who would have to be proficient in both Chinese and English. Such annotators are generally hard to find.</p><footnote>'http://www.google.com/language_tools</footnote><p>In written text, which is the primary source of data that we are dealing with, the temporal deixis is the document cre­ation time. All situations are temporally related to this doc­ument creation time except in direct quotations, where the temporal location is relative to the moment of speech of the speaker who is quoted. For example, in (1), there are sev­eral verbs involved. The temporal location of ft ("say") assumes that the temporal deixis is the document creation time, while .J<b>L </b>("be"), <b>M k </b>("want") are inside the direct quotations of ^ JJ, the speaker, and their temporal location is relative to the time when he performed that speech act.</p><doubt alpha="26.7" length="15" tooSmall="False" monospace="0.0">(1)f   *H4.# ft</doubt><p>Suokang once to he DE mother say : " he be I DE property , I want BA he roll into ball , put in pocket "Suokang once said to his mother: 'He is my property. If I want to roll him into a ball and put it in my pocket,</p><doubt alpha="38.2" length="34" tooSmall="False" monospace="0.0">%,?&amp;   A" inside , up to me ,... "</doubt><doubt alpha="39.1" length="23" tooSmall="False" monospace="0.0">it's up to me, '... ' "</doubt><p>Tenses that relate the situation time to the document cre­ation time or the moment of speech are considered to be <i>ab­solute tenses, </i>even though the moment of speech is variable and constantly changes. The term <i>situation </i>covers events and states in the broad sense of those terms and they are generally signaled by the presence of a verb. In other cases, the temporal location of a situation cannot be defined in re­lation to the moment of speech, at least not directly. For example in (2), The temporal location of ^ ("intend") cannot be determined independently of the temporal loca­tion of if Jt("reveal"). The temporal location of <i>^ </i><b>k </b>is simultaneous with if 3J. If the temporal location of if JJ is in the past, then the temporal location of <i>^ </i><b>k </b>is also in the past. If the temporal location of if JJ is in the future, then the temporal location of <b>^k</b>is also in the future. In this specific case, the situation denoted by the matrix verb if <i>J </i>is in the past. Therefore the situation denoted by <i>^ k </i>is also located in the past.</p><doubt alpha="38.1" length="21" tooSmall="False" monospace="0.0">(2)it*j^ltf*£4^ + 4ft</doubt><p>he also reveal Russia intend in next ten years within.</p><p>to Iran provide weapons .</p><p>"He also revealed that Russia intended to provide weapons to Iran within the next ten years."</p><p>In our Chinese "tense" annotation task, we annotate both <i>absolute </i>and <i>relative </i>tenses. By "tense", we mean the tem­poral relation between the temporal deixis and the situation (in the case of absolute tense) and between situations (in the case of relative tense). The situation time can be anterior to (in the past), simultaneous with (in the present), or poste­rior to (in the future) the moment of speech. Since there is no grammatical tense that can be directly observed in Chi­nese text, the tense annotation as defined here is a temporal inference exercise. The "situations" that we are interested in are expressed as clauses centered around a verb, and for the sake of convenience we mark the "tense" on the verb itself instead of the entire clause. However, when infer­ring the temporal location of the situation, we have to take into consideration the entire clause, because the arguments and modifiers of a verb are just as important as the verb itself when determining the temporal location of the situa­tion. For example, in the absence of additional information such as temporal adverbials, the default temporal location of (3 a) is the present while the default temporal location of (3b) is the past, even though the verb is the same in these two clauses. (3a) describes a habitual situation where the person described sleeps a lot repeatedly, even though he is not in a perpetual state of sleep. The habitual interpre­tation is induced by the adverbial modifier <b>4_- </b>A ("all the time"). In contrast, the duration of three hours quantifies the sleep situation in (3b) and establishes temporal bound for B§ ("sleep"). By default bounded situations are tempo­rally located in the past (Smith and Erbaugh, 2005), a point we will elaborate further.</p><doubt alpha="50.0" length="18" tooSmall="False" monospace="0.0">(3) a.-fel_-AJiA£o</doubt><p>he all the time sleep sleep .</p><p>"He sleeps all the time".</p><p>b. -fell   7    =- 'hat. he sleep ASP three hour .</p><p>"He slept for three hours."</p></section><section number="3." title="Specifications"><subsection number="3.1." title='Inferring Absolute "Tense"'><p>Our annotation task is inspired by the theoretical work of Smith (2005), in which she shows that for both languages with or without grammatical tense, there is a default pattern of temporal interpretation, which is that unbounded situa­tions are located in the Present while bounded situations are located in the past by default. There is also a bounded event constraint which says that bounded situations are not located in the Present. In the absence of explicit temporal expressions that can overwrite this default pattern of tem­poral interpretation, <i>boundedness </i>is thus a crucial seman­tic concept when inferring the temporal location of a situ­ation. There are many different ways in which a situation can be bounded (or unbounded, for that matter).<page local="3"/> Bounded-ness can be a function of the inherent properties of some verbs. For example, punctual verbs are usually bounded while stative verbs are usually unbounded. Boundedness can also come from the compositional properties of some syntactic constructions. For example, resultative construc­tions tend to be bounded. In addition, aspectual viewpoints are also good indications of boundedness, when they appear in text. For example, perfective viewpoints are compati­ble with bounded situations while imperfective viewpoints are compatible with unbounded situations. We do no have space to go into a detailed discussion of boundedness and its relationship to situation types and viewpoints here, and the reader is referred to (Xiao and McEnery, 2004) for a more detailed discussion. In this section, we will describe each temporal location when it is a default or non-default interpretation of a situation.</p><subsubsection number="3.1.1." title="Present tense"><p>A situation is assigned the present tense if it is true at an interval of time that includes the present moment. Bounded situations is incompatible with the present tense because it can only be viewed "at a distance" and thus cannot be true at the present moment. They can only be in the past or in the future. The present tense is compatible with states and activities. States are temporally located in the present by default. When non-stative situations are temporally located in the present, they either have an imperfective aspect or have a habitual or frequentive reading which makes them look like states, e.g., he often attend outdoors activities .</p><doubt alpha="31.6" length="19" tooSmall="False" monospace="0.0">(4)-f*'f't#^aj&gt;j&gt;\-</doubt><p>"He often attends outdoors activities."</p></subsubsection><subsubsection number="3.1.2." title="Past tense"><p>Situations thathappenbefore the momentofspeech(orthe document creation time) are temporally located in the past. Bounded situations are temporally located in the past by default (5a). States and unbounded activities are tempo­rally located in the present by default (5b), but they can be located in the past when they are modified by explicit tem­poral expressions indicating the past (5c).</p><doubt alpha="45.8" length="24" tooSmall="False" monospace="0.0">(5) a.+^    Ajj7L ifrJfo</doubt><p>Chinese personnel and Chinese nationals safely withdraw from Chad .</p><p>"Chinese personnel and Chinese nationals safely withdrew from Chad." he like watch kung-fun movie . "He likes to watch kung-fu movies." he young like watch kung-fu movie .</p><doubt alpha="62.5" length="16" tooSmall="False" monospace="0.0">c.l&amp;&gt;hrti^±MihK%</doubt><p>"He liked to watching kung-fu movies when he was young."</p></subsubsection><subsubsection number="3.1.3." title="Future tense"><p>Situations that happen posterior to the moment of speech are temporally located in the future. Future situations are not simply the opposite of past situations. While past situa­tions have already happened by definition, future situations by nature are characterized by uncertainty. That is, future situations may or may not happen. They really just refer to situations that have not happened yet. Therefore, future situations are often linked to possibilities, not just to situa­tions that will definitely happen. No situation type is asso­ciated with the future by default, and therefore a situation is temporally located in the future only if it is modified by an explicit temporal expression (6a), or if it is modified by a modal verb (6b) (not all modal verbs are future-oriented), or if the situation is embedded in a conditional clause, as indicated by a subordinate conjunction (6c) or by a noun denoting condition (6d), or if the situation is embedded in a future-oriented verb (6e) or noun (6f), in which case its temporal location is sensitive to the temporal location of the embedding situation (also see Section 3.2.).</p><p>(6) a. A^ <i>A</i><i>-êJxfaïÊL   </i><u>jjMr</u> o conference next year in Singapore hold .</p><p>"The conference will be held in Singapore next year." judge in verdict in say : " They if   release , very likely will immediately escape . " "The judge said in the verdict: 'if they are released, they are very likely to escape immediately.' "</p><doubt alpha="57.1" length="7" tooSmall="False" monospace="0.0">Tib4t."</doubt><p>c. # <u>A</u><u>&gt;fc</u> ... if   oil price continue rise ...</p><p>"If oil prices continue to rise..." when with Mexican government negotiate when put forward DE condition one of.</p><doubt alpha="55.0" length="60" tooSmall="False" monospace="0.0">d.i£#—^ *#AA&amp;19964 establish like this one CL law be he 1996</doubt><p>"Establishing such a law was one on the conditions that he put forward when he negotiated with the Mexican government." oversea battle in die DE troop remains</p><doubt alpha="66.7" length="66" tooSmall="False" monospace="0.0">e.JtSUiAf # #    —\i &amp;U.S. government determine BA every one CL in</doubt><p><u>iS la?</u> JtH</p><p>bring back the U.S. .</p><p>"The U.S. government is determined to bring back to the U.S. the remains of every troop who died in a battle overseas." this indicate they have at any time escape DE preparation .</p><page local="4"/><p>"This shows that they have made preparations to escape at any time."</p><p>Modal verbs in Chinese include ("will"), <b>J </b>("should, will"), # ("will"), <i>M </i><i>t£ </i>("should"), T <i>ii </i>("may"),T ("may"), <i>ok </i><b>M </b>("must"), etc.). Many modal verbs in­dicate futurity. The verb complement of these modals tend to be temporally located in the future, that is, they indi­cate situations that have not yet happened. For example, in (7), the verb ("cooperate") is temporally located in the future because of the modal <b>J. </b>Note that in some cases <b>J</b>c denotes intension and is not necessarily a modal verb in all context. Even when <b>J </b>is not a modal verb, it is still a future-oriented verb. So situations modified by <b>J </b>always has a sense of futurity.</p><doubt alpha="61.1" length="18" tooSmall="False" monospace="0.0">(7)KjttA*J|i£—iHHt</doubt><p>two sides indicate will further cooperate .</p><p>"The two sides indicate that they will cooperate fur­ther."</p><p>Not modals are future-oriented. For example, the verb com­plement of i<b>t, </b>("can) does not indicate futurity. The default tense is the present unless overwritten by an overt temporal adverbial:</p><doubt alpha="27.3" length="11" tooSmall="False" monospace="0.0">(8)44,H *ft</doubt><p>he can do-well this CL job .</p><p>"He can do this job well." to"), verbs of future events (e.g., <i>if</i><i> </i>("foretell") , M ("want"), if <i>~t </i>("predict") and verbs of future preven­tion (e.g., # <i>f&amp;r </i>("preclude"), <i>&amp; </i><b>j</b>h ("prevent"). Future-oriented nouns are often derived from these future-oriented verbs and they often co-occur with a support verb. For ex­ample, <i>&gt;$-4k- </i>("prepare") is a future-oriented verb (9a) and its complement, #t M ("withdraw") is located in the future relative to the temporal location of <i>&gt;$-4b~. </i>Even when the ;f£ <i>4b~ </i>("preparation) is nominalized, as in (9b), the situa­tion denoted by its complement clause is still located in the future relation to this nominalized verb.</p><doubt alpha="63.5" length="263" tooSmall="False" monospace="0.0">Future-oriented verbs include verbs of future having (e.g.,-f^il.("guarantee"),?%i%("pledge"), verbs of future situ­ation (e.g.,$L-p_("propose"),if3H|("plan") ,:^4r("pre­pare"), etc.), verbs of wish and desire (e.g.,J("want"),M("dream"),t J("need") ("look forward</doubt><doubt alpha="47.6" length="21" tooSmall="False" monospace="0.0">(9) a.ttfXTi^imi,&amp;.&amp;®</doubt><p>Kosovo independence may cause riot . UN Aj}       tj <u>#fc% </u>personnel already prepare withdraw .</p><p>"Kosovo independence may cause riot. UN per­sonnel have already prepared to leave."</p><doubt alpha="51.9" length="27" tooSmall="False" monospace="0.0">b.^ t A *fe A T i51imi &amp;Ajj</doubt><p>e,J^[#;ii&amp;]#2Mh.</p></subsubsection></subsection><subsection number="3.2." title="Inferring Relative tense"><p>The temporal interpretation of one situation is often bound by the temporal location of a reference situation. One com­mon scenario in which this kind of dependency occurs is when the target situation, the situation we are interested in at the moment, is embedded in the reference situation as a complement. Just as the absolute "tense" represents a tem­poral relation between the situation time and the moment of speech or document creation time, the relative "tense" represents a relation between the temporal location of a sit­uation and its reference situation. The target situation can be anterior to (10a), simultaneous with (10b), or posterior to the reference situation (10c).</p><doubt alpha="50.0" length="16" tooSmall="False" monospace="0.0">(10) a.t?Jt%ifAM</doubt><p>Indonesian police reveal ex-presidentSuharto already die .</p><doubt alpha="71.4" length="7" tooSmall="False" monospace="0.0">en *EtA</doubt><p>"The Indonesian police revealed that ex-president Suharto had already died."</p><p>b. "/T<b>i</b>t AM roaming charges testimony witness reveal mobile phone roaming cost less than five fen money .</p><p>"The witnesses at the testimony on roaming charges revealed that the cost for roaming was less than 0.05 Chinese yuan."</p><p>c. <i>frê)</i><i> </i>jgi     AM <b>«2</b>£P*2 » »B£ company personnel reveal " Star2 " trial version soon face the world .</p><p>"The company personnel revealed that 'Star 2' trial version would soon face the world."</p><p>Relative "tense" is invoked when the absolute (in relation to moment of speech) temporal location of a situation can only be determined through the temporal location of a ref­erence situation. For example, in (10c), the temporal loca­tion of i£j-t-r ("face the world") is posterior to the reference situation A M ("reveal"), and thus the absolute temporal location of i£j-fr depends on the temporal location of AM. If the reference situation is located in the present, the target situation is located in the future. If the reference is located in the past, then the temporal location of the target situation is a future-in-past. If the reference situation is located in the future, then the temporal location of the target situation is the future of future. The combination of absolute "tense" of the reference situation and the relative temporal ordering of the reference and target situations yields nine possibilities, listed in Table 1.</p><p>Table 1: Nine possibilities (Acronyms: ref=reference, tgt=target, pff=past-from-future, fip=future-in-past)</p><p>Among the nine possibilities, past-from-future is rarely attested.  When the reference situation is located in the present, the temporal location of the target situation is rel­ative to the moment of speech or document creation time, and thus are not different from the absolute "tense".<page local="5"/> When the reference situation is temporally located in the past and the target situation is anterior to or simultaneous with the reference situation, we simply stipulate that the target situ­ation is temporally located in the past without making any further distinctions. The only possibility we explicitly en­code is future-in-the-past, which occurs very often in actual text.</p><table class="main" frame="box" rules="all" border="1" regular="False"><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>ref/tgt</p></td><td class="cell"><p>anterior</p></td><td class="cell"><p>simultaneous</p></td><td class="cell"><p>posterior</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>present</p></td><td class="cell"><p>past</p></td><td class="cell"><p>present</p></td><td class="cell"><p>future</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>past</p></td><td class="cell"><p>past</p></td><td class="cell"><p>past</p></td><td class="cell"><p>fip</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>future</p></td><td class="cell"><p>pff</p></td><td class="cell"><p>future</p></td><td class="cell"><p>future</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr></table></subsection><subsection number="3.3." title="Target situation is posterior to reference situation"><p>One scenario where the target situation is posterior to the reference situation is when the reference situation is de­noted by a future-oriented verb. For example, in (11a), the situation denoted by <i>&amp; A </i>("prevent") is embedded in the reference situation denoted by <b>k </b>ffl ("intend"), which is a future-oriented verb. <i>&amp; A </i>is something that has not yet happened at the time of <b>k </b>ffl and is thus posterior to <b>k </b>ffl. <b>k </b>ffl is a stative verb, and by default is located in the present. The temporal location of &amp; A is thus a simple future. Similarly, in (11b), <i>HAXW</i><i> </i>("irresponsibly cut trees") is also located in the future because of the future-oriented verb <i>i\ </i>("allow").</p><doubt alpha="55.6" length="27" tooSmall="False" monospace="0.0">(11) a.-ffW^rkSFJ-jfc£H«fi£</doubt><p>Russia want       prevent      the U. S.</p><p>monopolize outer space .</p><p>"Russian want to prevent the U.S. from monopo­lizing the outer space" second not allow cut trees irresponsibly "Second, irresponsible logging is not allowed."</p><doubt alpha="47.1" length="17" tooSmall="False" monospace="0.0">b. x      ^ifcMAK</doubt><p>When the embedding future-oriented verb is temporally lo­cated in the past, the tense of the complement verb is a future-in-past. For example, in (12), the temporal loca­tion of the embedding verb <i>kr </i>("get ready to") is in the past because it is in the scope of the temporal adver­bial at A ("yesterday"). The tense of the complement verb A ("go") is thus a future-in-past.</p><p>(12) HtA       , <i>tfLSL</i><i>   &gt;jLjk_ </i><i>H , </i>yesterday , he right prepare go airport when.</p><p>"Yesterday, right when he was preparing to go to the airport,... "</p></subsection><subsection number="3.4." title="Target situation is simultaneous with reference situation"><p>By "simultaneous" we mean there is some overlap between the intervals that the two situations hold true. For example, in (13a), the temporal interpretation of ("seek") is de­pendent on the temporal location of if f ("like"). Since if; f is a stative verb, by default we assume that the situ­ation it denotes is temporally located in the present. Since -?- is simultaneous with f, it is also located in the present. In (13b), the situations denoted by 1 _t ("put on") are simultaneous with the situation denoted by <i>%</i> 5'J ("see"). Since ;# 5'J is temporally located in the past, the situation denoted by 1 _t is also temporally located in the past.</p><doubt alpha="54.2" length="24" tooSmall="False" monospace="0.0">(13) a.X&lt;ytHA^fiif»R7v4i</doubt><p>many Chinese like in salary income relatively high DE foreign enterprises seek employment opportunity .</p><p>"Many Chinese like to seek employment opportu­nities in foreign enterprises where the salary in­come is higher." reporter today at railway station square see . plain-clothes police also all   put on uniform participate maintain order .</p><doubt alpha="38.1" length="21" tooSmall="False" monospace="0.0">b.*e4-   4^ rii/ jrM,</doubt><p>"This reporter saw at the railway station square to­day that all plain-clothes policemen also put on uniforms and participated in maintaining order."</p></subsection><subsection number="3.5." title="Target situation is anterior to reference situation"><p>A third situation is when the target situation is temporally anterior to the reference situation. Verbs such as <i>Jkr^f </i>("feel fortunate"), <i>J$'W </i>("regret") are opposite of future-oriented verbs in that they imply something has already happened. For example, in (14, the temporal location of <b>J </b>("ask for") is anterior to <i>J$'W </i>("regret"). Since <i>J$'W </i>is a stative verb and by default is located in the present, the situation de­noted by <b>J </b>occurs before the moment of speech or docu­ment creation time. Thus it should have a simple past tense.</p><p>(14) <i>tfk * &amp; £ </i>Shanxi official regret not from photographer more ask for a few CL South China tiger picture .</p><p>"Shanxi officials regret that they didn't ask the pho­tographer for a few more pictures of the South China tiger."</p></subsection></section><section number="4." title="Experiments"><p>We performed two experiments with two annotators that are native speakers of Chinese who are also fluent in English. In the first experiment, we replicated the annotation condi­tion reported in (Ye, 2007) under which the annotators were asked to choose a tense they would use to translate a Chi­nese verb into English without providing them with a set of guidelines. The experiment was done on 1076 verb in­stances from 6 articles randomly selected from the Chinese Treebank. The annotators were presented with each verb in its context in the article. The results are presented in Table 2. The agreement is higher than the 43% is reported in (Ye, 2007), but on a reduced tag set that is only relevant to tense. In the second experiment, we provided the annotators with a simple set of guidelines that are summarized in Section 3.. The guidelines summarize factors that the annotators should consider when making their judgment on the tense selection.<page local="6"/> The guidelines are presented as a set ofrules that can be overwritten when "hard evidence" such as temporal adverbials are present. The second experiment was done on a different set of verbs taken from six different articles from the first experiment. The results (Table 3) show that even with this set ofvery simple guidelines, there has been sub­stantial improvement (17%) in inter-annotator agreement, from the 58% in Experiment 1 to the 75% in Experiment 2. One interesting observation is that the past tense is anno­tated with very high inter-annotator agreement (86%) while the future and present tenses are much harder to annotate. This is something that we will try to explain in future work.</p><p>CarlotaS. Smith and Mary Erbaugh. 2005. Temporal inter­pretation in Mandarin Chinese. <i>Linguistics, </i>43(4):713-756.</p><p>Z. Xiao and A. McEnery. 2004. <i>Aspect in Mandarin Chi­nese: A corpus-based study. </i>Amsterdam, John Ben­jamins.</p><p>Yang Ye, Victoria Li Fossum, and Steven Abney. 2006. Latent features in automatic tense translation between Chinese and English. In <i>The Proceedings of the 5th</i> <i>SIGHAN Workshop on Chinese Language Processing, </i>Sydney, Australia. Yang Ye. 2007. <i>Automatica Tense and Aspect Translation between Chinese and English. </i>Ph.D. thesis, University of Michigan.</p></section><section number="5." title="Conclusion and future work"><p>In the context of natural language processing, annotation is about recovering implicit information that is useful for natural language applications. In this sense annotation of Chinese tense would be a highly rewarding endeavor if suc­cessful. Our preliminary experiments show that providing a set of intuitive of guidelines is crucial to Chinese tense an­notation. Although the inter-annotator agreement we report here has not yet reached satisfactory levels, we are confi­dent that with refined guidelines the inter-annotator agree­ment can be further improved.</p><table caption="Table 2: Inter-annotator agreement without guidelines" class="main" frame="box" rules="all" border="1" regular="False"><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Tag</p></td><td class="cell"><p>Annl</p></td><td class="cell"><p>Ann2</p></td><td class="cell"><p>Agree</p></td><td class="cell"><p>f-measure</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Present</p></td><td class="cell"><p>386</p></td><td class="cell"><p>269</p></td><td class="cell"><p>185</p></td><td class="cell"><p>.565</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Past</p></td><td class="cell"><p>302</p></td><td class="cell"><p>269</p></td><td class="cell"><p>216</p></td><td class="cell"><p>.757</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Future</p></td><td class="cell"><p>123</p></td><td class="cell"><p>111</p></td><td class="cell"><p>52</p></td><td class="cell"><p>.444</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>N/A</p></td><td class="cell"><p>265</p></td><td class="cell"><p>427</p></td><td class="cell"><p>174</p></td><td class="cell"><p>.503</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Overall</p></td><td class="cell"><p>1076</p></td><td class="cell"><p>1076</p></td><td class="cell"><p>627</p></td><td class="cell"><p>.583</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr></table><table caption="Table 3: Inter-annotator agreement with guidelines" class="main" frame="box" rules="all" border="1" regular="False"><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Tag</p></td><td class="cell"><p>Annl</p></td><td class="cell"><p>Ann2</p></td><td class="cell"><p>Agree</p></td><td class="cell"><p>f-measure</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Present</p></td><td class="cell"><p>276</p></td><td class="cell"><p>123</p></td><td class="cell"><p>106</p></td><td class="cell"><p>.531</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Past</p></td><td class="cell"><p>501</p></td><td class="cell"><p>480</p></td><td class="cell"><p>424</p></td><td class="cell"><p>.864</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Future</p></td><td class="cell"><p>180</p></td><td class="cell"><p>320</p></td><td class="cell"><p>171</p></td><td class="cell"><p>.684</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>N/A</p></td><td class="cell"><p>134</p></td><td class="cell"><p>168</p></td><td class="cell"><p>122</p></td><td class="cell"><p>61</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"><p>Overall</p></td><td class="cell"><p>1091</p></td><td class="cell"><p>1091</p></td><td class="cell"><p>823</p></td><td class="cell"><p>.754</p></td><td class="cell"></td></tr><tr class="row"><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td><td class="cell"></td></tr></table></section><references><p>Jianhua Hu, Haihua Pan, and Liejiong Xu. 2001. Is there a finite-nonfinite distinction in Chinese. <i>Linguis­tics, </i>39:1117-1148.</p><p>James C.T. Huang. 1984. On the distribution and reference of empty pronouns. <i>Linguistics Inquiry, </i>15:531-574.</p><p>Audrey Yen-hui Li. 1990. <i>Order andConstituencyin Man­darin Chinese. </i>Dordrecht: Kluwer Academic Publish­ers.</p><p>Jo-WangLin. 2003. Temporal Reference in Mandarin Chi­nese. <i>Journal ofEast Asian Linguistics, </i>9:259-311.</p><p>Jo-Wang Lin. 2006. Time in a language without tense: The case ofChinese. <i>JournalofSemantics, </i>23:1-53.</p></references></body></article>