<?xml version="1.0"?><!DOCTYPE article SYSTEM "/project/take/software/searchbench_offline_processing/paperxml_generator/aclextractor/src/python/../resource/dtd/paperxml.dtd"><article><header><firstpageheader><page local="1" global="69"/><title>FIRE: Forum for Information Retrieval Evaluation</title><pubinfo>The 2nd International Workshop On "Cross Lingual Information Access Addressing the Information Need of Multilingual Societies, 2008</pubinfo><author surname="Mitra" givenname="Mandar"></author><author surname="Majumdar" givenname="Prosenjit"></author></firstpageheader><frontmatter><p><b>FIRE: Forum for Information Retrieval Evaluation</b></p><p>Mandar Mitra, Prasenjit Majumder</p></frontmatter><abstract></abstract></header><body><section title=""><p>This talk will present our plans for organizing FIRE, a forum for Information Retrieval evaluation, focused on Indian languages. We will start by reviewing the basic experimental framework and metrics as represented by the Cranfield paradigm. An overview of the main evaluation fora for IR TREC, CLEF and NTCIR, which are all based on this paradigm, and from which FIRE draws inspiration -- will be given. The components of the evaluation framework, viz. corpora, search topics, and relevance judgments will also be discussed.</p></section></body></article>