eds.) Evaluation of CrossLanguage Information Retrieval Systems.pdfVIP

The Future of Evaluation for Cross-Language Information Retrieval Systems 1 2 3 4, 5 Carol Peters , Martin Braschler , Khalid Choukri , Julio Gonzalo Michael Kluck 1ISTI-CNR, Area di Ricerca CNR, 56124 Pisa, Italy, carol.peters@r.it 2Eurospider Information Technology AG, Zurich, Switzerland, martin.braschler@ 3Evaluations and Language resources Distribution Agency, Paris, France, choukri@elda.fr 4Lenguajes y Sistemas Informáticos, Universidad Nacional de Educaciòn a Distancia, Madrid, Spain, julio@lsi.uned.es 5Informationszentrum Sozialwissenschaften (IZ), 53113 Bonn, Germany, kluck@bonn.iz-soz.de Abstract The objective of the Cross-Language Evaluation Forum (CLEF) is to promote research in the multilingual information access domain. In this short paper, we list the achievements of CLEF during its first four years of activity and describe how the range of tasks has been considerably expanded during this period. The aim of the paper is to demonstrate the importance of evaluation initiatives with respect to system research and development and to show how essential it is for such initiatives to keep abreast of and even anticipate the emerging needs of both system developers and application communities if they are to have a future. 1. Introduction to test monolingual, bilingual and multilingual free text The Cross-Language Evaluation Forum (CLEF) has just retrieval systems have been proposed. The aim has been completed its fourth year of activity. The objective of to encourage groups to work th