Summary of the paper
| Title | GikiCLEF: Crosscultural Issues in Multilingual Information Access |
|---|---|
| Authors | Diana Santos, Luís Miguel Cabral, Corina Forascu, Pamela Forner, Fredric Gey, Katrin Lamm, Thomas Mandl, Petya Osenova, Anselmo Peñas, Álvaro Rodrigo, Julia Schulz, Yvonne Skalban and Erik Tjong Kim Sang |
| Abstract | In this paper we describe GikiCLEF, the first evaluation contest that, to our knowledge, was specifically designed to expose and investigate cultural and linguistic issues involved in structured multimedia collections and searching, and which was organized under the scope of CLEF 2009. GikiCLEF evaluated systems that answered hard questions for both human and machine, in ten different Wikipedia collections, namely Bulgarian, Dutch, English, German, Italian, Norwegian (Bokmäl and Nynorsk), Portuguese, Romanian, and Spanish. After a short historical introduction, we present the task, together with its motivation, and discuss how the topics were chosen. Then we provide another description from the point of view of the participants. Before disclosing their results, we introduce the SIGA management system explaining the several tasks which were carried out behind the scenes. We quantify in turn the GIRA resource, offered to the community for training and further evaluating systems with the help of the 50 topics gathered and the solutions identified. We end the paper with a critical discussion of what was learned, advancing possible ways to reuse the data. |
| Topics | Question Answering, Multilinguality, Information Extraction, Information Retrieval |
Full paper |
GikiCLEF: Crosscultural Issues in Multilingual Information Access |
Slides |
- |
| Bibtex | @InProceedings{SANTOS10.272, author = {Diana Santos and Luís Miguel Cabral and Corina Forascu and Pamela Forner and Fredric Gey and Katrin Lamm and Thomas Mandl and Petya Osenova and Anselmo Peñas and Álvaro Rodrigo and Julia Schulz and Yvonne Skalban and Erik Tjong Kim Sang}, title = {GikiCLEF: Crosscultural Issues in Multilingual Information Access}, booktitle = {Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC'10)}, year = {2010}, month = {may}, date = {19-21}, address = {Valletta, Malta}, editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Bente Maegaard and Joseph Mariani and Jan Odijk and Stelios Piperidis and Mike Rosner and Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-6-7}, language = {english} } |