Summary of the paper
| Title | GikiCLEF: Crosscultural Issues in Multilingual Information Access |
|---|---|
| Authors | Diana Santos, Luís Miguel Cabral, Corina Forascu, Pamela Forner, Fredric Gey, Katrin Lamm, Thomas Mandl, Petya Osenova, Anselmo Peñas, Álvaro Rodrigo, Julia Schulz, Yvonne Skalban and Erik Tjong Kim Sang |
| Abstract | In this paper we describe GikiCLEF, the first evaluation contest that, to ourknowledge, was specifically designed to expose and investigate cultural andlinguistic issues involved in structured multimedia collections and searching,and which was organized under the scope of CLEF 2009.GikiCLEF evaluated systems that answered hard questions for both human andmachine, in ten different Wikipedia collections, namely Bulgarian, Dutch,English, German, Italian, Norwegian (Bokmäl and Nynorsk), Portuguese,Romanian, and Spanish.After a short historical introduction, we present the task, together with itsmotivation, and discuss how the topics were chosen. Then we provide anotherdescription from the point of view of the participants. Before disclosing theirresults, we introduce the SIGA management system explaining the several taskswhich were carried out behind the scenes. We quantify in turn the GIRAresource, offered to the community for training and further evaluating systemswith the help of the 50 topics gathered and the solutions identified. We endthe paper with a critical discussion of what was learned, advancing possibleways to reuse the data. |
| Language | Information Extraction, Information Retrieval |
| Topics | Question Answering, Multilinguality, Information Extraction, Information Retrieval |
Full paper  |
GikiCLEF: Crosscultural Issues in Multilingual Information Access |
| Bibtex | @InProceedings{SANTOS10.272, author = {Diana Santos, Luís Miguel Cabral, Corina Forascu, Pamela Forner, Fredric Gey, Katrin Lamm, Thomas Mandl, Petya Osenova, Anselmo Peñas, Álvaro Rodrigo, Julia Schulz, Yvonne Skalban and Erik Tjong Kim Sang}, title = {GikiCLEF: Crosscultural Issues in Multilingual Information Access}, booktitle = {Proceedings of the Seventh conference on International Language Resources and Evaluation (LREC'10)}, year = {2010}, month = {may}, date = {19-21}, address = {Valletta, Malta}, editor = {Nicoletta Calzolari (Conference Chair), Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odjik, Stelios Piperidis, Mike Rosner, Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-6-7}, language = {english} } |