Summary of the paper
| Title | Evaluating Multilingual Question Answering Systems at CLEF |
|---|---|
| Authors | Pamela Forner, Danilo Giampiccolo, Bernardo Magnini, Anselmo Peñas, Álvaro Rodrigo and Richard Sutcliffe |
| Abstract | The paper offers an overview of the key issues raised during the seven years’activity of the Multilingual Question Answering Track at the Cross LanguageEvaluation Forum (CLEF). The general aim of the Multilingual Question AnsweringTrack has been to test both monolingual and cross-language Question Answering(QA) systems that process queries and documents in several European languages,also drawing attention to a number of challenging issues for research inmultilingual QA. The paper gives a brief description of how the task hasevolved over the years and of the way in which the data sets have been created,presenting also a brief summary of the different types of questions developed.The document collections adopted in the competitions are sketched as well, andsome data about the participation are provided. Moreover, the main evaluationmeasures used to evaluate system performances are explained and an overallanalysis of the results achieved is presented. |
| Language | Multilinguality |
| Topics | Question Answering, Evaluation methodologies, Multilinguality |
Full paper  |
Evaluating Multilingual Question Answering Systems at CLEF |
| Bibtex | @InProceedings{FORNER10.464, author = {Pamela Forner, Danilo Giampiccolo, Bernardo Magnini, Anselmo Peñas, Álvaro Rodrigo and Richard Sutcliffe}, title = {Evaluating Multilingual Question Answering Systems at CLEF}, booktitle = {Proceedings of the Seventh conference on International Language Resources and Evaluation (LREC'10)}, year = {2010}, month = {may}, date = {19-21}, address = {Valletta, Malta}, editor = {Nicoletta Calzolari (Conference Chair), Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odjik, Stelios Piperidis, Mike Rosner, Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-6-7}, language = {english} } |