Summary of the paper
| Title | Question Answering on Web Data: The QA Evaluation in Quæro |
|---|---|
| Authors | Ludovic Quintard, Olivier Galibert, Gilles Adda, Brigitte Grau, Dominique Laurent, Véronique Moriceau, Sophie Rosset, Xavier Tannier and Anne Vilnat |
| Abstract | In the QA and information retrieval domains progress has been assessed viaevaluation campaigns(Clef, Ntcir, Equer, Trec).In theseevaluations, the systems handle independent questions and should provide oneanswer to each question, extracted from textual data,for both open domain and restricted domain. Quæro is a program promotingresearch and industrial innovation on technologies forautomatic analysis and classification of multimedia and multilingualdocuments. Among the many research areas concerned by Quæro.The Quaero project organized a series of evaluations of Question Answering onWeb Data systems in 2008 and 2009. For each language,English and French the full corpus has a size of around 20Gb for 2.5Mdocuments. We describe the task and corpora, and especially themethodologies used in 2008 to construct the test of question and a new one inthe 2009 campaign. Six types of questions were addressed,factual, Non-factual(How, Why, What), List, Boolean. A description of theparticipating systems and the obtained results is provided.We show the difficulty for a question-answering system to work with complexdata and questions. |
| Language | |
| Topics | Question Answering |
Full paper  |
Question Answering on Web Data: The QA Evaluation in Quæro |
| Bibtex | @InProceedings{QUINTARD10.186, author = {Ludovic Quintard, Olivier Galibert, Gilles Adda, Brigitte Grau, Dominique Laurent, Véronique Moriceau, Sophie Rosset, Xavier Tannier and Anne Vilnat}, title = {Question Answering on Web Data: The QA Evaluation in Quæro}, booktitle = {Proceedings of the Seventh conference on International Language Resources and Evaluation (LREC'10)}, year = {2010}, month = {may}, date = {19-21}, address = {Valletta, Malta}, editor = {Nicoletta Calzolari (Conference Chair), Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odjik, Stelios Piperidis, Mike Rosner, Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-6-7}, language = {english} } |