Title |
An Analysis of the Performances of the CasEN Named Entities Recognition System in the Ester2 Evaluation Campaign |
Authors |
Damien Nouvel, Jean-Yves Antoine, Nathalie Friburger and Denis Maurel |
Abstract |
In this paper, we present a detailed and critical analysis of the behaviour ofthe CasEN named entity recognition system during the French Ester2 evaluationcampaign. In this project, CasEN has been confronted with the task of detectingand categorizing named entities in manual and automatic transcriptions of radiobroadcastings. At first, we give a general presentation of the Ester2 campaign.Then, we describe our system, based on transducers. Next, we depict how systemswere evaluated during this campaign and we report the main official results.Afterwards, we investigate in details the influence of some annotation biaseswhich have significantly affected the estimation of the performances ofsystems. At last, we conduct an in-depth analysis of the effective errors ofthe CasEN system, providing us with some useful indications about phenomenathat gave rise to errors (e.g. metonymy, encapsulation, detection of rightboundaries) and are as many challenges for named entity recognition systems. |
Language |
Information Extraction, Information Retrieval |
Topics |
Named Entity recognition, Speech Recognition/Understanding, Information Extraction, Information Retrieval |
Full paper  |
An Analysis of the Performances of the CasEN Named Entities Recognition System in the Ester2 Evaluation Campaign |
Bibtex |
@InProceedings{NOUVEL10.865,
author = {Damien Nouvel, Jean-Yves Antoine, Nathalie Friburger and Denis Maurel}, title = {An Analysis of the Performances of the CasEN Named Entities Recognition System in the Ester2 Evaluation Campaign}, booktitle = {Proceedings of the Seventh conference on International Language Resources and Evaluation (LREC'10)}, year = {2010}, month = {may}, date = {19-21}, address = {Valletta, Malta}, editor = {Nicoletta Calzolari (Conference Chair), Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odjik, Stelios Piperidis, Mike Rosner, Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-6-7}, language = {english} } |