Summary of the paper
| Title | The Impact of Task and Corpus on Event Extraction Systems |
|---|---|
| Authors | Ralph Grishman |
| Abstract | The term “event extraction” covers a wide range of information extractiontasks, and methods developed and evaluated for one task may prove quiteunsuitable for another. Understanding these task differences is essential tomaking broad progress in event extraction. We look back at the MUC and ACEtasks in terms of one characteristic, the breadth of the scenario ― how widea range of information is subsumed in a single extraction task. We examine howthis affects strategies for collecting information and methods forsemi-supervised training of new extractors. We also consider the heterogeneityof corpora ― how varied the topics of documents in a corpus are. Extractionsystems may be intended in principle for general news but are typicallyevaluated on topic-focused corpora, and this evaluation context may affectsystem design. As one case study, we examine the task of identifying physicalattack events in news corpora, observing the effect on system performance ofshifting from an attack-event-rich corpus to a more varied corpus andconsidering how the impact of this shift may be mitigated. |
| Language | |
| Topics | Information Extraction, Information Retrieval |
Full paper  |
The Impact of Task and Corpus on Event Extraction Systems |
| Bibtex | @InProceedings{GRISHMAN10.565, author = {Ralph Grishman}, title = {The Impact of Task and Corpus on Event Extraction Systems}, booktitle = {Proceedings of the Seventh conference on International Language Resources and Evaluation (LREC'10)}, year = {2010}, month = {may}, date = {19-21}, address = {Valletta, Malta}, editor = {Nicoletta Calzolari (Conference Chair), Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odjik, Stelios Piperidis, Mike Rosner, Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-6-7}, language = {english} } |