Summary of the paper
| Title | Tag Dictionaries Accelerate Manual Annotation |
|---|---|
| Authors | Marc Carmen, Paul Felt, Robbie Haertel, Deryle Lonsdale, Peter McClanahan, Owen Merkling, Eric Ringger and Kevin Seppi |
| Abstract | Expert human input can contribute in various ways to facilitate automaticannotation of natural language text. For example, a part-of-speech tagger canbe trained on labeled input provided offline by experts. In addition, expertinput can be solicited by way of active learning to make the most of annotatorexpertise. However, hiring individuals to perform manual annotation is costlyboth in terms of money and time. This paper reports on a user study that wasperformed to determine the degree of effect that a part-of-speech dictionaryhas on a group of subjects performing the annotation task. The user study wasconducted using a modular, web-based interface created specifically for textannotation tasks. The user study found that for both native and non-nativeEnglish speakers a dictionary with greater than 60% coverage was effective atreducing annotation time and increasing annotator accuracy. On the basis ofthis study, we predict that using a part-of-speech tag dictionary with coveragegreater than 60% can reduce the cost of annotation in terms of both time andmoney. |
| Language | Tools, systems, applications |
| Topics | Corpus (creation, annotation, etc.), Part of speech tagging, Tools, systems, applications |
Full paper  |
Tag Dictionaries Accelerate Manual Annotation |
| Bibtex | @InProceedings{CARMEN10.451, author = {Marc Carmen, Paul Felt, Robbie Haertel, Deryle Lonsdale, Peter McClanahan, Owen Merkling, Eric Ringger and Kevin Seppi}, title = {Tag Dictionaries Accelerate Manual Annotation}, booktitle = {Proceedings of the Seventh conference on International Language Resources and Evaluation (LREC'10)}, year = {2010}, month = {may}, date = {19-21}, address = {Valletta, Malta}, editor = {Nicoletta Calzolari (Conference Chair), Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odjik, Stelios Piperidis, Mike Rosner, Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-6-7}, language = {english} } |