Summary of the paper
| Title | Typical Cases of Annotators’ Disagreement in Discourse Annotations in Prague Dependency Treebank |
|---|---|
| Authors | Šárka Zikánová, Lucie Mladová, Jiří Mírovský and Pavlína Jínová |
| Abstract | In this paper, we present the first results of the parallel Czech discourseannotation in the Prague Dependency Treebank 2.0. Having established anannotation scenario for capturing semantic relations crossing the sentenceboundary in a discourse, and having annotated the first sections of thetreebank according to these guidelines, we report now on the results of thefirst evaluation of these manual annotations. We give an overview of theprocess of the annotation itself, which we believe is to a large degreelanguage-independent and therefore accessible to any discourse researcher.Next, we describe the inter-annotator agreement measurement, and, mostimportantly, we classify and analyze the most common types of annotators’disagreement and propose solutions for the next phase of the annotation. Theannotation is carried out on dependency trees (on the tectogrammatical layer),this approach is quite novel and it brings us some advantages when interpretingthe syntactic structure of the discourse units. |
| Language | Grammar and Syntax |
| Topics | Discourse annotation, representation and processing, Corpus (creation, annotation, etc.), Grammar and Syntax |
Full paper  |
Typical Cases of Annotators’ Disagreement in Discourse Annotations in Prague Dependency Treebank |
| Bibtex | @InProceedings{ZIKNOV10.762, author = {Šárka Zikánová, Lucie Mladová, Jiří Mírovský and Pavlína Jínová}, title = {Typical Cases of Annotators’ Disagreement in Discourse Annotations in Prague Dependency Treebank}, booktitle = {Proceedings of the Seventh conference on International Language Resources and Evaluation (LREC'10)}, year = {2010}, month = {may}, date = {19-21}, address = {Valletta, Malta}, editor = {Nicoletta Calzolari (Conference Chair), Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odjik, Stelios Piperidis, Mike Rosner, Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-6-7}, language = {english} } |