Summary of the paper
| Title | Partial Parsing as a Method to Expedite Dependency Annotation of a Hindi Treebank |
|---|---|
| Authors | Mridul Gupta, Vineet Yadav, Samar Husain and Dipti Misra Sharma |
| Abstract | The paper describes an approach to expedite the process of manual annotation ofa Hindi dependency treebank which is currently under development. We propose away by which consistency among a set of manual annotators could be improved.Furthermore, we show that our setup can also prove useful for evaluating whenan inexperienced annotator is ready to start participating in the production ofthe treebank. We test our approach on sample sets of data obtained from anongoing work on creation of this treebank. The results asserting our proposalare reported in this paper. We report results from a semi-automated approach ofdependency annotation experiment. We find out the rate of agreement betweenannotators using Cohen’s Kappa. We also compare results with respect to thetotal time taken to annotate sample data-sets using a completely manualapproach as opposed to a semi-automated approach. It is observed from theresults that this semi-automated approach when carried out with experienced andtrained human annotators improves the overall quality of treebank annotationand also speeds up the process. |
| Language | Evaluation methodologies |
| Topics | Tools, systems, applications, Corpus (creation, annotation, etc.), Evaluation methodologies |
Full paper  |
Partial Parsing as a Method to Expedite Dependency Annotation of a Hindi Treebank |
| Bibtex | @InProceedings{GUPTA10.739, author = {Mridul Gupta, Vineet Yadav, Samar Husain and Dipti Misra Sharma}, title = {Partial Parsing as a Method to Expedite Dependency Annotation of a Hindi Treebank}, booktitle = {Proceedings of the Seventh conference on International Language Resources and Evaluation (LREC'10)}, year = {2010}, month = {may}, date = {19-21}, address = {Valletta, Malta}, editor = {Nicoletta Calzolari (Conference Chair), Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odjik, Stelios Piperidis, Mike Rosner, Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-6-7}, language = {english} } |