Summary of the paper
| Title | Djangology: A Light-weight Web-based Tool for Distributed Collaborative Text Annotation |
|---|---|
| Authors | Emilia Apostolova, Sean Neilan, Gary An, Noriko Tomuro and Steven Lytinen |
| Abstract | Manual text annotation is a resource-consuming endeavor necessary for NLPsystems when they target new tasks or domains for which there are no existingannotated corpora. Distributing the annotation work across multiplecontributors is a natural solution to reduce and manage the effort required.Although there are a few publicly available tools which support distributedcollaborative text annotation, most of them have complex user interfaces andrequire a significant amount of involvement from the annotators/contributors aswell as the project developers and administrators. We present a light-weightweb application for highly distributed annotation projects - Djangology. Theapplication takes advantage of the recent advances in web frameworkarchitecture that allow rapid development and deployment of web applicationsthus minimizing development time for customization. The application's web-basedinterface gives project administrators the ability to easily upload data,define project schemas, assign annotators, monitor progress, and reviewinter-annotator agreement statistics. The intuitive web-based user interfaceencourages annotator participation as contributors are not burdened by toolmanuals, local installation, or configuration. The system has achieved a userresponse rate of 70% in two annotation projects involving more than 250 medicalexperts from various geographic locations. |
| Language | Usability, user satisfaction |
| Topics | Tools, systems, applications, Corpus (creation, annotation, etc.), Usability, user satisfaction |
Full paper  |
Djangology: A Light-weight Web-based Tool for Distributed Collaborative Text Annotation |
| Bibtex | @InProceedings{APOSTOLOVA10.543, author = {Emilia Apostolova, Sean Neilan, Gary An, Noriko Tomuro and Steven Lytinen}, title = {Djangology: A Light-weight Web-based Tool for Distributed Collaborative Text Annotation}, booktitle = {Proceedings of the Seventh conference on International Language Resources and Evaluation (LREC'10)}, year = {2010}, month = {may}, date = {19-21}, address = {Valletta, Malta}, editor = {Nicoletta Calzolari (Conference Chair), Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odjik, Stelios Piperidis, Mike Rosner, Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-6-7}, language = {english} } |