Summary of the paper

Title Djangology: A Light-weight Web-based Tool for Distributed Collaborative Text Annotation
Authors Emilia Apostolova, Sean Neilan, Gary An, Noriko Tomuro and Steven Lytinen
Abstract Manual text annotation is a resource-consuming endeavor necessary for NLP systems when they target new tasks or domains for which there are no existing annotated corpora. Distributing the annotation work across multiple contributors is a natural solution to reduce and manage the effort required. Although there are a few publicly available tools which support distributed collaborative text annotation, most of them have complex user interfaces and require a significant amount of involvement from the annotators/contributors as well as the project developers and administrators. We present a light-weight web application for highly distributed annotation projects - Djangology. The application takes advantage of the recent advances in web framework architecture that allow rapid development and deployment of web applications thus minimizing development time for customization. The application's web-based interface gives project administrators the ability to easily upload data, define project schemas, assign annotators, monitor progress, and review inter-annotator agreement statistics. The intuitive web-based user interface encourages annotator participation as contributors are not burdened by tool manuals, local installation, or configuration. The system has achieved a user response rate of 70% in two annotation projects involving more than 250 medical experts from various geographic locations.
Topics Tools, systems, applications, Corpus (creation, annotation, etc.), Usability, user satisfaction
Full paper Djangology: A Light-weight Web-based Tool for Distributed Collaborative Text Annotation
Slides -
Bibtex @InProceedings{APOSTOLOVA10.543,
  author = {Emilia Apostolova and Sean Neilan and Gary An and Noriko Tomuro and Steven Lytinen},
  title = {Djangology: A Light-weight Web-based Tool for Distributed Collaborative Text Annotation},
  booktitle = {Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC'10)},
  year = {2010},
  month = {may},
  date = {19-21},
  address = {Valletta, Malta},
  editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Bente Maegaard and Joseph Mariani and Jan Odijk and Stelios Piperidis and Mike Rosner and Daniel Tapias},
  publisher = {European Language Resources Association (ELRA)},
  isbn = {2-9517408-6-7},
  language = {english}
 }
Powered by ELDA © 2010 ELDA/ELRA