Summary of the paper
| Title | Off-Road LAF: Encoding and Processing Annotations in NLP Workflows |
|---|---|
| Authors | Emanuele Lapponi, Erik Velldal, Stephan Oepen and Rune Lain Knudsen |
| Abstract | The Linguistic Annotation Framework (LAF) provides an abstract data model for specifying interchange representations to ensure interoperability among different annotation formats. This paper describes an ongoing effort to adapt the LAF data model as the interchange representation in complex workflows as used in the Language Analysis Portal (LAP), an on-line and large-scale processing service that is developed as part of the Norwegian branch of the Common Language Resources and Technology Infrastructure (CLARIN) initiative. Unlike several related on-line processing environments, which predominantly instantiate a distributed architecture of web services, LAP achives scalability to potentially very large data volumes through integration with the Norwegian national e-Infrastructure, and in particular job sumission to a capacity compute cluster. This setup leads to tighter integration requirements and also calls for efficient, low-overhead communication of (intermediate) processing results with workflows. We meet these demands by coupling the LAF data model with a lean, non-redundant JSON-based interchange format and integration of an agile and performant NoSQL database, allowing parallel access from cluster nodes, as the central repository of linguistic annotation. |
| Topics | Standards for LRs, LR Infrastructures and Architectures |
Full paper  |
Off-Road LAF: Encoding and Processing Annotations in NLP Workflows |
| Bibtex | @InProceedings{LAPPONI14.978, author = {Emanuele Lapponi and Erik Velldal and Stephan Oepen and Rune Lain Knudsen}, title = {Off-Road LAF: Encoding and Processing Annotations in NLP Workflows}, booktitle = {Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14)}, year = {2014}, month = {may}, date = {26-31}, address = {Reykjavik, Iceland}, editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Thierry Declerck and Hrafn Loftsson and Bente Maegaard and Joseph Mariani and Asuncion Moreno and Jan Odijk and Stelios Piperidis}, publisher = {European Language Resources Association (ELRA)}, isbn = {978-2-9517408-8-4}, language = {english} } |