Summary of the paper
| Title | Evaluating Query Languages for a Corpus Processing System |
|---|---|
| Authors | Elena Frick, Carsten Schnober and Piotr Bański |
| Abstract | This paper documents a pilot study conducted as part of the development of a new corpus processing system at the Institut für Deutsche Sprache in Mannheim and in the context of the ISO TC37 SC4/WG6 activity on the suggested work item proposal “Corpus Query Lingua Franca”. We describe the first phase of our research: the initial formulation of functionality criteria for query language evaluation and the results of the application of these criteria to three representatives of corpus query languages, namely COSMAS II, Poliqarp, and ANNIS QL. In contrast to previous works on query language evaluation that compare a range of existing query languages against a small number of queries, our approach analyses only three query languages against criteria derived from a suite of 300 use cases that cover diverse aspects of linguistic research. |
| Topics | Evaluation methodologies, Information Extraction, Information Retrieval, LR Infrastructures and Architectures |
Full paper  |
Evaluating Query Languages for a Corpus Processing System |
| Bibtex | @InProceedings{FRICK12.800, author = {Elena Frick and Carsten Schnober and Piotr Bański}, title = {Evaluating Query Languages for a Corpus Processing System}, booktitle = {Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC'12)}, year = {2012}, month = {may}, date = {23-25}, address = {Istanbul, Turkey}, editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Thierry Declerck and Mehmet Uğur Doğan and Bente Maegaard and Joseph Mariani and Asuncion Moreno and Jan Odijk and Stelios Piperidis}, publisher = {European Language Resources Association (ELRA)}, isbn = {978-2-9517408-7-7}, language = {english} } |