Summary of the paper
| Title | Discosuite - A Parser Test Suite for German Discontinuous Structures |
|---|---|
| Authors | Wolfgang Maier, Miriam Kaeshammer, Peter Baumann and Sandra Kübler |
| Abstract | Parser evaluation traditionally relies on evaluation metrics which deliver a single aggregate score over all sentences in the parser output, such as PARSEVAL. However, for the evaluation of parser performance concerning a particular phenomenon, a test suite of sentences is needed in which this phenomenon has been identified. In recent years, the parsing of discontinuous structures has received a rising interest. Therefore, in this paper, we present a test suite for testing the performance of dependency and constituency parsers on non-projective dependencies and discontinuous constituents for German. The test suite is based on the newly released TIGER treebank version 2.2. It provides a unique possibility of benchmarking parsers on non-local syntactic relationships in German, for constituents and dependencies. We include a linguistic analysis of the phenomena that cause discontinuity in the TIGER annotation, thereby closing gaps in previous literature. The linguistic phenomena we investigate include extraposition, a placeholder/repeated element construction, topicalization, scrambling, local movement, parentheticals, and fronting of pronouns. |
| Topics | Grammar and Syntax, Evaluation Methodologies |
Full paper  |
Discosuite - A Parser Test Suite for German Discontinuous Structures |
| Bibtex | @InProceedings{MAIER14.230, author = {Wolfgang Maier and Miriam Kaeshammer and Peter Baumann and Sandra Kübler}, title = {Discosuite - A Parser Test Suite for German Discontinuous Structures}, booktitle = {Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14)}, year = {2014}, month = {may}, date = {26-31}, address = {Reykjavik, Iceland}, editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Thierry Declerck and Hrafn Loftsson and Bente Maegaard and Joseph Mariani and Asuncion Moreno and Jan Odijk and Stelios Piperidis}, publisher = {European Language Resources Association (ELRA)}, isbn = {978-2-9517408-8-4}, language = {english} } |