Title |
Evaluation of parsed corpora: Experiments in user-transparent and user-visible evaluation |
Authors |
Diana Santos (SINTEF Tele og Data ) Caroline Gasperin, (Faculdade de Informática, PPGCC, PUCRS) |
Session |
EP1: Evaluation |
Abstract |
In the present paper, we describe and discuss the evaluation of parsed corpora, namely the ones that are available on the Web for querying in the AC/DC project. The paper has two parts: the first one suggests a set of different evaluation parameters and measures that are much more illuminating than commonly used simple precision measures, while the second evaluates the parsed corpus for a particular task -- that of automatic thesaurus building. The two evaluations are thus complementary, in that, in Gaizauskas (1998) terminology, the first is a typical user-transparent evaluation, while the second is user-visible. |
Keywords |
Parse evaluation, Parsed corpora, Portuguese, Semantic aquisition, Tagging |
Full Paper |