Title |
An Analysis of the Performances of the CasEN Named Entities Recognition System in the Ester2 Evaluation Campaign |
Authors |
Damien Nouvel, Jean-Yves Antoine, Nathalie Friburger and Denis Maurel |
Abstract |
In this paper, we present a detailed and critical analysis of the behaviour of the CasEN named entity recognition system during the French Ester2 evaluation campaign. In this project, CasEN has been confronted with the task of detecting and categorizing named entities in manual and automatic transcriptions of radio broadcastings. At first, we give a general presentation of the Ester2 campaign. Then, we describe our system, based on transducers. Next, we depict how systems were evaluated during this campaign and we report the main official results. Afterwards, we investigate in details the influence of some annotation biases which have significantly affected the estimation of the performances of systems. At last, we conduct an in-depth analysis of the effective errors of the CasEN system, providing us with some useful indications about phenomena that gave rise to errors (e.g. metonymy, encapsulation, detection of right boundaries) and are as many challenges for named entity recognition systems. |
Topics |
Named Entity recognition, Speech Recognition/Understanding, Information Extraction, Information Retrieval |
Full paper |
An Analysis of the Performances of the CasEN Named Entities Recognition System in the Ester2 Evaluation Campaign |
Slides |
- |
Bibtex |
@InProceedings{NOUVEL10.865,
author = {Damien Nouvel and Jean-Yves Antoine and Nathalie Friburger and Denis Maurel}, title = {An Analysis of the Performances of the CasEN Named Entities Recognition System in the Ester2 Evaluation Campaign}, booktitle = {Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC'10)}, year = {2010}, month = {may}, date = {19-21}, address = {Valletta, Malta}, editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Bente Maegaard and Joseph Mariani and Jan Odijk and Stelios Piperidis and Mike Rosner and Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-6-7}, language = {english} } |