Summary of the paper
| Title | U-Compare: An Integrated Language Resource Evaluation Platform Including a Comprehensive UIMA Resource Library |
|---|---|
| Authors | Yoshinobu Kano, Ruben Dorado, Luke McCrohon, Sophia Ananiadou and Jun'ichi Tsujii |
| Abstract | Language resources, including corpus and tools, are normally required to be combined in order to achieve a user’s specific task. However, resources tend to be developed independently in different, incompatible formats. In this paper we describe about U-Compare, which consists of the U-Compare component repository and the U-Compare platform. We have been building a highly interoperable resource library, providing the world largest ready-to-use UIMA component repository including wide variety of corpus readers and state-of-the-art language tools. These resources can be deployed as local services or web services, even possible to be hosted in clustered machines to increase the performance, while users do not need to be aware of such differences. In addition to the resource library, an integrated language processing platform is provided, allowing workflow creation, comparison, evaluation and visualization, using the resources in the library or any UIMA component, without any programming via graphical user interfaces, while a command line launcher is also available without GUIs. The evaluation itself is processed in a UIMA component, users can create and plug their own evaluation metrics in addition to the predefined metrics. U-Compare has been successfully used in many projects including BioCreative, Conll and the BioNLP shared task. |
| Topics | LR Infrastructures and Architectures, Usability, user satisfaction, Tools, systems, applications |
Full paper |
U-Compare: An Integrated Language Resource Evaluation Platform Including a Comprehensive UIMA Resource Library |
Slides |
U-Compare: An Integrated Language Resource Evaluation Platform Including a Comprehensive UIMA Resource Library |
| Bibtex | @InProceedings{KANO10.307, author = {Yoshinobu Kano and Ruben Dorado and Luke McCrohon and Sophia Ananiadou and Jun'ichi Tsujii}, title = {U-Compare: An Integrated Language Resource Evaluation Platform Including a Comprehensive UIMA Resource Library}, booktitle = {Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC'10)}, year = {2010}, month = {may}, date = {19-21}, address = {Valletta, Malta}, editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Bente Maegaard and Joseph Mariani and Jan Odijk and Stelios Piperidis and Mike Rosner and Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-6-7}, language = {english} } |