Summary of the paper
| Title | Comparison of the Impact of Word Segmentation on Name Tagging for Chinese and Japanese |
|---|---|
| Authors | Haibo Li, Masato Hagiwara, Qi Li and Heng Ji |
| Abstract | Word Segmentation is usually considered an essential step for many Chinese and Japanese Natural Language Processing tasks, such as name tagging. This paper presents several new observations and analysis on the impact of word segmentation on name tagging; (1). Due to the limitation of current state-of-the-art Chinese word segmentation performance, a character-based name tagger can outperform its word-based counterparts for Chinese but not for Japanese; (2). It is crucial to keep segmentation settings (e.g. definitions, specifications, methods) consistent between training and testing for name tagging; (3). As long as (2) is ensured, the performance of word segmentation does not have appreciable impact on Chinese and Japanese name tagging. |
| Topics | Multilinguality, Information Extraction, Information Retrieval |
Full paper  |
Comparison of the Impact of Word Segmentation on Name Tagging for Chinese and Japanese |
| Bibtex | @InProceedings{LI14.358, author = {Haibo Li and Masato Hagiwara and Qi Li and Heng Ji}, title = {Comparison of the Impact of Word Segmentation on Name Tagging for Chinese and Japanese}, booktitle = {Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14)}, year = {2014}, month = {may}, date = {26-31}, address = {Reykjavik, Iceland}, editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Thierry Declerck and Hrafn Loftsson and Bente Maegaard and Joseph Mariani and Asuncion Moreno and Jan Odijk and Stelios Piperidis}, publisher = {European Language Resources Association (ELRA)}, isbn = {978-2-9517408-8-4}, language = {english} } |