Summary of the paper
| Title | Learning Language Identification Models: A Comparative Analysis of the Distinctive Features of Names and Common Words |
|---|---|
| Authors | Stasinos Konstantopoulos |
| Abstract | The intuition and basic hypothesis that this paper explores is that names are more characteristic of their language than common words are, and that a single name can have enough clues to confidently identify its language where random text of the same length wouldn't. To test this hypothesis, n-gramm modelling is used to learn language models which identify the language of isolated names and equally short document fragments. As the empirical results corroborate the prior intuition, an explanation is sought for the higher accuracy at which the language of names can be identified. The results of the application of these models, as well as the models themselves, are quantitatively and qualitatively analysed and a hypothesis is formed about the explanation of this difference. The conclusions derived are both technologically useful in information extraction or text-to-speech tasks, and theoretically interesting as a tool for improving our understanding of the morphology and phonology of the languages involved in the experiments. |
| Topics | Language Identification, Named Entity recognition, Information Extraction, Information Retrieval |
Full paper |
Learning Language Identification Models: A Comparative Analysis of the Distinctive Features of Names and Common Words |
Slides |
- |
| Bibtex | @InProceedings{KONSTANTOPOULOS10.452, author = {Stasinos Konstantopoulos}, title = {Learning Language Identification Models: A Comparative Analysis of the Distinctive Features of Names and Common Words}, booktitle = {Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC'10)}, year = {2010}, month = {may}, date = {19-21}, address = {Valletta, Malta}, editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Bente Maegaard and Joseph Mariani and Jan Odijk and Stelios Piperidis and Mike Rosner and Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-6-7}, language = {english} } |