Summary of the paper
| Title | Identification of Rare & Novel Senses Using Translations in a Parallel Corpus |
|---|---|
| Authors | Richard Schwarz, Hinrich Schütze, Fabienne Martin and Achim Stein |
| Abstract | The identification of rare and novel senses is a challenge in lexicography. In this paper, we present a new method for finding such senses using a word aligned multilingual parallel corpus. We use the Europarl corpus and therein concentrate on French verbs. We represent each occurrence of a French verb as a high dimensional term vector. The dimensions of such a vector are the possible translations of the verb according to the underlying word alignment. The dimensions are weighted by a weighting scheme to adjust to the significance of any particular translation. After collecting these vectors we apply forms of the K-means algorithm on the resulting vector space to produce clusters of distinct senses, so that standard uses produce large homogeneous clusters while rare and novel uses appear in small or heterogeneous clusters. We show in a qualitative and quantitative evaluation that the method can successfully find rare and novel senses. |
| Topics | Tools, systems, applications, Lexicon, lexical database, Statistical and machine learning methods |
Full paper |
Identification of Rare & Novel Senses Using Translations in a Parallel Corpus |
Slides |
Identification of Rare & Novel Senses Using Translations in a Parallel Corpus |
| Bibtex | @InProceedings{SCHWARZ10.411, author = {Richard Schwarz and Hinrich Schütze and Fabienne Martin and Achim Stein}, title = {Identification of Rare & Novel Senses Using Translations in a Parallel Corpus}, booktitle = {Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC'10)}, year = {2010}, month = {may}, date = {19-21}, address = {Valletta, Malta}, editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Bente Maegaard and Joseph Mariani and Jan Odijk and Stelios Piperidis and Mike Rosner and Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-6-7}, language = {english} } |