Title |
Comparing Similarity Measures for Distributional Thesauri |
Authors |
Muntsa Padró, Marco Idiart, Aline Villavicencio and Carlos Ramisch |
Abstract |
Distributional thesauri have been applied for a variety of tasks involving semantic relatedness. In this paper, we investigate the impact of three parameters: similarity measures, frequency thresholds and association scores. We focus on the robustness and stability of the resulting thesauri, measuring inter-thesaurus agreement when testing different parameter values. The results obtained show that low-frequency thresholds affect thesaurus quality more than similarity measures, with more agreement found for increasing thresholds.These results indicate the sensitivity of distributional thesauri to frequency. Nonetheless, the observed differences do not transpose over extrinsic evaluation using TOEFL-like questions. While this may be specific to the task, we argue that a careful examination of the stability of distributional resources prior to application is needed. |
Topics |
Acquisition, Lexicon, Lexical Database |
Full paper |
Comparing Similarity Measures for Distributional Thesauri |
Bibtex |
@InProceedings{PADR14.619,
author = {Muntsa Padró and Marco Idiart and Aline Villavicencio and Carlos Ramisch}, title = {Comparing Similarity Measures for Distributional Thesauri}, booktitle = {Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14)}, year = {2014}, month = {may}, date = {26-31}, address = {Reykjavik, Iceland}, editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Thierry Declerck and Hrafn Loftsson and Bente Maegaard and Joseph Mariani and Asuncion Moreno and Jan Odijk and Stelios Piperidis}, publisher = {European Language Resources Association (ELRA)}, isbn = {978-2-9517408-8-4}, language = {english} } |