Summary of the paper
| Title | Evaluation of Classification Algorithms and Features for Collocation Extraction in Croatian |
|---|---|
| Authors | Mladen Karan, Jan Šnajder and Bojana Dalbelo Bašić |
| Abstract | Collocations can be defined as words that occur together significantly more often than it would be expected by chance. Many natural language processing applications such as natural language generation, word sense disambiguation and machine translation can benefit from having access to information about collocated words. We approach collocation extraction as a classification problem where the task is to classify a given n-gram as either a collocation (positive) or a non-collocation (negative). Among the features used are word frequencies, classical association measures (Dice, PMI, chi2), and POS tags. In addition, semantic word relatedness modeled by latent semantic analysis is also included. We apply wrapper feature subset selection to determine the best set of features. Performance of various classification algorithms is tested. Experiments are conducted on a manually annotated set of bigrams and trigrams sampled from a Croatian newspaper corpus. Best results obtained are 79.8 F1 measure for bigrams and 67.5 F1 measure for trigrams. The best classifier for bigrams was SVM, while for trigrams the decision tree gave the best performance. Features which contributed the most to overall performance were PMI, semantic relatedness, and POS information. |
| Topics | MultiWord Expressions & Collocations, Statistical and machine learning methods, Semantics |
Full paper  |
Evaluation of Classification Algorithms and Features for Collocation Extraction in Croatian |
| Bibtex | @InProceedings{KARAN12.796, author = {Mladen Karan and Jan Šnajder and Bojana Dalbelo Bašić}, title = {Evaluation of Classification Algorithms and Features for Collocation Extraction in Croatian}, booktitle = {Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC'12)}, year = {2012}, month = {may}, date = {23-25}, address = {Istanbul, Turkey}, editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Thierry Declerck and Mehmet Uğur Doğan and Bente Maegaard and Joseph Mariani and Asuncion Moreno and Jan Odijk and Stelios Piperidis}, publisher = {European Language Resources Association (ELRA)}, isbn = {978-2-9517408-7-7}, language = {english} } |