Summary of the paper
| Title | Evaluating Web-as-corpus Topical Document Retrieval with an Index of the OpenDirectory |
|---|---|
| Authors | Clément De Groc and Xavier Tannier |
| Abstract | This article introduces a novel protocol and resource to evaluate Web-as-corpus topical document retrieval. To the contrary of previous work, our goal is to provide an automatic, reproducible and robust evaluation for this task. We rely on the OpenDirectory (DMOZ) as a source of topically annotated webpages and index them in a search engine. With this OpenDirectory search engine, we can then easily evaluate the impact of various parameters such as the number of seed terms, queries or documents, or the usefulness of various term selection algorithms. A first fully automatic evaluation is described and provides baseline performances for this task. The article concludes with practical information regarding the availability of the index and resource files. |
| Topics | |
Full paper  |
Evaluating Web-as-corpus Topical Document Retrieval with an Index of the OpenDirectory |
| Bibtex | @InProceedings{DEGROC14.980, author = {Clément De Groc and Xavier Tannier}, title = {Evaluating Web-as-corpus Topical Document Retrieval with an Index of the OpenDirectory}, booktitle = {Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14)}, year = {2014}, month = {may}, date = {26-31}, address = {Reykjavik, Iceland}, editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Thierry Declerck and Hrafn Loftsson and Bente Maegaard and Joseph Mariani and Asuncion Moreno and Jan Odijk and Stelios Piperidis}, publisher = {European Language Resources Association (ELRA)}, isbn = {978-2-9517408-8-4}, language = {english} } |