Summary of the paper
| Title | Building a Domain-specific Document Collection for Evaluating Metadata Effects on Information Retrieval |
|---|---|
| Authors | Walid Magdy, Jinming Min, Johannes Leveling and Gareth J. F. Jones |
| Abstract | This paper describes the development of a structured document collection containing user-generated text and numerical metadata for exploring the exploitation of metadata in information retrieval (IR). The collection consists of more than 61,000 documents extracted from YouTube video pages on basketball in general and NBA (National Basketball Association) in particular, together with a set of 40 topics and their relevance judgements. In addition, a collection of nearly 250,000 user profiles related to the NBA collection is available. Several baseline IR experiments report the effect of using video-associated metadata on retrieval effectiveness. The results surprisingly show that searching the videos titles only performs significantly better than searching additional metadata text fields of the videos such as the tags or the description. |
| Topics | Metadata, Information Extraction, Information Retrieval, Multimedia Document Processing |
Full paper |
Building a Domain-specific Document Collection for Evaluating Metadata Effects on Information Retrieval |
Slides |
Building a Domain-specific Document Collection for Evaluating Metadata Effects on Information Retrieval |
| Bibtex | @InProceedings{MAGDY10.353, author = {Walid Magdy and Jinming Min and Johannes Leveling and Gareth J. F. Jones}, title = {Building a Domain-specific Document Collection for Evaluating Metadata Effects on Information Retrieval}, booktitle = {Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC'10)}, year = {2010}, month = {may}, date = {19-21}, address = {Valletta, Malta}, editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Bente Maegaard and Joseph Mariani and Jan Odijk and Stelios Piperidis and Mike Rosner and Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-6-7}, language = {english} } |