Summary of the paper
| Title | A Ground Truth Dataset for Matching Culturally Diverse Romanized Person Names |
|---|---|
| Authors | Mark Arehart and Keith J Miller |
| Abstract | This paper describes the development of a ground truth dataset of culturally diverse Romanized names in which approximately 70,000 names are matched against a subset of 700. We ran the subset as queries against the complete list using several matchers, created adjudication pools, adjudicated the results, and compiled two versions of ground truth based on different sets of adjudication guidelines and methods for resolving adjudicator conflicts. The name list, drawn from publicly available sources, was manually seeded with over 1500 name variants. These names include transliteration variation, database fielding errors, segmentation differences, incomplete names, titles, initials, abbreviations, nicknames, typos, OCR errors, and truncated data. These diverse types of matches, along with the coincidental name similarities already in the list, make possible a comprehensive evaluation of name matching systems. We have used the dataset to evaluate several open source and commercial algorithms and provide some of those results. |
| Language | |
| Topics | Corpus (creation, annotation, etc.), Evaluation methodologies, Information Extraction, Information Retrieval |
Full paper |
A Ground Truth Dataset for Matching Culturally Diverse Romanized Person Names |
Slides |
- |
| Bibtex | @InProceedings{AREHART08.291, author = {Mark Arehart and Keith J Miller}, title = {A Ground Truth Dataset for Matching Culturally Diverse Romanized Person Names}, booktitle = {Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC'08)}, year = {2008}, month = {may}, date = {28-30}, address = {Marrakech, Morocco}, editor = {Nicoletta Calzolari (Conference Chair), Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odijk, Stelios Piperidis, Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-4-0}, note = {http://www.lrec-conf.org/proceedings/lrec2008/}, language = {english} } |