LREC 2000 2nd International Conference on Language Resources & Evaluation
 

Previous Paper   Next Paper

Title Design Issues in Text-Independent Speaker Recognition Evaluation
Authors Martin Alvin (National Institute of Standards and Technology, 100 Bureau Drive, Stop 8940, Gaithersburg, MD, 20899, USA, alvin.martin@nist.gov)
Przybocki Mark (National Institute of Standards and Technology, 100 Bureau Drive, Stop 8940, Gaithersburg, MD, 20899, USA, mark.przybocki@nist.gov)
Keywords Evaluation, NIST, Speaker Recognition, Text-independence
Session Session SO6 - Recognition
Full Paper 286.ps, 286.pdf
Abstract We discuss various considerations that have been involved in designing the past five annual NIST speaker recognition evaluations. These text-independent evaluations using conversational telephone speech have attracted state-of-the- art automatic systems from research sites around the world. The availability of appropriate data for sufficiently large test sets has been one key design consideration. There have also been variations in the specific task efinitions, the amount and type of training data provided, and the durations of the test segments. The microphone types of the handsets used, as well as the match or mismatch of training and test handsets, have been found to be important considerations that greatly affect system performance.