LREC 2000 - Papers

LREC 2000 2^nd International Conference on Language Resources & Evaluation

Conference Papers

Papers by paper title: A B C D E F G H I J K L M N O P Q R S T U V W X Y Z

Papers by ID number: 1-50, 51-100, 101-150, 151-200, 201-250, 251-300, 301-350, 351-377.

List of all papers and abstracts.

Previous Paper Next Paper

Title Evaluating Multi-party Multi-modal Systems

Authors Damianos Laurie E. (The MITRE Corporation, 202 Burlington Road;Bedford,MA 01730 USA, laurie@mitre.org)
Drury Jill (The MITRE Corporation, 202 Burlington Road;Bedford,MA 01730 USA, jldrury@mitre.org)
Fanderclai Tari (The MITRE Corporation, 202 Burlington Road;Bedford,MA 01730 USA, tari@nwe.ufl.edu)
Hirschman Lynette (The MITRE Corporation, 202 Burlington Road;Bedford,MA 01730 USA, lynette@mitre.org)
Oshika Beatrice (The MITRE Corporation, 202 Burlington Road;Bedford,MA 01730 USA, bea@mitre.org)

Keywords Cenario, Collaborative System, Data Visualization, Evaluation Methodology, Human-Computer Interaction, Metrics, Usability

Session Session SO6 - Recognition

Abstract The MITRE Corporation ’s Evaluation Working Group has developed a methodology for evaluating multi-modal groupware systems and capturing data on human-human interactions.The methodology consists of a framework for describing collaborative systems, scenario-based evaluation approach,and evaluation metrics for the various components of collaborative systems.We designed and ran two sets of experiments to validate the methodology by evaluating collaborative systems.In one experiment,we compared two configurations of a multi-modal collaborative application using a map navigation scenario requiring information sharing and decision making.In the second experiment,we pplied the evaluation methodology to a loosely integrated set of collaborative tools,again using a scenario-based approach.In both experiments,multi-modal,multi-user data were collected,visualized,annotated,and analyzed.

t face="Verdana">

Title	Evaluating Multi-party Multi-modal Systems
Authors	Damianos Laurie E. (The MITRE Corporation, 202 Burlington Road;Bedford,MA 01730 USA, laurie@mitre.org) Drury Jill (The MITRE Corporation, 202 Burlington Road;Bedford,MA 01730 USA, jldrury@mitre.org) Fanderclai Tari (The MITRE Corporation, 202 Burlington Road;Bedford,MA 01730 USA, tari@nwe.ufl.edu) Hirschman Lynette (The MITRE Corporation, 202 Burlington Road;Bedford,MA 01730 USA, lynette@mitre.org) Oshika Beatrice (The MITRE Corporation, 202 Burlington Road;Bedford,MA 01730 USA, bea@mitre.org)
Keywords	Cenario, Collaborative System, Data Visualization, Evaluation Methodology, Human-Computer Interaction, Metrics, Usability
Session	Session SO6 - Recognition
Abstract	The MITRE Corporation ’s Evaluation Working Group has developed a methodology for evaluating multi-modal groupware systems and capturing data on human-human interactions.The methodology consists of a framework for describing collaborative systems, scenario-based evaluation approach,and evaluation metrics for the various components of collaborative systems.We designed and ran two sets of experiments to validate the methodology by evaluating collaborative systems.In one experiment,we compared two configurations of a multi-modal collaborative application using a map navigation scenario requiring information sharing and decision making.In the second experiment,we pplied the evaluation methodology to a loosely integrated set of collaborative tools,again using a scenario-based approach.In both experiments,multi-modal,multi-user data were collected,visualized,annotated,and analyzed.