Summary of the paper

Title Vox Populi Annotation: Measuring Intensity of Ideological Perspectives by Aggregating Group Judgments
Authors Wei-Hao Lin and Alexander Hauptmann
Abstract Polarizing discussions about political and social issues are common in mass media. Annotations on the degree to which a sentence expresses an ideological perspective can be valuable for evaluating computer programs that can automatically identify strongly biased sentences, but such annotations remain scarce. We annotated the intensity of ideological perspectives expressed in 250 sentences by aggregating judgments from 18 annotators. We proposed methods of determining the number of annotators and assessing reliability, and showed the annotations were highly consistent across different annotator groups.
Language Language-independent
Topics Corpus (creation, annotation, etc.), Discourse, Statistical methods
Full paper Vox Populi Annotation: Measuring Intensity of Ideological Perspectives by Aggregating Group Judgments
Slides Vox Populi Annotation: Measuring Intensity of Ideological Perspectives by Aggregating Group Judgments
Bibtex @InProceedings{LIN08.600,
  author = {Wei-Hao Lin and Alexander Hauptmann},
  title = {Vox Populi Annotation: Measuring Intensity of Ideological Perspectives by Aggregating Group Judgments},
  booktitle = {Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC'08)},
  year = {2008},
  month = {may},
  date = {28-30},
  address = {Marrakech, Morocco},
  editor = {Nicoletta Calzolari (Conference Chair), Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odijk, Stelios Piperidis, Daniel Tapias},
  publisher = {European Language Resources Association (ELRA)},
  isbn = {2-9517408-4-0},
  note = {http://www.lrec-conf.org/proceedings/lrec2008/},
  language = {english}
  }

Powered by ELDA © 2008 ELDA/ELRA