Summary of the paper
| Title | Vox Populi Annotation: Measuring Intensity of Ideological Perspectives by Aggregating Group Judgments |
|---|---|
| Authors | Wei-Hao Lin and Alexander Hauptmann |
| Abstract | Polarizing discussions about political and social issues are common in mass media. Annotations on the degree to which a sentence expresses an ideological perspective can be valuable for evaluating computer programs that can automatically identify strongly biased sentences, but such annotations remain scarce. We annotated the intensity of ideological perspectives expressed in 250 sentences by aggregating judgments from 18 annotators. We proposed methods of determining the number of annotators and assessing reliability, and showed the annotations were highly consistent across different annotator groups. |
| Language | Language-independent |
| Topics | Corpus (creation, annotation, etc.), Discourse, Statistical methods |
Full paper |
Vox Populi Annotation: Measuring Intensity of Ideological Perspectives by Aggregating Group Judgments |
Slides |
Vox Populi Annotation: Measuring Intensity of Ideological Perspectives by Aggregating Group Judgments |
| Bibtex | @InProceedings{LIN08.600, author = {Wei-Hao Lin and Alexander Hauptmann}, title = {Vox Populi Annotation: Measuring Intensity of Ideological Perspectives by Aggregating Group Judgments}, booktitle = {Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC'08)}, year = {2008}, month = {may}, date = {28-30}, address = {Marrakech, Morocco}, editor = {Nicoletta Calzolari (Conference Chair), Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odijk, Stelios Piperidis, Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-4-0}, note = {http://www.lrec-conf.org/proceedings/lrec2008/}, language = {english} } |