LREC COLING 2024 Proceedings Home | Workshops | Tutorials | LREC Proceedings | ELRA Website | ICCL Website


3rd Workshop on Perspectivist Approaches to NLP (NLPerspectives)


Full proceedings volume (PDF) | Workshop Site | Home | Programme | Author index | Bibliography (BibTeX) | Editors

PROGRAM

Tuesday, May 21, 2024

09:00–09:30Introduction
09:30–10:30First Keynote
10:30–11:00Coffee Break
11:00–13:30Short Talks and Poster Session
 Is a picture of a bird a bird? A mixed-methods approach to understanding diverse human perspectives and ambiguity in machine vision models
Alicia Parrish, Susan Hao, Sarah Laszlo and Lora Aroyo
 Wisdom of Instruction-Tuned Language Model Crowds. Exploring Model Label Variation
Flor Miriam Plaza-del-Arco, Debora Nozza and Dirk Hovy
 Exploring Cross-Cultural Differences in English Hate Speech Annotations: From Dataset Construction to Analysis
Nayeon Lee, Chani Jung, Junho Myung, Jiho Jin, Jose Camacho-Collados, Juho Kim and Alice Oh
 Revisiting Annotation of Online Gender-Based Violence
Gavin Abercrombie, Nikolas Vitsakis, Aiqi Jiang and Ioannis Konstas
 Confidence-based Ensembling of Perspective-aware Models
Silvia Casola, Soda Marem Lo, Valerio Basile, Simona Frenda, Alessandra Teresa Cignarella, Viviana Patti and Cristina Bosco
 A Perspectivist Corpus of Numbers in Social Judgements
Marlon May, Lucie Flek and Charles Welch
 An Overview of Recent Approaches to Enable Diversity in Large Language Models through Aligning with Human Perspectives
Benedetta Muscato, Chandana Sree Mala, Marta Marchiori Manerba, Gizem Gezici and Fosca Giannotti
 Federated Learning for Exploiting Annotators’ Disagreements in Natural Language Processing
Nuria Rodríguez Barroso, Eugenio Martínez Cámara, Jose Camacho-Collados, M. Victoria Luzón and Francisco Herrera
 Disagreement in Argumentation Annotation
Anna Lindahl
 Moral Disagreement over Serious Matters: Discovering the Knowledge Hidden in the Perspectives
Anny D. Alvarez Nogales and Oscar Araque
 Perspectives on Hate: General vs. Domain-Specific Models
Giulia Rizzi, Michele Fontana and Elisabetta Fersini
 Soft metrics for evaluation with disagreements: an assessment
Giulia Rizzi, Elisa Leonardelli, Massimo Poesio, Alexandra Uma, Maja Pavlovic, Silviu Paun, Paolo Rosso and Elisabetta Fersini
 Designing NLP Systems That Adapt to Diverse Worldviews
Claudiu Creanga and Liviu P. Dinu
 The Effectiveness of LLMs as Annotators: A Comparative Overview and Empirical Analysis of Direct Representation
Maja Pavlovic and Massimo Poesio
 What Does Perspectivism Mean? An Ethical and Methodological Countercriticism
Mathieu Valette
 Consistency is Key: Disentangling Label Variation in Natural Language Processing with Intra-Annotator Agreement
Gavin Abercrombie, Amanda Cercas Curry, Tanvi Dinkar, Verena Rieser and Dirk Hovy
13:30–15:00Lunch Break
15:00–16:00Remote Presentations
 OrigamIM: A Dataset of Ambiguous Sentence Interpretations for Social Grounding and Implicit Language Understanding
Liesbeth Allein and Marie-Francine Moens
 Linguistic Fingerprint in Transformer Models: How Language Variation Influences Parameter Selection in Irony Detection
Michele Mastromattei and Fabio Massimo Zanzotto
 Intersectionality in AI Safety: Using Multilevel Models to Understand Diverse Perceptions of Safety in Conversational AI
Christopher Homan, Gregory Serapio-Garcia, Lora Aroyo, Mark Diaz, Alicia Parrish, Vinodkumar Prabhakaran, Alex Taylor and Ding Wang
 Quantifying the Persona Effect in LLM Simulations
Tiancheng Hu and Nigel Collier
 A Dataset for Multi-Scale Film Rating Inference from Reviews
Frankie Robertson and Stefano Leone
 Towards Situated Evaluation for Perspectivist Machine Learning Problems: A Pilot Study of Image Aesthetic Quality Assessment.
Samuel Goree and David Crandall
16:00–16:30Coffee Break
16:30–17:30Panel Discussion
17:30–18:00Wrapup and Close