Neidio i’r brif dudalen lywio Neidio i chwilio Neidio i’r prif gynnwys

Leveraging Large Language Models in Detecting Anti-LGBTQIA+ User-generated Texts

  • University of Technology, Sydney
  • The University of Melbourne
  • RMIT University, Melbourne

Allbwn ymchwil: Pennod mewn Llyfr/Adroddiad/Trafodion Cynhadledd › Cyfraniad i Gynhadledd › adolygiad gan gymheiriaid

Crynodeb

Anti-LGBTQIA+ texts in user-generated content pose significant risks to online safety and inclusivity. This study investigates the capabilities and limitations of five widely adopted Large Language Models (LLMs)---DeepSeek-V3, GPT-4o, GPT-4o-mini, GPT-o1-mini, and Llama3.3-70B---in detecting such harmful content. Our findings reveal that while LLMs demonstrate potential in identifying offensive language, their effectiveness varies across models and metrics, with notable shortcomings in calibration. Furthermore, linguistic analysis exposes deeply embedded patterns of discrimination, reinforcing the urgency for improved detection mechanisms for this marginalised population. In summary, this study demonstrates the significant potential of LLMs for practical application in detecting anti-LGBTQIA+ user-generated texts and provides valuable insights from text analysis that can inform topic modelling. These findings contribute to developing safer digital platforms and enhancing protection for LGBTQIA+ individuals.
Iaith wreiddiolSaesneg
TeitlProceedings of the Queer in AI Workshop
GolygyddionA Pranav, Alissa Valentine, Shaily Bhatt, Yanan Long, Arjun Subramonian, Amanda Bertsch, Anne Lauscher, Ankush Gupta
Man cyhoeddiHybrid format (in-person and virtual)
CyhoeddwrAssociation for Computational Linguistics
Tudalennau26-34
Nifer y tudalennau9
ISBN (Electronig)979-8-89176-244-2
ISBN (Argraffiad)979-8-89176-244-2
Dynodwyr Gwrthrych Digidol (DOIs)
StatwsCyhoeddwyd - 1 Mai 2025

Ôl bys

Gweld gwybodaeth am bynciau ymchwil 'Leveraging Large Language Models in Detecting Anti-LGBTQIA+ User-generated Texts'. Gyda’i gilydd, maen nhw’n ffurfio ôl bys unigryw.

Dyfynnu hyn