Large Language Models (LLMs) encode and reproduce social biases rooted in their training data, including biases associated with linguistic varieties. This work investigates whether GPT-4.1 mini exhibits stereotypes towards speakers of three Italian dialects - Neapolitan, Parmesan and Sicilian - compared to standard Italian, through three experiments covering job assignment, personality trait attribution and character scoring. Results show that the model systematically favours standard Italian across all three tasks, associating dialect speakers with lower-prestige occupations and negative social traits. Additionally, southern varieties are penalised more consistently than the northern one, reproducing patterns associated with anti-meridionalism, a historically grounded form of discrimination against southern Italians. Mitigation strategies based on role prompting and multistep critique pipelines partially reduce, but do not eliminate the observed bias. These findings suggest that dialectal bias is intrinsic to LLMs trained on data that reflect existing social hierarchies, extending beyond specific languages and cultures.

Measuring Linguistic Bias in LLMs Across I.N.P.S. (Italian, Neapolitan, Parmesan and Sicilian) Dialect Corpora / Ullasci, M., Rondina, M., Coppola, R., Giobergia, F., De Cesare, A., Di Gregorio, M., Giordano, G., Maddaloni, A.L., Mantione, S.. - (In corso di stampa). (FAIEMA 2026 L'Aquila (ITA) 09-11 September 2026).

Measuring Linguistic Bias in LLMs Across I.N.P.S. (Italian, Neapolitan, Parmesan and Sicilian) Dialect Corpora

Martina Ullasci;Marco Rondina;Riccardo Coppola;Flavio Giobergia;Adriano De Cesare;Matteo Di Gregorio;Giovanni Giordano;Anna Lisa Maddaloni;
In corso di stampa

Abstract

Large Language Models (LLMs) encode and reproduce social biases rooted in their training data, including biases associated with linguistic varieties. This work investigates whether GPT-4.1 mini exhibits stereotypes towards speakers of three Italian dialects - Neapolitan, Parmesan and Sicilian - compared to standard Italian, through three experiments covering job assignment, personality trait attribution and character scoring. Results show that the model systematically favours standard Italian across all three tasks, associating dialect speakers with lower-prestige occupations and negative social traits. Additionally, southern varieties are penalised more consistently than the northern one, reproducing patterns associated with anti-meridionalism, a historically grounded form of discrimination against southern Italians. Mitigation strategies based on role prompting and multistep critique pipelines partially reduce, but do not eliminate the observed bias. These findings suggest that dialectal bias is intrinsic to LLMs trained on data that reflect existing social hierarchies, extending beyond specific languages and cultures.
In corso di stampa
File in questo prodotto:
File Dimensione Formato  
italian_dialects__FAIEMA.pdf

accesso riservato

Tipologia: 1. Preprint / submitted version [pre- review]
Licenza: Non Pubblico - Accesso privato/ristretto
Dimensione 3.12 MB
Formato Adobe PDF
3.12 MB Adobe PDF   Visualizza/Apri   Richiedi una copia
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11583/3015699