Large Language Models (LLMs) encode and reproduce social biases rooted in their training data, including biases associated with linguistic varieties. This work investigates whether GPT-4.1 mini exhibits stereotypes towards speakers of three Italian dialects - Neapolitan, Parmesan and Sicilian - compared to standard Italian, through three experiments covering job assignment, personality trait attribution and character scoring. Results show that the model systematically favours standard Italian across all three tasks, associating dialect speakers with lower-prestige occupations and negative social traits. Additionally, southern varieties are penalised more consistently than the northern one, reproducing patterns associated with anti-meridionalism, a historically grounded form of discrimination against southern Italians. Mitigation strategies based on role prompting and multistep critique pipelines partially reduce, but do not eliminate the observed bias. These findings suggest that dialectal bias is intrinsic to LLMs trained on data that reflect existing social hierarchies, extending beyond specific languages and cultures.
Measuring Linguistic Bias in LLMs Across I.N.P.S. (Italian, Neapolitan, Parmesan and Sicilian) Dialect Corpora / Ullasci, M., Rondina, M., Coppola, R., Giobergia, F., De Cesare, A., Di Gregorio, M., Giordano, G., Maddaloni, A.L., Mantione, S.. - (In corso di stampa). (FAIEMA 2026 L'Aquila (ITA) 09-11 September 2026).
Measuring Linguistic Bias in LLMs Across I.N.P.S. (Italian, Neapolitan, Parmesan and Sicilian) Dialect Corpora
Martina Ullasci;Marco Rondina;Riccardo Coppola;Flavio Giobergia;Adriano De Cesare;Matteo Di Gregorio;Giovanni Giordano;Anna Lisa Maddaloni;
In corso di stampa
Abstract
Large Language Models (LLMs) encode and reproduce social biases rooted in their training data, including biases associated with linguistic varieties. This work investigates whether GPT-4.1 mini exhibits stereotypes towards speakers of three Italian dialects - Neapolitan, Parmesan and Sicilian - compared to standard Italian, through three experiments covering job assignment, personality trait attribution and character scoring. Results show that the model systematically favours standard Italian across all three tasks, associating dialect speakers with lower-prestige occupations and negative social traits. Additionally, southern varieties are penalised more consistently than the northern one, reproducing patterns associated with anti-meridionalism, a historically grounded form of discrimination against southern Italians. Mitigation strategies based on role prompting and multistep critique pipelines partially reduce, but do not eliminate the observed bias. These findings suggest that dialectal bias is intrinsic to LLMs trained on data that reflect existing social hierarchies, extending beyond specific languages and cultures.| File | Dimensione | Formato | |
|---|---|---|---|
|
italian_dialects__FAIEMA.pdf
accesso riservato
Tipologia:
1. Preprint / submitted version [pre- review]
Licenza:
Non Pubblico - Accesso privato/ristretto
Dimensione
3.12 MB
Formato
Adobe PDF
|
3.12 MB | Adobe PDF | Visualizza/Apri Richiedi una copia |
Pubblicazioni consigliate
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.
https://hdl.handle.net/11583/3015699
