Aggregating the preferences of a group of experts is a recurring problem in several fields, including engineering design; in a nutshell, each expert formulates an ordinal ranking of a set of alternatives and the resulting rankings should be aggregated into a collective one. Many aggregation models have been proposed in the literature, showing strengths and weaknesses, in line with the implications of Arrow's impossibility theorem. Furthermore, the coherence of the collective ranking with respect to the expert rankings may change depending on: (i) the expert rankings themselves and (ii) the aggregation model adopted. This paper assesses this coherence for a variety of aggregation models, through a recent test based on the Kendall's coefficient of concordance (W), and studies the characteristics of those models that are most likely to achieve higher coherence. Interestingly, the so-called Borda count model often provides best coherence, with some exceptions in the case of collective rankings with ties. The description is supported by practical examples.

Aggregating multiple ordinal rankings in engineering design: the best model according to the Kendall’s coefficient of concordance / Franceschini, Fiorenzo; Maisano, DOMENICO AUGUSTO FRANCESCO. - In: RESEARCH IN ENGINEERING DESIGN. - ISSN 0934-9839. - STAMPA. - 32:1(2021), pp. 91-103. [10.1007/s00163-020-00348-3]

Aggregating multiple ordinal rankings in engineering design: the best model according to the Kendall’s coefficient of concordance

Fiorenzo Franceschini;Domenico Maisano
2021

Abstract

Aggregating the preferences of a group of experts is a recurring problem in several fields, including engineering design; in a nutshell, each expert formulates an ordinal ranking of a set of alternatives and the resulting rankings should be aggregated into a collective one. Many aggregation models have been proposed in the literature, showing strengths and weaknesses, in line with the implications of Arrow's impossibility theorem. Furthermore, the coherence of the collective ranking with respect to the expert rankings may change depending on: (i) the expert rankings themselves and (ii) the aggregation model adopted. This paper assesses this coherence for a variety of aggregation models, through a recent test based on the Kendall's coefficient of concordance (W), and studies the characteristics of those models that are most likely to achieve higher coherence. Interestingly, the so-called Borda count model often provides best coherence, with some exceptions in the case of collective rankings with ties. The description is supported by practical examples.
File in questo prodotto:
File Dimensione Formato  
Research Engineering Design v.32 n.1, 2021 pp.91-103 (Best Model according Kendall'W) - FF DM.pdf

accesso aperto

Descrizione: Research Engineering Design v.32 n.1, 2021 pp.91-103 (Best Model according Kendall'W)
Tipologia: 2a Post-print versione editoriale / Version of Record
Licenza: Creative commons
Dimensione 2.56 MB
Formato Adobe PDF
2.56 MB Adobe PDF Visualizza/Apri
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11583/2870247