Document types (DTs) - e.g., research articles, reviews, conference proceedings, letters, etc. - are not only used to classify scientific publications, but also to routinely guide inclusion-exclusion decisions in bibliometric assessments, often without adequate consideration of the quality of underlying content. This study examines DT-classification errors in Scopus and Web of Science (WoS), focusing on engineering/manufacturing publications. These errors - which may directly affect publication/citation counts, citation-impact indicators, and consequently academic evaluations and careers - are analyzed in a corpus of about 10,000 documents, using a recent semi-automated method. The results indicate that these errors, while occurring in several percentage points, are far from negligible. Furthermore, statistical analyses reveal systematic differences among publishers (e.g., Springer, Elsevier, Taylor & Francis, etc.), with some contributing more to errors, probably due to editorial styles or inconsistent metadata. This study provides insights for researchers, evaluators and database managers, highlighting the need for publisher-specific guidelines to enhance classification accuracy and reduce errors.
Document-type classification errors in bibliometric databases: Insights from the engineering/manufacturing field / Maisano, Domenico Augusto Francesco; Ferrara, Lucrezia; Franceschini, Fiorenzo. - ELETTRONICO. - 57:(2025), pp. 80-89. (Intervento presentato al convegno XVI Convegno dell'Associazione Italiana delle Tecnologie Manifatturiere (AITeM) tenutosi a Bari (Italy) nel 10-12 settembre 2025) [10.21741/9781644903735-10].
Document-type classification errors in bibliometric databases: Insights from the engineering/manufacturing field
Domenico Augusto MAISANO;Lucrezia FERRARA;Fiorenzo FRANCESCHINI
2025
Abstract
Document types (DTs) - e.g., research articles, reviews, conference proceedings, letters, etc. - are not only used to classify scientific publications, but also to routinely guide inclusion-exclusion decisions in bibliometric assessments, often without adequate consideration of the quality of underlying content. This study examines DT-classification errors in Scopus and Web of Science (WoS), focusing on engineering/manufacturing publications. These errors - which may directly affect publication/citation counts, citation-impact indicators, and consequently academic evaluations and careers - are analyzed in a corpus of about 10,000 documents, using a recent semi-automated method. The results indicate that these errors, while occurring in several percentage points, are far from negligible. Furthermore, statistical analyses reveal systematic differences among publishers (e.g., Springer, Elsevier, Taylor & Francis, etc.), with some contributing more to errors, probably due to editorial styles or inconsistent metadata. This study provides insights for researchers, evaluators and database managers, highlighting the need for publisher-specific guidelines to enhance classification accuracy and reduce errors.Pubblicazioni consigliate
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.
https://hdl.handle.net/11583/3003029
Attenzione
Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo