Critical remarks on the Italian research assessment exercise VQR 2011–2014

Franceschini, Fiorenzo; Maisano, DOMENICO AUGUSTO FRANCESCO

doi:10.1016/j.joi.2017.02.005

PORTO @ Archivio Istituzionale della Ricerca

IRIS è la soluzione IT che facilita la raccolta e la gestione dei dati relativi alle attività e ai prodotti della ricerca. Fornisce a ricercatori, amministratori e valutatori gli strumenti per monitorare i risultati della ricerca, aumentarne la visibilità e allocare in modo efficace le risorse disponibili.

For nearly a decade, several national exercises have been implemented for assessing the Italian research performance, from the viewpoint of universities and other research institutions. The penultimate one – i.e., the VQR 2004–2010, which adopted a hybrid evaluation approach based on bibliometric analysis and peer review – suffered heavy criticism at a national and international level. The architecture of the subsequent exercise – i.e., the VQR 2011–2014, still in progress – is partly similar to that of the previous one, except for a few presumed improvements. Nevertheless, this other exercise is suffering heavy criticism too. This paper presents a structured discussion of the VQR 2011–2014, collecting and organizing some critical arguments so far emerged, and developing them in detail. Some of the major vulnerabilities of the VQR 2011–2014 are: (1) the fact that evaluations cover a relatively small fraction of the scientific publications produced by the researchers involved in the evaluation, (2) incorrect and anachronistic use of the journal metrics (i.e., ISI Impact Factor and similar ones) for assessing individual papers, and (3) conceptually misleading criteria for normalizing and aggregating the bibliometric indicators in use.

Titolo:	Critical remarks on the Italian research assessment exercise VQR 2011–2014
Autori:	FRANCESCHINI, FIORENZO MAISANO, DOMENICO AUGUSTO FRANCESCO
Data di pubblicazione:	2017
Rivista:	JOURNAL OF INFORMETRICS
Digital Object Identifier (DOI):	10.1016/j.joi.2017.02.005
Appare nelle tipologie:	1.1 Articolo in rivista

File in questo prodotto:

File	Descrizione	Tipologia	Licenza
INFORMETRICS VQR Revised_JOI_2016_273.R1 (08-02-2017) no Yellow.pdf	INFORMETRICS VQR Revised_JOI_2016_273.R1 (08-02-2017) no Yellow	2. Post-print		Visibile a tuttiVisualizza/Apri
INFORMETRICS v.11 n.2, 2017 pp.337-357 VQR 11-14 (FF DM).pdf	INFORMETRICS v.11 n.2, 2017 pp.337-357 VQR 11-14 (FF DM)	2. Post-print	Non Pubblico - Accesso privato/ristretto	Administrator Richiedi una copia

Utilizza questo identificativo per citare o creare un link a questo documento:
http://hdl.handle.net/11583/2666081

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.