A relevant question for the organization of large-scale research assessments is whether bibliometric eval-uation and informed peer review yield similar results. In this paper, we draw on the experience of thepanel that evaluated Italian research in Economics, Management and Statistics during the national assess-ment exercise (VQR) relative to the period 2004–2010. We exploit the unique opportunity of studying asample of 590 journal articles randomly drawn from a population of 5681 journal articles (out of nearly12,000 journal and non-journal publications), which the panel evaluated both by bibliometric analysisand by informed peer review. In the total sample we find fair to good agreement between informed peer-review and bibliometric analysis and absence of statistical bias between the two. We then discuss thenature, implications, and limitations of this correlation.

Bibliometric evaluation vs. informed peer review: evidence from Italy

GAMBARDELLA, ALFONSO;PERACCHI, FRANCO
2015

Abstract

A relevant question for the organization of large-scale research assessments is whether bibliometric eval-uation and informed peer review yield similar results. In this paper, we draw on the experience of thepanel that evaluated Italian research in Economics, Management and Statistics during the national assess-ment exercise (VQR) relative to the period 2004–2010. We exploit the unique opportunity of studying asample of 590 journal articles randomly drawn from a population of 5681 journal articles (out of nearly12,000 journal and non-journal publications), which the panel evaluated both by bibliometric analysisand by informed peer review. In the total sample we find fair to good agreement between informed peer-review and bibliometric analysis and absence of statistical bias between the two. We then discuss thenature, implications, and limitations of this correlation.
2015
2014
Bertocchi, Graziella; Gambardella, Alfonso; Jappelli, Tullio; Nappi, Carmela A.; Peracchi, Franco
File in questo prodotto:
File Dimensione Formato  
Bertocchi et al Bibliometric evaluation and informed peer review Evidence from Italy RP forthcoming.pdf

non disponibili

Tipologia: Documento in Post-print (Post-print document)
Licenza: NON PUBBLICO - Accesso privato/ristretto
Dimensione 765.72 kB
Formato Adobe PDF
765.72 kB Adobe PDF   Visualizza/Apri
Email acceptance.pdf

non disponibili

Tipologia: Allegato per valutazione Bocconi (Attachment for Bocconi evaluation)
Licenza: NON PUBBLICO - Accesso privato/ristretto
Dimensione 12.6 kB
Formato Adobe PDF
12.6 kB Adobe PDF   Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11565/3935518
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 68
  • ???jsp.display-item.citation.isi??? 69
social impact