Bibliometric Evaluation vs. Informed Peer Review: Evidence from Italy A relevant question for the organization of large scale research assessments is whether bibliometric evaluation and informed peer review where reviewers know where the work was published, yield similar results. It would suggest, for instance, that less costly bibliometric evaluation might at least partly replace informed peer...

Introduction The scientific community has developed many institutionalized forms of evaluation where peer review has an important role, but recently, bibliometric methods have been gaining some acceptability to assess the scientific performance. The two techniques have been related to one another in different ways: 1) bibliometric methods have been used to analyze the peer review processes (Moe...

BACKGROUND The peer review system has been traditionally challenged due to its many limitations especially for allocating funding. Bibliometric indicators may well present themselves as a complement. OBJECTIVE We analyze the relationship between peers' ratings and bibliometric indicators for Spanish researchers in the 2007 National R&D Plan for 23 research fields. METHODS AND MATERIALS We a...

BACKGROUND The h index bibliometric indicator for evaluating scientists and scientific institutions plays an increasingly important role in evaluating contemporary scientific research, including chemistry. RESULTS Citations are meaningful. The best way of measuring performance is to use the informed peer review, where peers judge on the base of a bibliometric report, once the limits and advan...

in bibliometric and scientometric studies, three approaches of multivariate analysis, namely factor analysis, cluster analysis and multidimensional scaling are the most used methods. this article aims to review the use and applications of these techniques.

In December 2003, seventeen years after the first UK research assessment exercise, Italy started up its first-ever national research evaluation, with the aim to evaluate, using the peer review method, the excellence of the national research production. The evaluation involved 20 disciplinary areas, 102 research structures, 18,500 research products and 6,661 peer reviewers (1,465 from abroad); i...

This paper shows how bibliometric assessment can be implemented at individual level. This has been successfully done at the University of Vienna carried out by the Bibliometrics and Publication Strategies Department of the Vienna University Library. According to the department's philosophy, bibliometrics is not only a helpful evaluation instrument in order to complement the peer review system. ...

Ž . It is often argued that interdisciplinary research is valued less in both qualitative peer-review based as well as in Ž . quantitative bibliometric assessments. A recent extensive, nation-wide evaluation of all academic physics groups in the Netherlands allowed us to investigate this problem empirically. Therefore, we first developed an operationalization of ‘interdisciplinarity’. On the ba...

The predictive validity of peer review at the National Institutes of Health (NIH) has not yet been demonstrated empirically. It might be assumed that the most efficient and expedient test of the predictive validity of NIH peer review would be an examination of the correlation between percentile scores from peer review and bibliometric indices of the publications produced from funded projects. T...

P rofessor Stephen Holgate comments on our statement that “the new UK Research Excellence Framework (REF) puts more emphasis on bibliometric data and less on peer review than did its predecessor” [1]. As the Chair of Main Panel A of REF 2014, he describes the informed peer review process in his domain. In our opinion, peer review can indeed be considered as an ideal way of evaluating research. ...