www.uhasselt.be
DSpace

Document Server@UHasselt >
Research >
Research publications >

Please use this identifier to cite or link to this item: http://hdl.handle.net/1942/792

Title: Methods for accrediting publications to authors or countries: consequences for evaluation studies
Authors: EGGHE, Leo
ROUSSEAU, Ronald
Van Hooydonk, G.
Issue Date: 2000
Publisher: Wiley
Citation: Journal of the American Society for Information Science, 51(2). p. 145-157
Abstract: One aim of science evaluation studies is to determine quantitatively the contribution of different players (authors, departments, countries) to the whole system. This information is then used to study the evolution of the system, for instance to gauge the influence of special national or international programs. Taking articles as our basic data, we want to determine the exact relative contribution of each co-author or each country. These numbers are then brought together to obtain country scores, or department scores, etc. It turns out, as we will show in this article, that different scoring methods can yield totally different rankings. In addition to this, a relative increase according to one method can go hand in hand with a relative decrease according to another counting method. Indeed, we present examples in which country (or author) c has a smaller relative score in the total counting system than in the fractional counting one, yet this smaller score has a higher importance than the larger one (fractional counting). Similar anomalies were constructed for total versus proportional counts and for total versus straight counts. Consequently, a ranking between countries, universities, research groups or authors, based on one particular accrediting method does not contain an absolute truth about their relative importance. Different counting methods should be used and compared. Differences are illustrated with a real-life example. Finally, it is shown that some of these anomalies can be avoided by using geometric instead of arithmetic averages.
URI: http://hdl.handle.net/1942/792
DOI: 10.1002/(SICI)1097-4571(2000)51:2<145::AID-ASI6>3.0.CO;2-9
ISI #: 000084513300005
ISSN: 0002-8231
Category: A1
Type: Journal Contribution
Validation: ecoom, 2001
Appears in Collections: Research publications

Files in This Item:

Description SizeFormat
Published version243.36 kBAdobe PDF
Peer-reviewed author version618.39 kBAdobe PDF

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.