Abstract
A methodology for creating bibliometric impact profiles is described. The advantages of such profiles as a management tool to supplement the reporting power of traditional average impact metrics are discussed. The impact profile for the UK as a whole reveals the extent to which the median and modal UK impact values differ from and are significantly below average impact. Only one-third of UK output for 1995-2004 is above world average impact although the UK’s average world-normalised impact is 1.24.
Time-categorised impact profiles are used to test hypotheses about changing impact and confirm that the increase in average UK impact is due to real improvement rather than a reduction in low impact outputs.
The impact profile methodology has been applied across disciplines as well as years and is shown to work well in all subject categories. It reveals substantial variations in performance between disciplines. The value of calculating the profile median and mode as well as the average impact are demonstrated. Finally, the methodology is applied to a specific data-set to compare the impact profile of the elite Laboratory of Molecular Biology (Cambridge) with the relevant UK average. This demonstrates an application of the methodology by identifying where the institute’s exceptional performance is located.
The value of impact profiles lies in their role as an interpretive aid for non-specialists, not as a technical transformation of the data for scientometricians.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Adams, J. (1998), Benchmarking international research. Nature, 396: 615–618.
Ehrenberg, A. (1988), Repeat-buying: Facts, Theory and Applications. New York: Oxford University Press.
European Commission (2003), Third European Report on Science and Technology Indicators. D G Research, Brussels. ISBN 92 894 1795 1.
Evidence (2005), PSA Target Metrics for the UK Research Base. A report by Evidence Ltd for the Office of Science and Innovation. http://www.ost.gov.uk/research/psa_target_metrics.htm
Feller, W. (1943), On a general class of ‘contagious’ distributions. Annals of Mathematical Statistics, 14: 389–400.
Garfield, E. (1955), Citation indexes for science: a new dimension in documentation through association of ideas. Science, 122: 108–111.
King, D. A. (2004), The scientific impact of nations. Nature, 430: 311–316.
Leydesdorff, L., Bensman, S. (2006), Classification and powerlaws: the logarithmic transformation. Journal of the American Society for Information Science and Technology, 57 1470–1486.
May, R. M. (1997), The scientific wealth of nations. Science, 275: 793–796.
Michelson, E. S. (2006), Approaches to research and development performance assessment in the United States. Science and Public Policy, 33: 546–560.
Moed, H. F. (2005), Citation Analysis in Research Evaluation. Springer, Dordrecht. ISBN 4020 3713 9.
Moed, H. F., Glänzel, W., Schmoch, U. (2004), Handbook of Quantitative Science and Technology Research. Springer, Dordrecht.
Price, D. de Solla (1965), The scientific foundations of science policy. Nature, 206: 233–238.
Savani, V., Zhigljavsky, A. (2006), Efficient estimation of parameters of the negative binomial distribution. Communications in Statistics: Theory and Methods, 35: 1–17.
Savani, V., Zhigljavsky, A., Efficient parameter estimation for independent and INAR(1) negative binomial samples. Metrika (in press a).
Savani, V., Zhigljavsky, A., Asymptotic distributions of statistics and parameter estimates for mixed Poisson processes. (in press b).
Small, H., Why authors think their papers are highly cited. Scientometrics, 60 (2004) 305–316.
Weingart, P. Impact of bibliometrics upon the science system: inadvertent consequences? Scientometrics, 62 (2005) 117–131.
Zitt, M., Ramanana-Rahary, S., Bassecoulard, E., Relativity of citation performance and excellence measures: from cross-field to cross-scale effects of field normalisation. Scientometrics, 63 (2005) 373–201.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Adams, J., Gurney, K. & Marshall, S. Profiling citation impact: A new methodology. Scientometrics 72, 325–344 (2007). https://doi.org/10.1007/s11192-007-1696-x
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11192-007-1696-x