Abstract
The relationship between indicators of and expert judgement of, research performance were compared in the context of mission oriented pharmaceutical research. Expert judgment is very highly correlated with measures of publication activity, much more so than with very plausible measures of research output and research quality. Furthermore, expert judgement appears to be an additive function of publication size (another name for which might be visibility) and publication quality, with the principal component being size/visibility. These results are very similar to those found byAnderson, Narin, andMcAllister in the context of academic research, but these findings emerge from a context which allows other variables to compete in predicting expert judgement, and are therefore to that degree more robuts. In addition this study finds a clear pattern of subject specificity, which implies that visibility is a function of the judge's subject field.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
R. C. ANDERSON, F. NARIN, P. McALLISTER, “Publication Ratings versus Peer Ratings of Universities”,Journal of the American Society for Information Science, 29 No. 3 1978) 91–103.
K. D. ROOSE, C. J. ANDERSON,A Rating of Graduate Programs, American Council on Education, Washington, D.C., 1970.
A. M. CARTTER,An Assessment of Quality in Graduate Education, American Council on Education, Washington, D.C.
Science Citation Index, Philadelphia, Pa., Institute for Scientific Information, 1961 to date, yearly.
F. NARIN,Evaluative Bibliometrics, Computer Horizons, Cherry Hill, N.J., 1976.
D. SCHWARTZMAN,Innovation in the Pharmaceutical Industry, Johns Hopkins University Press, Baltimore, 1976.
W. McVICKER,New Drug Development Study—Final Report, Internal Document of the U.S. Food and Drug Administration, March 1972.
P. de HAEN,New Products Parade—Annual Review of the New Drugs, de Haen Inc., New York, 1954 to date, yearly.
M. WINDHOLE, Ed.,The Merck Index: An Encyclopedia of Chemicals and Drugs, Ninth Edition, Merck & Co. Inc., Rahway, N.J., 1976.
Innovative Activity in the Pharmaceutical Industry, National Economic Development Office, London, England, HMSO, 1973.
N. H. NIE, et al,SPSS Statistical Package for the Social Sciences, Second Edition McGraw Hill, New York, 1975, p. 353.
H. G. SMALL, “Co-Citation in the Scientific Literature: A New Measure of the Relationship Between Two Documents”,Journal of the American Society for Information Science, 24 No. 4, August (1973) 265–269.
B. C. GRIFFITH, H. G. SMALL, J. S. STONEHILL, S. DYE, The Structure of Scientific Literature. 2. Toward a Macro- and Microstructure for Science,Science Studies 4 (1974) 339–365.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Koenig, M.E.D. Determinants of expert judgement of research performance. Scientometrics 4, 361–378 (1982). https://doi.org/10.1007/BF02135122
Received:
Issue Date:
DOI: https://doi.org/10.1007/BF02135122