Abstract
Quality assurance and quality control are important for the reliability of case–control studies. Here we describe the procedures used in a previously published study, with emphasis on interviewer variability. To evaluate risk factors for acute pancreatitis, information including previous diagnoses and medication was collected from medical records and by telephone interviews from 462 cases and 1781 controls. Quality assurance procedures included education and training of interviewers and data validity checks. Quality control included a classification test, annual test interviews, expert case validation, and database validation. We found pronounced variations between interviewers. The maximal number of interviews per day varied from 3 to 9. The adjusted average (95% CI) number of diagnoses captured per interview of cases was 4.1 (3.8–4.3) and of controls 3.5 (3.4–3.7) (excluding one deviating interviewer). For drugs, the average (95% CI) number per interview was 3.9 (3.7–4.1) for cases and 3.3 (3.2–3.4) for controls (excluding one deviating interviewer). One of the fourteen interviewers deviated significantly from the others, and more so for controls than for cases. This interviewer’s data `were excluded. Nonetheless, data concerning controls more frequently needed correction and supplementation than for cases. Erroneous coding of diagnoses and medication was also more frequent among controls. Thus, a system for quality control of coding practices is crucial. Variability in interviewers’ ability to ascertain information is a possible source of bias in interview-based case–control studies when “blinding” cannot be achieved.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
PB Ottevanger P Therasse C Velde Particlevan de et al. (2003) ArticleTitleQuality assurance in clinical trials Crit Rev Oncol Hematol 47 IssueID3 213–235 Occurrence Handle1:STN:280:DC%2BD3svit1Kltw%3D%3D Occurrence Handle12962897
Crerand WJ, Lamb J, Rulon V, Karal B, Mardekian J. Buildning data quality into clinical trials. J AHIMA 2002 Nov–Dec;73(10): 44–6, 48–53, 2 quiz 55–6
Directive 2001/20/EC.Official Journal L 311,28/11/2001: 67–128
ICH Harmonised Tripartite Guideline for Good Clinical Practice. J Postgrad Med 2001; Jul–Sept; 47(3):199–203
CM Collins (1998) ArticleTitleEnsuring data quality in the pharmaceutical industry J AHIMA 69 IssueID6 34–39 Occurrence Handle1:STN:280:DyaK1c3psFeguw%3D%3D Occurrence Handle10180097
K Sharples TR Fleming S MacMahon A Moore J Reid B Scoggins (1998) ArticleTitleMonitoring clinical trials NZ Med J 111 IssueID1072 322–325 Occurrence Handle1:STN:280:DyaK1cvjvVOksg%3D%3D
ICH Harmonised Tripartite Guideline for Good Clinical Practice. Brookwood Medical Publications Ltd, UK, 1996
JJ Gassman WW Owen TE Kuntz JP Martin WP Amoroso (1995) ArticleTitleData quality assurance, monitoring and reporting Control Clin Trials 16 IssueID2 Suppl 104S–136S Occurrence Handle10.1016/0197-2456(94)00095-K Occurrence Handle1:STN:280:ByqA3cfpvV0%3D Occurrence Handle7789140
JD Neaton AG Duchene KH Svendsen D Wentworth (1990) ArticleTitleAn examination of the efficiency of some quality assurance methods commonly employed in clinical trials Stat Med 9 115–124 Occurrence Handle1:STN:280:By%2BB28nht1I%3D Occurrence Handle2345830
GJ Prud’homme PL Canner JA Cutler (1989) ArticleTitleQuality assurance and monitoring in the hypertension prevention trials. Hypertension Prevention Trials Research Group Control Clin Trials 10 IssueID3 Suppl 84S–94S Occurrence Handle10.1016/0197-2456(89)90044-5 Occurrence Handle1:STN:280:By%2BD3s7mtVQ%3D Occurrence Handle2680275
JB Severe NR Schooler JH Lee et al. (1989) ArticleTitleEnsuring data quality in a multicenter clinical trial: remote site data entry, central coordination and feedback Psychopharmacol Bull 25 488–490 Occurrence Handle1:STN:280:By%2BC2srnvFc%3D Occurrence Handle2697015
JL Tillotson DD Gorder AG DuChene PV Grambsch J Wenz (1986) ArticleTitleQuality control in the Multiple Risk Factor Intervention Trial Nutrition Modality Control Clin Trials 7 IssueID3 Suppl 66S–90S Occurrence Handle10.1016/0197-2456(86)90160-1 Occurrence Handle1:STN:280:BiiC3cvislQ%3D Occurrence Handle3802847
A Bagniewska D Black K Molvig C Fox C Ireland J Smith S Hulley (1986) ArticleTitleData quality in a distributed data processing system: the SHEP Pilot Study Control Clin Trials 7 27–37 Occurrence Handle10.1016/0197-2456(86)90005-X Occurrence Handle1:STN:280:BimC28zivFc%3D Occurrence Handle3956210
YN Marinez CA McMahan GM Barnwell HS Wigodsky (1984) ArticleTitleEnsuring data quality in medical research through an integrated data management system Stat Med 3 101–111 Occurrence Handle1:STN:280:BiuB2szosFY%3D Occurrence Handle6463448
T Karrison (1981) ArticleTitleData editing in a clinical trials Control Clin Trials 2 15–29 Occurrence Handle10.1016/0197-2456(81)90055-6 Occurrence Handle1:STN:280:Bi6B2MbnslA%3D Occurrence Handle7261636
A Correa WF Stewart HC Yeh C Santos-Burgoa (1994) ArticleTitleExposure measurement in case–control studies: reported methods and recommendations Epidemiol Rev 16 18–32 Occurrence Handle1:STN:280:ByqD3M%2FktlA%3D Occurrence Handle7925725
DH Christiansen JD Hosking AL Danneberg OD Williams (1990) ArticleTitleComputer-assisted data collection in multicenter epidemiologic research. The Atherosclerosis Risk in Communities Study Control Clin Trial 11 101–115 Occurrence Handle10.1016/0197-2456(90)90004-L Occurrence Handle1:STN:280:By%2BB28bgtVQ%3D
CW Whitney BK Lind PW Wahl (1998) ArticleTitleQuality assurance and quality control in longitudinal studies Epidemiol Rev 20 IssueID1 71–80 Occurrence Handle1:STN:280:DyaK1cvjsFamug%3D%3D Occurrence Handle9762510
RR Cook (1991) ArticleTitleOverview of good epidemiological practice J Occup Med 33 216–220
P Lepore (1995) ArticleTitleThe 10 essential activities of the quality assurance unit Qual Assur 4 29–33 Occurrence Handle1:STN:280:BymD1M7psVc%3D Occurrence Handle8520862
LR Bergman (1996) ArticleTitleMeasurement and data quality in longitudinal research Eur Child Adolesc Psychiatry 5 IssueID1 Suppl S28–S32 Occurrence Handle10.1007/BF00538540
JK Baldwin BK Hoover (1991) ArticleTitleQuality assurance and quality control in toxicology: how might these concepts apply to epidemiology? J Occup Med 33 1247–1249 Occurrence Handle1:STN:280:By2C1MzpvFA%3D Occurrence Handle1800683
NM Bradburn S Sudman E Blir (1979) Improving interview Method, Questionnaire Design Jossey-Bass publishers San Fransisco CA 26–63
P Hartge JL Cahill D West et al. (1984) ArticleTitleDesign and methods in a multi-center case–control interview study Am J Public Health 74 52–56 Occurrence Handle1:STN:280:BiuD2sjjvVU%3D Occurrence Handle6689843
PA Wingo HW Ory PM Layde NC Lee (1989) The Evaluation of the Data Collection Process for a Multicenter, Population-based, Survey Costs John Wiley and Sons, Inc New York NY 357–406
RM Groves (1989) Survey Errors, Survey Costs John Wiley and sons, Inc New York NY 357–406
Fowler FJ, Mangione TW. Standardized survey interviewing: minimizing interviewer-related error (Applied social Research Methods, Vol. 18). Newbury Park, CA: Sage Publications, 1990: 24–32, 96–105, 136–44
JJ Hox ED Leeuw IG Kreft (1991) The effect of interviewer and respondent characteristics on the quality of survey data: a multilevel model PB Biermar RM Groves LE Lyberg (Eds) Measurement Errors in Surveys John and Sons, Inc New York, NY 439–461
L Wynder Ernst (1994) ArticleTitleInvestigator bias and interviewer bias: the problem of reporting systematic error in epidemiology J Clin Epidemiol 47 IssueID8 825–827 Occurrence Handle10.1016/0895-4356(94)90184-8
S Edwards M Slattery M Mori et al. (1994) ArticleTitleObjective system for interviewer performance evaluation for use in epidemiologic studies Am J Epidemiol 140 IssueID11 1020–1028 Occurrence Handle1:STN:280:ByqD2snpsFY%3D Occurrence Handle7985650
CB Johannes SL Crawford JB McKinlay (1997) ArticleTitleInterviewer effects in a cohort study Am J Epidemiol 147 IssueID5 429–438
James H. Frey Sabine Mertens Oishi (1995) How to Conduct Interviews by Telephone and in Person Sage Publications International Educational and Professional Publisher Thousand Oaks, London, New Dehli
KB Blomgren A Sundstrom G Steineck BE Wiholm (2002) ArticleTitleA Swedish case–control network for studies of drug induced morbidity – acute pancreatitis Eur J Clin Pharmacol 58 275–283 Occurrence Handle10.1007/s00228-002-0471-4 Occurrence Handle1:CAS:528:DC%2BD38XltlOntb8%3D Occurrence Handle12136374
KB Blomgren A Sundstrom G Steineck BE Wiholm (2002) ArticleTitleObesity and treatment of diabetes with glibenclamide may both be risk factors for acute pancreatitis Diabetes Care 25 298–302 Occurrence Handle1:CAS:528:DC%2BD38Xhtlyksrc%3D Occurrence Handle11815499
A Wessling U Bergman B Westerholm (1991) ArticleTitleOn the difference in psychotropic drug use between the three major urban areas in Sweden Eur J Clin Pharmacol 40 495–500 Occurrence Handle10.1007/BF00315229 Occurrence Handle1:STN:280:By6A2MjgsFQ%3D Occurrence Handle1884724
K Henricsson A Carlsten J Ranstam et al. (1999) ArticleTitleUtilisation of codein and propoxyphene:geographic and demographic variation in prescribing, prescriber and recipient categories Eur J Clin Pharmacol 55 605–611 Occurrence Handle10.1007/s002280050680
Apoteket AB. Läkemedelsstatistik 1997
EB Andrews J Avorn EA Bortnichak et al. (1996) ArticleTitleISPE. Guidelines for good epidemiology practice for drug, device and vaccine research in the United States Pharmacoepidemiol Drug Safety 5 333–338 Occurrence Handle10.1002/(SICI)1099-1557(199609)5:5<333::AID-PDS244>3.0.CO;2-5 Occurrence Handle1:STN:280:DC%2BD2czit1Grsw%3D%3D
International Society for pharmacoepidemiology. Guidelines for Good pharmacoepidemiology practices (6pp), 2004
Author information
Authors and Affiliations
Corresponding author
Additional information
Bengt-Erik Wiholm unexpectedly died on 30th July 2005 after an auto accident. He was specialist in internal medicine as well as in clinical pharmacology, he has been a leader in the field of Drug Safety and Pharmacoepidemiology. He started his carrier in pharmacology and epidemiology at Karolinska Institute in Stockholm Sweden and later on as head for the Pharmacoepidemiology Unit at the Swedish Medical Products Agency in Sweden. Since the last four years he has been employed as Senior Director, Epidemiology at Merck Research and Laboratories in US.
Rights and permissions
About this article
Cite this article
Blomgren, K.J., Sundström, A., Steineck, G. et al. Interviewer Variability – Quality Aspects in a Case–Control Study. Eur J Epidemiol 21, 267–277 (2006). https://doi.org/10.1007/s10654-006-0017-7
Accepted:
Issue Date:
DOI: https://doi.org/10.1007/s10654-006-0017-7