Abstract
Population-based estimates of substance use patterns have been regularly reported for several decades. Concerns with the quality of the survey methodologies employed to produce these estimates, however, date back almost as far. These concerns have led to a considerable body of research specifically focused on understanding the nature and consequences of survey-based errors in substance use epidemiology. This chapter reviews and summarizes that empirical research by organizing it within a total survey error model framework that considers multiple types of representation and measurement errors. Gaps in knowledge regarding sources of error in substance use surveys and areas needing future research are also identified.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
The Total Survey Error model has helped organize several decades of empirical research concerned with various sources of survey errors into a single unifying theoretical framework.
- 2.
Wagner and Lee (2015) define rare populations as referring to subgroups in the total population that are either small in size or “hard-to-reach” in terms of ability to identify or interview, such as cases where the population is geographically dispersed.
- 3.
Low numbers of a subsample, in and of itself, affects the precision of information gathered, as smaller numbers of subjects are associated with margins of error that make it more difficult to be confident in the actual, underlying data (Andersen et al. 2004). Also problematic is that small sample sizes may preclude analyses of complex models on the causes and consequences of substance abuse within subpopulations of interest.
- 4.
See the chapter by Gfroerer et al. (this volume) for additional detail regarding sample designs in substance use research.
- 5.
- 6.
Chapter 14 (this volume) by Fendrich et al. explores the use of biospecimens in greater detail.
References
Adams, S. A., Matthews, C. E., Ebbeling, C. B., Moore, J. E., Cunningham, J., Fulton, J., et al. (2005). The effect of social desirability and social approval on self-reports of physical activity. American Journal of Epidemiology, 161, 389–398.
Aguinis, H., Pierce, C. A., & Quigley, B. M. (1995). Enhancing the validity of self-reported alcohol and marijuana consumption using a bogus pipeline procedure: A meta-analytic review. Basic and Applied Social Psychology, 16, 515–527.
Andersen, E. M., Diehr, P. H., & Luke, D. A. (2004). Public health surveillance of low-frequency populations. Annual Review of Public Health, 25, 25–52.
Aquilino, W. S. (1992). Telephone versus face-to-face interviewing for household drug use surveys. International Journal of the Addictions, 27, 71–91.
Aquilino, W. S. (1994). Interviewer mode effects in surveys of drug and alcohol use. Public Opinion Quarterly, 58, 210–240.
Aquilino, W. S. (1997). Privacy effects on self-reported drug use: Interactions with survey mode and respondent characteristics. In L. Harrison & A. Hughes (Eds.), The validity of self-reported drug use: Improving the accuracy of survey estimates (pp. 97–4147). Rockville, MD: NIDA Research Monograph 167, NIH Pub No National Institute on Drug Abuse.
Aquilino, W. S., & LoSciuto, L. A. (1990). Effects of interview mode of self-reported drug use. Public Opinion Quarterly, 54, 362–395.
Aquilino, W. S., Wright, D. L., & Supple, A. J. (2000). Response effects due to bystander presence in CASI and paper-and-pencil surveys of drug use and alcohol use. Substance Use and Misuse, 35, 845–846.
Ardila, A., Rosselli, M., & Strumwassler, S. (1991). Neuropsychological defects in chronic cocaine abuse. International Journal of Neuroscience, 57, 73–79.
Babor, T. F., Steinberg, K., Anton, R., & Del Boca, F. K. (2000). Talk is cheap: Measuring drinking outcomes in clinical trials. Journal of Studies on Alcohol, 61, 55–63.
Bachman, J. G., Johnson, L. D., & O’Malley, P. M. (1981). Smoking, drinking, and drug use among American high school students: Correlates and trends, 1975–1979. American Journal of Public Health, 71, 59–69.
Bachman, J. G., & O’Malley, P. M. (1981). When four months equal a year: Inconsistencies in students’ reports of drug use. Public Opinion Quarterly, 45, 536–548.
Bailey, S. L., Flewelling, R. L., & Rachal, J. V. (1992). The characterization of inconsistencies in self-reports of alcohol and marijuana use in a longitudinal study of adolescents. Journal of Studies on Alcohol, 53, 636–647.
Barnea, A., Rahav, G., & Teichman, M. (1987). The reliability and consistency of self-reports on substance use in a longitudinal study. British Journal of Addiction, 82, 891–898.
Barrett, S. P., Gross, S. R., Garand, I., & Pihl, R. O. (2005). Patterns of simultaneous polysubstance use in Canadian rave attendees. Substance Use and Misuse, 40, 1525–1537.
Bauermeister, J. A., Zimmerman, M. A., Johns, M. M., Glowacki, P., Stoddard, S., & Volz, E. (2012). Innovative recruitment using online networks: Lessons learned from an online study of alcohol and other drug use utilizing a web-based, respondent-driven sampling (webRDS) strategy. Journal of Studies on Alcohol and Drugs, 73, 834–838.
Beard, C. M., Lane, A. W., O’Fallon, W. M., Riggs, B. L., & Melton, L. S. (1994). Comparison of respondents and nonrespondents in an osteoporosis study. Annals of Epidemiology, 4, 398–403.
Belli, R. F. (2008). Calendar and time diary methods in life course research. Los Angeles, CA: Sage Publications.
Bijl, R. V., van Zessen, G., Ravelli, A., de Rijk, C., & Langendoen, Y. (1998). The Netherlands Mental Health Survey and Incidence Study (NEMESIS): Objectives and design. Social Psychiatry and Psychiatric Epidemiology, 33, 581–586.
Bloomfield, K., Hope, A., & Kraus, L. (2013). Alcohol survey measures for Europe: A literature review. Drugs: Education Prevention and Policy, 20, 348–360.
Blumberg, S. J., & Luke, J. V. (2009). Reevaluating the need for concern regarding noncoverage bias in landline surveys. American Journal of Public Health, 99, 1806–1810.
Blumberg, S. J., & Luke, J. V. (2016). Wireless substitution: Early release of estimates from the National Health Interview Survey, July–December 2015. Hyattsville, MD: National Center for Health Statistics. Available from: http://www.cdc.gov/nchs/data/nhis/earlyrelease/wireless201605.pdf
Blumberg, S. J., Luke, J. V., & Cynamon, M. L. (2006). Telephone coverage and health survey estimates: Evaluating the need for concern about wireless substitution. American Journal of Public Health, 96, 926–931.
Bolla, K. I., McCann, U. D., & Ricaurte, G. A. (1998). Memory impairment in abstinent MDMA (“Ecstasy”) users. Neurology, 51, 1532–1537.
Bongers, I. M. B., & Oers, J. A. M. (1998). Mode effects on self-reported alcohol use and problem drinking: Mail questionnaires and personal interviewing compared. Journal of Studies on Alcohol, 59, 280–285.
Boniface, S., Kneale, J., & Shelton, N. (2014). Drinking pattern is more strongly associated with under-reporting of alcohol consumption than socio-demographic factors: Evidence from a mixed-methods study. BMC Public Health, 14.
Bradburn, N. M., & Sudman, S. (1979). Improving interview method and questionnaire design: Response effects to threatening questions in survey research. San Francisco, CA: Jossey-Bass Publishers.
Brener, N. D., Billy, J. O. G., & Grady, W. R. (2003). Assessment of factors affecting the validity of self-reported health-risk behavior among adolescents: Evidence from the scientific literature. Journal of Adolescent Health, 33, 436–457.
Brener, N. D., Eaton, D. K., Kann, L., Grunbaum, J. A., Gross, L. A., Kyle, T. M., et al. (2006). The association of survey setting and mode with self-reported health risk behaviors among high school students. Public Opinion Quarterly, 70, 354–374.
Bucholz, K. K., Shayka, J. J., Marion, S. L., Lewis, C. E., Pribor, E. F., & Rubio, D. M. (1996). Is a history of alcohol problems or of psychiatric disorder associated with attrition at 11-year follow-up? Annals of Epidemiology, 6, 228–234.
Caetano, R., Ramisetty-Mikler, S., & McGrath, C. (2003). Characteristics of non-respondents in a US national longitudinal survey on drinking and intimate partner violence. Addiction, 98, 791–797.
Caldwell, T. M., Rogers, B., Power, C., Clark, C., & Stansfeld, S. A. (2006). Drinking histories of self-identified lifetime abstainers and occasional drinkers: Findings from the 1958 British Birth Cohort Study. Alcohol and Alcoholism, 41, 650–654.
Campanelli, P., Dielman, T. E., & Shope, J. T. (1987). Validity of adolescents’ self-reports of alcohol use and misuse using a bogus pipeline procedure. Adolescence, 22, 7–22.
Caspar, R. A. (1992). Follow-up of non-respondents in 1990. In C. Turner, J. Lessler & J. Gfroerer (Eds.), Survey measurement of drug use: Methodological studies. DHHS Pub. No., ADM 92-1929. Rockville, MD: National Institute on Drug Abuse.
Center for Behavioral Health Statistics and Quality. (2015). Behavioral health trends in the United States: Results from the 2014 national survey on drug use and health. HHS Publication No. SMA 15-4927, NSDUH Series H-50. Retrieved from: http://www.samhsa.gov/data/
Chavez, E. L., Edwards, R. W., & Oetting, E. R. (1989). Mexican American and White American school dropouts drug use, health status, and involvement in violence. Public Health Reports, 104, 594–604.
Cho, Y. I., Johnson, T. P., & Fendrich, M. (2001). Monthly variations in self-reports of alcohol consumption. Journal of Studies on Alcohol, 62, 268–272.
Chromy, J., Davis, T., Packer, L., & Gfroerer, J. (2002). Mode effects on substance use measures: Comparison of 1999 CAI and PAPI data. In J. Gfroerer, J. Eyerman, & J. Chromy (Eds.), Redesigning an ongoing national household survey: Methodological issues. DHHS Publication No. MA 03-3768. Rockville, MD: Substance Abuse and Mental Health Services Administration.
Chromy, J. R., Eyerman, J., Odom, D., & McNeeley, A. E. (2005). Association between interviewer experience and substance use prevalence rates in NSDUH. In J. Kannet & J. Gfroerer (Eds.), Evaluating and improving methods used in the National Survey of Drug Use and Health. DHHS Publication No. SMA 05-4044, Methodology Series M-5. Rockville, MD: Substance Abuse and Mental Health Services Administration, Office of Applied Studies.
Chung, T., & Martin, C. S. (2005). What were they thinking? Adolescents’ interpretations of DSM-IV alcohol dependence symptom queries and implications for diagnostic validity. Drug and Alcohol Dependence, 80, 191–200.
Clatts, M. C., Goldamt, L. A., & Yi, H. (2005). Club drug use among young men who have sex with men in NYC: A preliminary epidemiologic profile. Substance Use and Misuse, 40, 1317–1330.
Cohen, G., & Duffy, J. C. (2002). Are nonrespondents to health surveys less healthy than respondents? Journal of Official Statistics, 18, 13–23.
Colón, H. M., Pérez, C. M., Meléndez, M., Marrero, E., Ortiz, A. P., & Suárez, E. (2010). The validity of drug use responses in a household survey in Puerto Rico: Comparison of survey responses with urinalysis. Addictive Behaviors, 35, 667–672.
Colón, H. M., Robles, R. R., & Sahai, H. (2001). The validity of drug use responses in a household survey in Puerto Rico: Comparison of survey responses of cocaine and heroin use with hair tests. International Journal of Epidemiology, 30, 1042–1049.
Colón, H. M., Robles, R. R., & Sahai, H. (2002). The validity of drug use reports among hard core drug users in a household survey in Puerto Rico: Comparison of survey responses of cocaine and heroin use with hair tests. Drug and Alcohol Dependence, 67, 269–279.
Cottler, L. B., Zipp, J. F., Robbins, L. H., & Spitznagel, E. L. (1987). Difficult-to-recruit respondents and their effect on prevalence estimates in an epidemiologic survey. American Journal of Epidemiology, 125, 329–339.
Cowan, C. D. (2001). Coverage, sample design, and weighting in three federal surveys. Journal of Drug Issues, 31, 599–614.
Crawford, A. (1986). A comparison of participants and non-participants from a British general population survey of alcohol drinking practices. Journal of the Market Research Society, 28, 291–297.
Crawford, A. (1987). Bias in a survey of drinking habits. Alcohol and Alcoholism, 22, 167–179.
Crowne, D. P., & Marlowe, D. (1964). The approval motive: Studies in evaluative dependence New York. NY: Wiley.
Cunradi, C. B., Moore, R., Killoran, M., & Ames, G. (2005). Survey nonresponse bias among young adults: The role of alcohol, tobacco, and drugs. Substance Use and Misuse, 40, 171–185.
Darrow, W. W., Jaffe, H. W., Thomas, P. A., Haverkos, H. W., Rogers, M. F., Guinan, M. E., et al. (1986). Sex of interviewer, place of interview, and responses of homosexual men to sensitive questions. Archives of Sexual Behavior, 15, 79–88.
Dawson, D. A. (1998). Volume of ethanol consumption: Effects of different approaches to measurement. Journal of Studies on Alcohol, 59, 191–197.
Dawson, D. A. (2003). Methodological issues in measuring alcohol use. Alcohol Research & Health, 27, 18–29.
Dawson, D. A., Goldstein, R. B., Pickering, R. P., & Grant, B. F. (2014). Nonresponse bias in survey estimates of alcohol consumption and its association with harm. Journal of Studies on Alcohol and Drugs, 75, 695–703.
De Graf, R., van Dorsselaer, S., Tuithof, M., & ten Have, M. (2013). Sociodemographic and psychiatric predictors of attrition in a prospective psychiatric epidemiological study among the general population. Result of the Netherlands mental health survey and incidence study-2. Comprehensive Psychiatry, 54, 1131–1139.
De La Rosa, M. R., & Adrados, J.-L. R. (1993). Drug abuse among minority youth: Advances in research and methodology. Rockville, MD: NIDA Research Monograph 130, National Institute on Drug Abuse.
de Lint, J. (1981). “Words and deeds”: Responses to Popham and Schmidt. Journal of Studies on Alcohol, 42, 359–361.
DeBlaere, C., Brewster, M. E., Sarkees, A., & Moradi, B. (2010). Conducting research with LGB people of color: Methodological challenges and strategies. The Counseling Psychologist, 38, 331–362.
Del Boca, F. K., & Darkes, J. (2003). The validity of self-reports of alcohol consumption: State of the science and challenges for research. Addiction, 98(Supplement 2), 1–12.
Del Boca, F. K., & Noll, J. A. (2000). Truth or consequences: The validity of self-report data in health services research. Addiction, 95(Supplement 3), S347–S360.
Delaney-Black, V., Chiodo, L. M., Hannigan, J. H., Greenwald, M. K., Janisse, J., Patterson, G., et al. (2010). Just say “I don’t”: Lack of concordance between teen report and biological measures of drug use. Pediatrics, 126, 887–893.
DeLauder, S. F. (2004). Considering issues of racial bias in drug testing where hair is the matrix. Transforming Anthropology, 11, 54–59.
Delnevo, C. D., Gundersen, D. A., & Hagma, B. T. (2007). Declining estimated prevalence of alcohol drinking and smoking among young adults nationally: Artifacts of sample undercoverage. American Journal of Epidemiology, 167, 15–19.
Dengler, R. (1996). Smoking and alcohol consumption in Trent, UK: An analysis of item non-response. Journal of Epidemiology and Community Health, 50, 687.
Devos-Comby, L., & Lange, J. E. (2008). “My drink is larger than yours”? A literature review of self-defined drink sizes and standard drinks. Current Drug Abuse Reviews, 1, 162–176.
Dotinga, A., van den Eijnden, R. J. J. M., Bosvekd, W., & Garretsen, H. F. L. (2005). The effect of data collection and ethnicity of interviewer on response rates and self-reported alcohol use among Turks and Moroccans in the Netherlands: An experimental study. Alcohol and Alcoholism, 40, 242–248.
Duffy, J. C., & Waterton, J. J. (1984). Under-reporting of alcohol consumption in sample surveys: The effect of computer interviewing in fieldwork. British Journal of Addiction, 79, 303–308.
Dunne, M. P., Martin, N. G., Bailey, J. M., Heath, A. C., Bucholz, K. K., Madden, P. A. F., et al. (1997). Participation bias in a sexuality survey: Psychological and behavioural characteristics of responders and non-responders. International Journal of Epidemiology, 26, 844–854.
Eaton, D. K., Brener, N. D., Kann, L., Denniston, M. M., McManus, T., Kyle, T. M., et al. (2010). Comparison of paper-and-pencil versus web administration of the Youth Risk Behavior Survey (YRBS): Risk behavior prevalence estimates. Evaluation Review, 34, 137–153.
Edwards, S. L., Slattery, M. L., & Ma, K.-N. (1998). Measurement errors stemming from nonrespondents present at in-person interviews. Annals of Epidemiology, 8, 272–277.
Ekholm, O. (2004). Influence of the recall period on self-reported alcohol intake. European Journal of Clinical Nutrition, 58, 60–62.
Ekholm, O., Strandberg-Larsen, K., Christensen, K., & Grønbæk, M. (2008). Comparison of assessment methods for self-reported alcohol consumption in health interview surveys. European Journal of Clinical Nutrition, 62, 286–291.
Ellickson, P., Bui, K., Bell, R., & McGuigan, K. (1998). Does early drug use increase the risk of dropping out of high school? Journal of Drug Issues, 28, 357–380.
Elliott, M. N., Finch, B. K., Klein, D., Ma, S., Do, D. P., Beckett, M. K., et al. (2008). Sample designs for measuring the health of small racial/ethnic subgroups. Statistics in Medicine, 27, 4016–4029.
Engels, R., Knibbe, R. A., & Drop, M. J. (1997). Inconsistencies in adolescents’ self-reports of initiation of alcohol and tobacco use. Addictive Behaviors, 22, 613–623.
Engels, R. C. M. E., Van Der Vorst, H., Dekoić, M., & Meeus, W. (2007). Correspondence in collateral and self-reports on alcohol consumption: A within family analysis. Addictive Behaviors, 32, 1016–1030.
Farrell, A. D., Danish, S. J., & Howard, C. W. (1991). Evaluation of data screening methods in surveys of adolescents’ drug use. Psychological Assessment, 3, 295–298.
Fendrich, M. (2005). The undeniable problem of recanting. Addiction, 100, 143–144.
Fendrich, M., & Johnson, T. P. (2001). Examining prevalence differences in three national surveys of youth: Impact of consent procedures, mode, and editing rules. Journal of Drug Issues, 31, 615–642.
Fendrich, M., & Johnson, T. P. (2005). Race/ethnicity differences in the validity of self-reported drug use: Results from a household survey. Journal of Urban Health, 82 Supplement 3, iii67–iii81.
Fendrich, M., Johnson, T. P., Sudman, S., Wislar, J. S., & Spiehler, V. (1999). Validity of drug use reporting in a high-risk community sample: A comparison of cocaine and heroin survey reports with hair tests. American Journal of Epidemiology, 149, 955–962.
Fendrich, M., Johnson, T. P., Wislar, J. S., Hubbell, A., & Spiehler, V. (2004). The utility of drug testing in epidemiological research: Results from an ACASI general population survey. Addiction, 99, 197–208.
Fendrich, M., & Mackesy-Amiti, M. E. (2000). Decreased drug reporting in a cross-sectional student drug use survey. Journal of Substance Abuse, 11, 161–172.
Fendrich, M., Mackesy-Amiti, M., & Johnson, T. P. (2008). Validity of self-reported substance use in men who have sex with men: Comparisons with a general population sample. Annals of Epidemiology, 18, 752–759.
Fendrich, M., & Rosenbaum, D. P. (2003). Recanting of substance use reports in longitudinal prevention study. Drug and Alcohol Dependence, 70, 241–253.
Fendrich, M., & Vaughn, C. (1994). Diminished lifetime substance use over time: An inquiry into differential underreporting. Public Opinion Quarterly, 58, 96–123.
Fernández, M. L., Bowen, G. S., Varga, L. M., Collazo, J. B., Hernandez, N., Perrino, T., et al. (2005). High rates of club drug use and risky sexual practices among Hispanic men who have sex with men in Miami, Florida. Substance Use and Misuse, 40, 1347–1362.
Fortney, J., Mukherjee, S., Curran, G., Fortney, S., Han, X., & Booth, B. M. (2004). Factors associated with perceived stigma for alcohol use and treatment among at-risk drinkers. Journal of Behavioral Health Services & Research, 31, 418–429.
Fowler, F. J., & Stringfellow, V. L. (2001). Learning from experience: Estimating teen use of alcohol, cigarettes, and marijuana from three survey protocols. Journal of Drug Issues, 31, 643–664.
Friedman, W. J. (1993). Memory for the time of past events. Psychological Bulletin, 113, 44–66.
Garcia, M., Fernandez, E., Schiaffino, A., Borrell, C., Marti, M., & Borras, J. M. (2005). Attrition in a population-based cohort eight years after baseline interview: The Conella Health Interview Survey Follow-up (CHIS.FU) study. Annals of Epidemiology, 15, 98–104.
Gardner, B., & Tang, V. (2014). Reflecting on non-reflective action: An exploratory think-aloud study of self-report habit measures. British Journal of Health Psychology, 19, 258–273.
Gfroerer, J. (1985). Underreporting of drug use by youths resulting from lack of privacy in household interviews. In B. Rouse, N. Kozel, & L. Richards (Eds.), Self-report methods of estimating drug use: Meeting current challenges to validity. National Institute on Drug Abuse: Washington, D.C.
Gfroerer, J., Bose, J., Kroutil, L., Lopez, M., & Kann, L. (2012). Methodological considerations in estimating adolescent substance use. In Proceedings from the 2012 Joint Statistical Meetings, Section on Survey Research Methods (pp. 4127–4140).
Gfroerer, J., Eyerman, J., & Chromy, J. (2002). Redesigning an ongoing national household survey: Methodological issues. DHHS Pub. No. SMA 03-3768. Rockville, MD: Substance Abuse and Mental Health Services Administration.
Gfroerer, J., & Hughes, A. (1991). The feasibility of collecting drug abuse data by telephone. Public Health Reports, 106, 284–293.
Gfroerer, J., & Hughes, A. (1992). Collecting data on illicit drug use by phone. In C. Turner, J. Lessler, & J. Gfroerer (Eds.) Survey measurement of drug use: Methodological studies. DHHS Pub. No., ADM 92-1929. Rockville, MD: National Institute on Drug Abuse.
Gfroerer, J., Lessler, J., & Parsley, T. (1997a). Studies of nonresponse and measurement error in the National Households Survey on Drug Abuse. In L. Harrison & A. Hughes (Eds.), The validity of self-reported drug use: Improving the accuracy of survey estimates (pp. 97–4147). Rockville, MD: NIDA Research Monograph 167, NIH Pub No, National Institute on Drug Abuse.
Gfroerer, J., Wright, D., & Kopstein, A. (1997b). Prevalence of youth substance use: The impact of methodological differences between two national surveys. Drug and Alcohol Dependence, 47, 19–30.
Gmel, G. (2000). The effect of mode of data collection and of non-response on reported alcohol consumption: A split-sample study in Switzerland. Addiction, 95, 123–134.
Gmel, G., & Daeppen, J.-B. (2007). Recall bias for seven-day recall measurement of alcohol consumption among emergency department patients: Implications for case-crossover designs. Journal of Studies on Alcohol and Drugs, 68, 303–310.
Gmel, G., Graham, K., Kuendig, H., & Kuntsche, S. (2006). Measuring alcohol consumption—Should the ‘graduated frequency’ approach become the norm in survey research? Addiction, 101, 16–30.
Gmel, G., & Rehm, J. (2004). Measuring alcohol consumption. Contemporary Drug Problems, 31, 467–540.
Gmel, G., Studer, J., Deline, S., Baggio, S., N’Goran, A., Mohler-Kuo, M., et al. (2014). More is not always better—Comparison of three instruments measuring volume of drinking in a sample of young me and their association with consequences. Journal of Studies on Alcohol and Drugs, 75, 880–888.
Goldberg, M., Chastang, J. E., Zins, M., Niedhammer, I., & Leclerc, A. (2006). Health problems were the strongest predictors of attrition during follow-up of the GAZEL cohort. Journal of Clinical Epidemiology, 59, 1213–1221.
Goodstadt, M. S., & Grusin, V. (1975). The randomized response technique: A test on drug use. Journal of the American Statistical Association, 70, 814–818.
Gorman, E., Leyland, A. H., McCartney, G., White, I. R., Katikireddi, S. V., Rutherford, L., et al. (2014). Assessing the representativeness of population-sampled health surveys through linkage to administrative data on alcohol-related outcomes. American Journal of Epidemiology, 180, 941–948.
Grant, B. F., & Dawson, D. A. (1998). Age of onset of drug use and its association with DSMIV drug abuse and dependence: Results from the national longitudinal alcohol epidemiologic survey. Journal of Substance Abuse, 10, 163–173.
Grant, B. F., Harford, T. C., Dawson, D. A., Chou, P. S., & Pickering, R. P. (1995). The alcohol use disorder and associated disabilities interview schedule (AUDADIS): Reliability of alcohol and drug modules in a general population sample. Drug and Alcohol Dependence, 39, 37–44.
Greenfield, T. K., & Kerr, W. C. (2008). Alcohol measurement methodology in epidemiology: Recent advances and opportunities. Addiction, 103, 1082–1099.
Greenfield, T. K., Midanik, L. T., & Rogers, J. D. (2000). Effects of telephone versus face-to-face interview modes on reports of alcohol consumption. Addiction, 95, 277–284.
Gribble, J. N., Miller, H. G., Cooley, P. C., Catania, J. A., Pollack, L., & Turner, C. F. (2000). The impact of T-ACASI interviewing on reported drug use among men who have sex with men. Substance Use and Misuse, 36, 869–890.
Groves, R. M. (1989). Survey errors and survey costs. New York, NY: Wiley.
Groves, R. M., & Couper, M. P. (1998). Nonresponse in household surveys. New York, NY: Wiley.
Groves, R. M., Dillman, D. A., Eltinge, J. L., & Little, R. J. A. (2002). Survey nonresponse. New York, NY: Wiley.
Groves, R. M., & Peytcheva, E. (2008). The impact of nonresponse rates on nonresponse bias: A meta-analysis. Public Opinion Quarterly, 72, 167–189.
Grucza, R. A., Abbacchi, A. M., Przybeck, T. R., & Gfroerer, J. C. (2007). Discrepancies in estimates of prevalence and correlates of substance use and disorders between two national surveys. Addiction, 102, 623–629.
Guttmacher, S., Weitzman, B. C., Kapadeia, F., & Weinberg, S. L. (2002). Classroom-based surveys of adolescent risk-taking behaviors: Reducing the bias of absenteeism. American Journal of Public Health, 92, 235–237.
Halkitis, P. N., Fischgrund, B. N., & Parsons, J. T. (2005). Explanations for methamphetamine use among gay and bisexual men in New York City. Substance Use and Misuse, 40, 1331–1345.
Hall, W. (2014). What has research over the past two decades revealed about the adverse health effects of recreational cannabis use? Addiction, 110, 19–35.
Hansen, W. B., Collins, L. M., Malotte, C. K., Johnson, C. A., & Fielding, J. E. (1985). Attrition in prevention research. Journal of Behavioral Medicine, 8, 261–275.
Harrel, M. (1997). The validity of self-reported drug use data: The accuracy of responses on confidential self-administered answer sheets. In L. Harrison & A. Hughes (Eds.), The validity of self-reported drug use: Improving the accuracy of survey estimates (pp. 97–4147). Rockville, MD: NIDA Research Monograph 167, NIH Pub No, National Institute on Drug Abuse.
Harris, K. M., Griffin, B. A., McCaffrey, D. F., & Morral, A. R. (2008). Inconsistencies in self-reported drug use by adolescents in substance abuse treatment: Implications for outcome and performance measurements. Journal of Substance Abuse Treatment, 34, 347–355.
Harrison, L. D. (2001). Understanding the differences in youth drug prevalence rates produced by the MTF, NHSDA, and YRBS studies. Journal of Drug Issues, 31, 665–694.
Harrison, L. D., Martin, S. S., Enev, T., & Harrington, D. (2007). Comparing drug testing and self-report of drug use among youths and young adults in the general population. DHHS Pub. No. SMA 07-4249, Methodology Series M-7. Rockville, MD: Substance Abuse and Mental Health Services Administration.
Hasin, D., & Carpenter, K. M. (1998). Difficulties with questions on usual drinking and the measurement of alcohol consumption. Alcoholism, Clinical and Experimental Research, 22, 580–584.
Heckathorn, D. D. (1997). Respondent-driven sampling: A new approach to the study of hidden populations. Social Problems, 44, 174–199.
Heckathorn, D. D. (2002). Respondent driven sampling II. Deriving valid population estimates from chain-referral samples of hidden populations. Social Problems, 49, 11–34.
Hill, A., Roberts, J., Ewings, P., & Gunnell, D. (1997). Non-response bias in a lifestyle survey. Journal of Public Health Medicine, 19, 203–207.
Hilton, M. E. (1989). A comparison of a prospective diary and two summary recall techniques for recording alcohol consumption. British Journal of Addiction, 84, 1085–1092.
Hines, D. A., Douglas, E. M., & Mahmood, S. (2010). The effects of survey administration on disclosure rates to sensitive items among men: A comparison of an internet panel sample with a RDD telephone sample. Computers in Human Behavior, 26, 1327–1335.
Hochhauser, M. (1979). Bias in drug abuse survey research. International Journal of the Addictions, 14, 675–687.
Hoeymans, N., Feskens, E. J. M., van den Bos, G. A. M., & Kromhout, D. (1998). Non-response bias in a study of cardiovascular diseases, functional status and self-rated health among elderly men. Age and Ageing, 27, 35–40.
Horwood, L., Fergusson, D., Havatbakksh, M., Najman, J., Coffey, C., Patton, G. C., et al. (2010). Cannabis use and educational achievement: Findings from three Australasian cohort studies. Drug and Alcohol Dependence, 110, 247–253.
Hoyt, G. M., & Chaloupka, F. J. (1994). Effect of survey conditions on self-reported substance use. Contemporary Economic Policy, 12, 109–121.
Hser, Y. (1997). Self-reported drug use: Results of selected empirical investigations of validity. In L. Harrison & A. Hughes (Eds.), The validity of self-reported drug use: improving the accuracy of survey estimates (pp. 97–4147). Rockville, MD: NIDA Research Monograph 167, NIH Pub No, National Institute on Drug Abuse.
Hu, S. S., Balluz, L., Battaglia, M. P., & Frankel, M. R. (2011). Improving public health surveillance using a dual-frame survey of landline and cell phone numbers. American Journal of Epidemiology, 173, 703–711.
Hubbard, M. (1992). Laboratory experiments testing new questioning strategies. In C. F. Turner, J. T. Lessler, & J.C. Gfroerer (Eds.), Survey measurement of drug use. Rockville, MD: National Institute on Drug Abuse, Rockville.
Hubbard, M., Pantula, J., & Lessler, J. (1992). Effects of decomposition of complex concepts. In C. F. Turner, J. T. Lessler & J. C. Gfroerer (Eds.), Survey measurement of drug use. Rockville, MD: National Institute on Drug Abuse.
Hughes, A., Chromy, J., Giacoletti, K., & Odom, D. (2002). Impact of interviewer experience on respondent reports of substance use. In J. Gfroerer, J. Eyeman, & J. Chromy (Eds.), Redesigning an ongoing national household survey: Methodological issues. DHHS Publication No. SMA 03-3768, pp. 161-184. Rockville, MD: Substance Abuse and Mental Health Services Administration, Office of Applied Studies.
Humphrey, J. A., & Friedman, J. (1986). The onset of drinking and intoxification among university students. Journal of Studies on Alcohol, 47, 455–458.
Hunt, D. E., Kling, R., Almozlino, Y., Jalbert, S., Chapman, M. T., & Rhodes, W. (2015). Telling the truth about drug use: How much does it matter. Substance Abuse, 45, 314–329.
Iversen, L., & Klausen, H. (1986). Alcohol consumption among laid-off workers before and after closure of a Danish ship-yard: A 2-year follow-up study. Social Science and Medicine, 22, 107–109.
Jabine, T., Straf, M., Tanur, J., & Tourangeau, R. (1984). Cognitive aspects of survey methodology: Building a bridge between disciplines. Washington, D.C.: National Academy Press.
Johnson, T. P. (2014). Sources of error in substance use prevalence surveys. International Scholarly Research Notices, Article ID 923290. Retrieved from: http://dx.doi.org/10.1155/2014/923290
Johnson, T. P., & Bowman, P. J. (2003). Cross-cultural sources of measurement error in substance use surveys. Substance Use and Misuse, 38, 1447–1490.
Johnson, T., & Fendrich, M. (2005). Modeling sources of self-report bias in a survey of drug use epidemiology. Annals of Epidemiology, 15, 381–389.
Johnson, T. P., Fendrich, M., & Mackesy-Amiti, M. E. (2012). An evaluation of the validity of the Crowne-Marlowe need for approval scale. Quality & Quantity, 46, 1883–1896.
Johnson, T. P., Fendrich, M., Shaligram, C., Garcy, A., & Gillespie, S. (2000). An evaluation of the effects of interviewer characteristics in an RDD telephone survey of drug use. Journal of Drug Issues, 30, 77–102.
Johnson, T. P., Hougland, J., & Clayton, R. (1989). Obtaining reports of sensitive behaviors: A comparison of substance use reports from telephone and face-to-face interviews. Social Science Quarterly, 70, 174–183.
Johnson, T. P., & Mott, J. A. (2001). The reliability of self-reported age of onset of tobacco, alcohol, and illicit drug use. Addiction, 96, 1187–1198.
Johnson, T., O’Rourke, D., Chavez, N., Sudman, S., Warnecke, R., Lacey, L., et al. (1997). Social cognition and responses to survey questions among culturally diverse populations. In L. Lyberg, P. Biemer, M. Collins, E. de Leeuw, C. Dippo, N. Schwarz, & D. Trewin (Eds.), Survey measurement and process quality. New York, NY: Wiley.
Johnson, T. P., & Owens, L. (2004). Survey response rate reporting in the professional literature. In 2003 Proceedings of the Section on Survey Research Methods. Alexandria, VA: American Statistical Association.
Johnson, T. P., Parker, V., & Clements, C. (2001). Detection and prevention of data falsification in survey research. Survey Research, 32, 1–2.
Johnson, T. P., & Parsons, J. A. (1994). Interviewer effects on self-reported substance use among homeless persons. Addictive Behaviors, 19, 83–93.
Johnston, L. D., & O’Malley, P. M. (1997). The recanting or earlier reported drug use by young adults. In L. Harrison & A. Hughes (Eds.), The validity of self-reported drug use: Improving the accuracy of survey estimates (pp. 97–4147). Rockville, MD: NIDA Research Monograph 167, NIH Pub No, National Institute on Drug Abuse.
Jousilahti, P., Salomaa, V., Kuulasmaa, K., Niemelä, M., & Vartiainen, E. (2005). Total and cause specific mortality among participants and non-participants of population based health surveys: A comprehensive follow up of 54 372 Finnish men and women. Journal of Epidemiology and Community Health, 59, 310–315.
Kalsbeek, W. D. (2003). Sampling minority groups in health surveys. Statistics in Medicine, 22, 1527–1549.
Kandel, D. B. (1975). Reaching the hard-to-reach: Illicit drug use among high school absentees. Addictive Diseases, 1, 465–480.
Kann, L., Brener, N. D., Warren, C. W., Collins, J. L., & Giovino, G. A. (2002). An assessment of the effect of data collection setting on the prevalence of health-risk behaviors among adolescents. Journal of Adolescent Health, 31, 327–335.
Kaplan, C. D., Korf, D., & Sterk, C. (1987). Temporal and social contexts of heroin-using populations: An illustration of the snowball sampling technique. The Journal of Nervous and Mental Disease, 175, 566–574.
Kassira, E. N., Bauserman, R. L., Tomoyasu, N., Caldeira, E., Swetz, A., & Solomon, L. (2001). HIV and AIDS surveillance among inmates in Maryland prisons. Journal of Urban Health, 78, 256–263.
Keeter, S., Miller, C., Kohut, A., Groves, R. M., & Presser, S. (2000). Consequences of reducing nonresponse in a telephone survey. Public Opinion Quarterly, 64, 125–148.
Kerr, W. C., & Greenfield, T. K. (2007). Distribution of alcohol consumption and expenditures and the impact of improved measurement on coverage of alcohol sales in the 2000 National Alcohol Survey. Alcohol: Clinical and Experimental Research, 31, 1714–1722.
Kerr, W. C., & Stockwell, T. (2012). Understanding standard drinks and drinking guidelines. Drug and Alcohol Review, 21, 200–205.
Khadjesari, Z., Murray, E., Kalaitzaki, E., White, I. R., McCambridge, J., Gadfrey, C., et al. (2009). Test-retest reliability of an online measure of past week alcohol consumption (The TOT-AL), and comparison with face-to-face interview. Addictive Behaviors, 34, 337–342.
Kim, J., Dubowitz, H., Hudson-Martin, E., & Lane, W. (2008). Comparison of 3 data collection methods for gathering sensitive and less sensitive information. Ambulatory Pediatrics, 8, 255–260.
Kish, L. (1965). Survey sampling. New York, NY: Wiley.
Korkeila, K., Suominen, S., Ahvenainen, J., Ojanlatva, A., Rautava, P., Helenius, H., et al. (2001). Non-response and related factors in a nation-wide health survey. European Journal of Epidemiology, 17, 991–999.
Kroutil, L. A., Vorburger, M., Aldworth, J., & Colliver, J. D. (2010). Estimated drug use based on direct questioning and open-ended questions: Responses in the 2006 national survey on drug use and health. International Journal of Methods in Psychiatric Research, 19, 74–87.
Krumpal, I. (2013). Determinants of social desirability bias in sensitive surveys: A literature review. Quality & Quantity, 47, 2025–2047.
Kypri, K., Samaranayaka, A., Conner, J., Langley, J. D., & Maclennan, B. (2011). Non-response bias is a web-based health behavior survey of New Zealand tertiary students. Preventive Medicine, 53, 274–277.
Kypri, K., Stephenson, S., & Langley, J. (2004). Assessment of nonresponse bias in an internet survey of alcohol use. Alcoholism, Clinical and Experimental Research, 28, 630–634.
Lahaut, V. M. H. C. J., Jansen, H. A. M., van de Mheen, D., & Garretsen, H. F. L. (2002). Non-response bias in a sample survey on alcohol consumption. Alcohol and Alcoholism, 37, 256–260.
Lahaut, V. M. H. C. J., Jansen, H. A. M., van de Mheen, D., Garretsen, H. F. L., Verdurmen, J. E. E., & van Dijk, A. (2003). Estimating non-response bias in a survey of alcohol consumption: Comparison of response waves. Alcohol and Alcoholism, 38, 128–134.
Lamers, F., Hoogendoorn, A. W., Smit, J. H., van Dyck, R., Zitman, F. G., Nolen, W. A., et al. (2012). Sociodemographic and psychiatric determinants of attrition in the Netherlands Study of Depression and Anxiety (NESDA). Comprehensive Psychiatry, 53, 63–70.
Larsen, S. B., Dalton, S. O., Schüz, J., Christensen, J., Overvad, K., Tjønneland, A., et al. (2012). Mortality among participants and non-participants in a prospective cohort study. European Journal of Epidemiology, 27, 837–845.
Lavrakas, P. J. (2013). Applying a total error perspective for improving research quality in the social, behavioral, and marketing sciences. Public Opinion Quarterly, 77, 831–850.
Ledgerwood, D. M., Goldberger, B. A., Risk, N. K., Lewis, C. E., & Price, R. K. (2008). Comparison between self-report and hair analysis of illicit drug use in a community sample of middle-aged men. Addictive Behaviors, 33, 1131–1139.
Lemmens, P. H. H. M., Tan, E. S., & Knibbe, R. A. (1988). Bias due to non-response in a Dutch survey on alcohol consumption. British Journal of Addiction, 83, 1069–1077.
Leonard, K., Dunn, N. J., & Jacob, T. (1983). Drinking problems of alcoholics: Correspondence between self and spouse reports. Addictive Behaviors, 8, 369–373.
Levy, K. B., O’Grady, K. E., Wish, E. D., & Arria, A. M. (2005). An in-depth qualitative examination of the ecstasy experience: Results of a focus group with ecstasy-using college students. Substance Use and Misuse, 40, 1427–1441.
Lewin, T. (2002). Teenage drinking a problem but not in way study found. New York Times, February 27.
Lin, L. F., & Schaeffer, N. C. (1995). Using survey participants to estimate the impact of nonparticipation. Public Opinion Quarterly, 59, 236–258.
Link, M. W., & Mokdad, A. H. (2005). Effects of survey mode on self-reports of adult alcohol consumption: A comparison of mail, web and telephone approaches. Journal of Studies on Alcohol, 6, 239–245.
Livingston, M., Dietze, P. Ferris, J., Pennay, D., Hayes, L., & Lenton, S. (2013). Surveying alcohol and other drug use through telephone sampling: A comparison of landline and mobile phone samples. BMC Medical Research Methodology, 13.
Lowe, J. B., Windsor, R. A., Adams, B., Morris, J., & Reese, Y. (1986). Use of a bogus pipeline method to increase accuracy of self-reported alcohol consumption among women. Journal of Studies on Alcohol, 47, 173–175.
Luetgert, M. J., & Armstrong, A. H. (1973). Methodological issues in drug usage surveys: Anonymity, recency, and frequency. The International Journal of the Addictions, 8, 683–689.
Macera, C. A., Jackons, K. L., Davis, D. R., Kronenfeld, J. J., & Blair, S. N. (1990). Patterns of non-response to a mail survey. Journal of Clinical Epidemiology, 43, 1427–1430.
Mäkelä, P., & Huhtanen, P. (2010). The effect of survey sampling frame on coverage: The level of and changes in alcohol-related mortality in Finland as a test case. Addiction, 105, 1935–1941.
Malvin, J. H., & Moskowitz, J. M. (1983). Anonymous vs. identifiable self-reports of adolescent drug attitudes, intentions and use. Public Opinion Quarterly, 47, 557–566.
Martino, S. C., McCaffrey, D. F., Klein, D. J., & Ellickson, P. L. (2009). Recanting of life-time inhalant use: How big a problem and what to make of it. Addiction, 104, 1373–1381.
Mays, V. M., & Jackson, J. S. (1991). AIDS survey methodology with black Americans. Social Science and Medicine, 33, 47–54.
McAuliffe, W. E., Breer, P., Ahmadifar, N. W., & Spino, C. (1991). Assessment of drug abuser treatment needs in Rhode Island. American Journal of Public Health, 81, 365–371.
McCabe, S. E., Diez, A., Boyd, C. J., Nelson, T. F., & Weitzman, E. R. (2006). Comparing web and mail responses in a mixed mode survey in college alcohol use research. Addictive Behaviors, 31, 1619–1627.
McCabe, S. E., & West, B. T. (2016). Selective nonresponse bias in population-based survey estimates of drug use behaviors in the United States. Social Psychiatry and Psychiatric Epidemiology, 51, 141–153.
McCoy, T. P., Ip, E. H., Blocker, J. N., Champion, H., Rhodes, S. D., Wagoner, K. G., et al. (2009). Attrition bias in a U.S. internet survey of alcohol use among college freshmen. Journal of Studies on Alcohol, 70, 606–614.
McElrath, K. (2005). MDMA and sexual behavior: Ecstasy users’ perceptions about sexuality and sexual risk. Substance Use and Misuse, 40, 1461–1477.
McKnight, C., Des Jarlais, D., Bramson, H., Tower, C., Abdu-Quader, A. J., Nemeth, C., et al. (2006). Respondent-driven sampling in a study of drug users in New York City: Notes from the field. Journal of Urban Health, 83(suppl. 1), 54–59.
Meiklejohn, J., Connor, J., & Kypri, K. (2012). The effect of low survey response rates on estimates of alcohol consumption in a general population survey. PLOS One, 7(4), e35527. Accessed August 7, 2016 at: http://dx.doi.org/10.1371/journal.pone.0035527)
Mensch, B. S., & Kandel, D. B. (1988). Underreporting of substance use in a national longitudinal youth cohort: Individual and interviewer effects. Public Opinion Quarterly, 52, 100–124.
Merachnik, D. (1972). Why initiate a drug survey? In S. Einstein & S. Allen (Eds.), Proceedings of the First International Conference on Student Drug Surveys. Baywood: Farmingdale, NY.
Merkle, D., & Edelman, M. (2002). Nonresponse in exit polls: A comprehensive analysis. In R. M. Groves, D. A. Dillman, J. L. Eltinge, & R. J. A. Little (Eds.), Survey nonresponse. New York, NY: Wiley.
Merline, A., Jager, J., & Schulenberg, J. E. (2008). Adolescent risk factors for adult alcohol use and abuse: Stability and change of predictive value across early and middle adulthood. Addiction, 103, 84–99.
Mewton, L., Slade, T., Teesson, M., Memedovic, S., & Krueger, R. F. (2014). Improving the diagnostic criteria for alcohol use disorders through survey methodology and cognitive interviewing. International Journal of Methods in Psychiatric Research, 23, 359–371.
Meyer, I. H., & Wilson, P. A. (2009). Sampling lesbian, gay, and bisexual populations. Journal of Counseling Psychology, 56, 23–31.
Midanik, L. T. (1982). The validity of self-reported alcohol consumption and alcohol problems: A literature review. British Journal of Addiction, 77, 357–358.
Midanik, L. T. (1994). Comparing usual quantity/frequency and graduated frequency scales to assess yearly alcohol consumption: Results from the 1990 United States National Alcohol Survey. Addiction, 89, 407–412.
Midanik, L. T., & Greenfield, T. K. (2003). Telephone versus in-person interviews for alcohol use: Results of the 2000 National Alcohol Survey. Drug and Alcohol Dependence, 72, 209–214.
Midanik, L. T., Greenfield, T. K., & Rogers, J. D. (2001). Reports of alcohol-related harm: Telephone versus face-to-face interviews. Journal of Studies on Alcohol, 62, 74–78.
Midanik, L. T., & Hines, A. M. (1991). ‘Unstandard’ ways of answering standard questions: Protocol analysis in alcohol survey research. Drug and Alcohol Dependence, 27, 245–252.
Mieczkowski, T. (1989). The accuracy of self-reported drug use: An evaluation and analysis of new data. In N. A. Weiner & M. E. Wolfgang (Eds.), Pathways to criminal violence. Newbury Park, CA: Sage Publications.
Miller, P. V. (1997). Is ‘up’ right? The national household survey on drug abuse. Public Opinion Quarterly, 64, 627–641.
Miller, J. W., Gfroerer, J. C., Brewer, R. D., Maimi, T. S., Mokdad, A., & Giles, W. H. (2004). Prevalence of adult binge drinking: A comparison of two national surveys. American Journal of Preventive Medicine, 27, 197–202.
Moore, R. S., & Ames, G. M. (2002). Survey confidentiality vs. anonymity: Young men’s self-reported substance use. Journal of Alcohol & Drug Education, 47, 32–41.
Morgan, M. J. (1999). Memory deficits associated with recreational use of “ecstasy” (MDMA). Psychopharmacology (Berl), 141, 30–36.
Morral, A. R., McCaffrey, D. F., & Chien, S. (2003). Measurement of adolescent drug use. Journal of Psychoactive Drugs, 35, 301–309.
Morral, A. R., McCaffrey, D., & Iguchi, M. Y. (2000). Hardcore drug users claim to be occasional users: Drug use frequency underreporting. Drug and Alcohol Dependence, 57, 193–202.
Muhib, F. B., Lin, L. S., Stueve, A., Miller, R. L., Ford, W. L., Johnson, W. D., et al. (2001). A venue-based method for sampling hard-to-reach populations. Public Health Reports, 116, 216–222.
Mulford, H. A., & Miller, D. E. (1959). Drinking in Iowa, I. Sociocultural distribution of drinkers. Quarterly Journal of Studies on Alcohol, 20, 704–726.
Murray, D. M., & Perry, C. L. (1987). The measurement of substance use among adolescents: When is the ‘bogus pipeline’ method needed? Addictive Behaviors, 12, 225–233.
Needle, R. H., McCubbin, H., Lorence, J., & Hochhauser, M. (1983). Reliability and validity of adolescent self-reported drug use in a family-based study: A methodological report. International Journal of the Addictions, 18, 901–912.
Nelson, D. E., Naimi, T. S., Brewer, R. D., & Roeber, J. (2010). US state alcohol sales compared to survey data, 1993–2006. Addiction, 105, 1589–1596.
Nelson, D. E., Powell-Griner, E., Town, M., & Kovar, M. G. (2003). A comparison of national estimates from the National Health Interview Survey and the Behavioral Risk Factor Surveillance System. American Journal of Public Health, 93, 1335–1341.
O’Malley, P. M., Bachman, J. G., & Johnston, L. D. (1983). Reliability and consistency in self-reports of drug use. The International Journal of the Addictions, 18, 805–824.
O’Malley, P. M., Johnston, L. D., Bachman, J. G., & Schulenberg, J. (2000). A comparison of confidential versus anonymous survey procedures: Effects on reporting of drug use and related attitudes and beliefs in a national study of students. Journal of Drug Issues, 30, 35–54.
Osgood, D. W., Johnston, L. D., O’Malley, P. M., & Bachman, J. G. (1988). The generality of deviance in late adolescence and early adulthood. American Sociological Review, 53, 81–93.
Ouelett, L. J., Cagle, H. H., & Fisher, D. G. (1997). “Crack” versus “rock” cocaine: The importance of local nomenclature in drug research and education. Contemporary Drug Problems, 24, 219–237.
Owens, L., Johnson, T. P., & O’Rourke, D. (2001). Culture and item nonresponse in health surveys. In M. L. Cynamon & R. A. Kulka (Eds.), Seventh Conference on Health Survey Research Methods. DHHS Publication No. (PHS) 01-1013. Hyattsville, MD: National Center for Health Statistics.
Parrott, A. C., Lees, A., Garnham, N. J., Jones, M., & Wesnes, K. (1998). Cognitive performance in recreational users of MDMA or “ecstasy”: Evidence for memory deficits. Journal of Psychopharmacology, 12, 79–83.
Paschall, M., & Freisthler, B. (2003). Does heavy drinking affect academic performance in college? Findings from a prospective study of high achievers. Journal of Studies on Alcohol, 64, 515–519.
Paulhus, D. L. (1991). Measurement and control of response bias. In J. P. Robinson & P. R. Shaver (Eds.), Measures of personality and social psychological attitudes. San Diego, CA: Academic Press.
Percy, A., McAlister, S., Higgins, K., McCrystal, P., & Thornton, M. (2005). Response consistency in young adolescent’s drug use self-reports: A recanting rate analysis. Addiction, 100, 189–196.
Pernanen, K. (1974). Validity of survey data on alcohol use. In R. Gibbins, Y. Israel, H. Kalant, R. Papham, W. Schmidt, & R. Smart (Eds.), Research advances in alcohol and drug problems (Vol. 1). New York, NY: Wiley.
Perrine, M. W., Mundt, J. C., Searles, J. S., & Lester, L. S. (1995). Validation of daily self-reported alcohol consumption using interactive voice response (IVR) technology. Journal of Studies on Alcohol, 56, 487–490.
Petzel, T. P., Johnson, J. E., & McKillip, J. (1973). Response bias in drug surveys. Journal of Consulting and Clinical Psychology, 40, 437–439.
Plant, M. A., Chick, J., & Kreitman, N. (1980). The effects of response rates on levels of self-reported alcohol consumption and alcohol-related problems: Conclusions from a Scottish Study. British Journal on Alcohol and Alcoholism, 15, 158–163.
Plant, M. A., & Miller, T,-I. (1977). Disguised and undisguised questionnaires compared: Two alternative approaches to drinking behavior surveys. Social Psychiatry, 12, 21–24.
Pleck, J. H., Sonenstein, F. L., & Ku, L. (1996). Black-white differences in adolescent males’ substance use: Are they explained by underreporting by Blacks? Journal of Gender, Culture, and Health, 1, 247–265.
Poikolainen, K., & Kärkkäinen, P. (1983). Diary gives more accurate information about alcohol consumption than questionnaire. Drug and Alcohol Dependence, 11, 209–216.
Poikolainen, K., & Kärkkäinen, P. (1985). Nature of questionnaire options affects estimates of alcohol intake. Journal of Studies on Alcohol, 46, 219–222.
Poikolainen, K., Podkletnova, I., & Alho, H. (2002). Accuracy of quantity-frequency and graduated frequency questionnaires in measuring alcohol intake: Comparison with daily diary and commonly used laboratory markers. Alcohol and Alcoholism, 37, 573–576.
Popham, R. E., & Schmidt, W. (1981). Words and deeds: The validity of self-report data on alcohol consumption. Journal of Studies on Alcohol, 42, 355–358.
Poulin, C., MacNeil, P., & Mitic, W. (1993). The validity of a province-wide student drug survey: Lessons in design. Canadian Journal of Public Health, 84, 259–264.
Prause, J., Dooley, D., Ham-Rowbottom, K. A., & Emptage, N. (2007). Alcohol drinking onset: A reliability study. Journal of Child & Adolescent Substance Abuse, 16, 79–90.
Psaty, B. M., Cheadle, A., Koespsell, T. D., Diehr, P., Wickizer, T., Curry, S., et al. (1994). Race- and ethnicity-specific characteristics of participants lost to follow-up in a telephone cohort. American Journal of Epidemiology, 140, 161–171.
Ramirez-Valles, J., Kuhns, L. M., Campbell, R. T., & Diaz, R. M. (2010). Community involvement, stigmatized identities, and sexual risk in Latino sexual minorities. Journal of Health and Social Behavior, 51, 30–47.
Ramo, D. E., Liu, H., & Prochaska, J. J. (2012). Reliability and validity of young adults’ anonymous online reports of marijuana use and thoughts about use. Psychology of Addictive Behaviors, 26, 801–811.
Ramstedt, M. (2010). How much alcohol do you buy? A comparison of self-reported alcohol purchases with actual sales. Addiction, 105, 649–654.
Reardon, M. L., Burns, A. B., Preist, R., Sachs-Ericsson, N., & Lang, A. R. (2003). Alcohol use and other psychiatric disorders in the formerly homeless and never homeless: Prevalence, age of onset, comorbidity, temporal sequencing, and service utilization. Substance Use and Misuse, 38, 601–644.
Rehm, J. (1998). Measuring quantity, frequency, and volume of drinking. Alcohol: Clinical and Experimental Research, 22, 4S–14S.
Rhem, J., Greenfield, T. K., Walsh, G., Xie, X., Robson, L., & Single, E. (1999). Assessment methods for alcohol consumption, prevalence of high risk drinking and harm: A sensitivity analysis. International Journal of Epidemiology, 28, 219–224.
Richter, L., & Johnson, P. B. (2001). Current methods of assessing substance use: A review of strengths, problems, and developments. Journal of Drug Issues, 31, 809–832.
Ridolfo, H. (2011). Testing of the national HIV behavioral surveillance system: Results of interviews conducted 1/13/2011-4/5/2011. Hyattsville, MD: Questionnaire Design Research Laboratory, National Center for Health Statistics, Centers for Disease Control and Prevention. Available from: http://wwwn.cdc.gov/qbank/report/Ridolfo_NCHS_2011_NHBSS%20HIV.pdf#page=43
Robbins, C., & Clayton, R. R. (1989). Gender-related differences in psychoactive drug use among older adults. Journal of Drug Issues, 19, 207–219.
Romelsjö, A. (1989). The relationship between alcohol consumption and social status in Stockholm. Has the social pattern of alcohol consumption changed? International Journal of Epidemiology, 18, 842–851.
Room, R. (2007). Taking account of cultural and societal influences on substance use diagnoses and criteria. Focus, 5, 199–207.
Room, R., Janca, A., Bennett, L. A., Schmidt, L., & Sartorius, N. (1996). WHO cross-cultural applicability research on diagnosis and assessment of substance use disorders: An overview of methods and selected results. Addiction, 91, 199–220.
Rootman, I., & Smart, R. G. (1985). A comparison of alcohol, tobacco and drug use as determined from household and school surveys. Drug and Alcohol Dependence, 16, 89–94.
Safika, I., Johnson, T. P., & Levy, J. A. (2011). A venue analysis of predictors of alcohol use prior to sexual intercourse among female sex workers in Senggigi, Indonesia. International Journal of Drug Policy, 22, 49–55.
Satyanarayana, V. A., Vaddiparti, K., Chandra, P. S., O’Leary, C. C., Benegal, V., & Cottler, L. B. (2010). Problem drinking among married men in India: Comparison between husband’s and wife’s reports. Drug and Alcohol Review, 29, 557–562.
Schober, S., Caces, M.F., Pergamit, M., & Branden, L. (1992). Effects of mode of administration on reporting of drug use in the National Longitudinal Survey. In C. Turner, J. Lessler, & J. Gfoerer (Eds.), Survey measurement of drug use: methodological studies. DHHS Pub. No., ADM 92-1929. Rockville, MD: National Institute on Drug Abuse.
Schutz, C. G., & Chilcoat, H. D. (1994). Breach of privacy in surveys on adolescent drug use: A methodological inquiry. International Journal of Methods in Psychiatric Research, 4, 183–188.
Schwarz, N. (1999). Self-reports: How the questions shape the answers. American Psychologist, 54, 93–105.
Serdula, M. K., Mokdad, A. H., Byers, T., & Siegel, P. Z. (1999). Assessing alcohol consumption: Beverage-specific versus grouped-beverage questions. Journal of Studies on Alcohol, 60, 99–102.
Sharma, A. K., Aggarwal, O. P., & Dubey, K. K. (2002). Sexual behavior of drug-users: Is it different? Preventive Medicine, 34, 512–515.
Shield, K. D., & Rehm, J. (2012). Difficulties with telephone-based surveys on alcohol consumption in high-income countries: The Canadian example. International Journal of Methods in Psychiatric Research, 21, 17–28.
Shillington, A. M., & Clapp, J. D. (2000). Self-report stability of adolescent substance use: Are there differences for gender, ethnicity and age? Drug and Alcohol Dependence, 60, 19–27.
Shillington, A. M., Clapp, J. D., & Reed, M. B. (2011a). The stability of self-reported marijuana use across eight years of the National Longitudinal Survey of Youth. Journal of Child & Adolescent Substance Abuse, 20, 407–420.
Shillington, A. M., Clapp, J. D., Reed, M. B., & Woodruff, S. I. (2011b). Adolescent alcohol use self-report stability: A decade of panel study data. Journal of Child & Adolescent Substance Abuse, 20, 63–81.
Shillington, A. M., Reed, M. B., Clapp, J. D., & Woodruff, S. I. (2011c). Testing the length of time theory of recall decay: Examining substance use report stability with 10 years of National Longitudinal Survey of Youth data. Substance Use and Misuse, 46, 1105–1112.
Shillington, A. M., Roesch, S. C., Reed, M. B., Clapp, J. D., & Woodruff, S. I. (2011d). Typologies of recanting of lifetime cigarette, alcohol and marijuana use during a six-year longitudinal panel study. Drug and Alcohol Dependence, 118, 134–140.
Shillington, A. M., Woodruff, S. I., Clapp, J. D., Reed, M. B., & Lemus, H. (2012). Self-reported age of onset and telescoping for cigarettes, alcohol, and marijuana: Across eight years of the National Longitudinal Survey of Youth. Journal of Child & Adolescent Substance Abuse, 21, 333–348.
Siddiqui, O., Mott, J. A., Anderson, T. L., & Flay, B. R. (1999). Characteristics of inconsistent respondents who have “ever used” drugs in a school-based sample. Substance Use and Misuse, 34, 269–295.
Simpura, J., & Poikolainen, K. (1983). Accuracy of retrospective measurement of individual alcohol consumption in men: A re-interview after 18 years. Journal of Studies on Alcohol, 44, 911–917.
Sims, M. (1969). Comparison of sales figures of alcoholic beverages with types and amounts reported by canadian facts company, limited, in a market survey, Toronto, CAN: Addiction Research Foundation, Substudy No. 1-29-69.
Single, E., Kandel, D., & Johnson, B. (1975). The reliability and validity of drug use responses in a large scale longitudinal survey. Journal of Drug Issues, 5, 426–443.
Slade, T., Teesson, M., Mewton, L., Mmedovic, S., & Krueger, R. F. (2013). Do young adults interpret the DSM diagnostic criteria for alcohol use disorders as intended? A cognitive interviewing study. Alcoholism Clinical and Experimental Research, 37, 1001–1007.
Smith, P. E., Remington, P. L., Williamson, D. F., & Anda, R. F. A. (1990). A comparison of alcohol sales data with survey data on self-reported alcohol use in 21 states. American Journal of Public Health, 80, 309–312.
Snow, D. L., Tebes, H. K., & Arthur, M. W. (1992). Panel attrition and external validity in adolescent substance use research. Journal of Consulting and Clinical Psychology, 60, 804–807.
Sobell, L. C., Agrawal, S., & Sobell, M. B. (1997). Factors affecting agreement between alcohol abusers’ and their collaterals’ reports. Journal of Studies on Alcohol, 59, 405–413.
Sobell, L. C., Cellucci, T., Nirenberg, T. D., & Sobell, M. B. (1982). Do quantity-frequency data underestimate drinking-related health risks? American Journal of Public Health, 72, 823–828.
Sobell, L. C., & Sobell, M. B. (2003). Alcohol consumption measures. In J. P. Allen & V. B. Wilson (Eds.), Assessing alcohol problems: A guide for clinicians and researchers, Second Edition. NIH Pub. No. 03-3745. Bethesda, MD: National Institute on Alcohol Abuse and Alcoholism.
Solowij, N., & Battisti, R. (2008). The chronic effects of cannabis on memory in humans: A review. Current Drug Abuse Reviews, 1, 81–98.
Steeh, C., Kirgis, N., Cannon, B., & DeWitt, J. (2001). Are they really as bad as they seem? Nonresponse rates at the end of the 20th Century. Journal of Official Statistics, 17, 227–247.
Stockwell, T., Donath, S., Cooper-Stanbury, M., Chiritzhs, T., Catalano, P., & Mateo, C. (2004). Under-reporting of alcohol consumption in household surveys: A comparison of quantity-frequency, graduated-frequency and recent recall. Addiction, 99, 1024–1033.
Stockwell, T., Zhao, J., Chiritzhs, T., & Greenfield, T. K. (2008). What did you drink yesterday? Public health relevance of a recent recall method used in the 2004 Australian National Drug Strategy Household Survey. Addiction, 103, 919–928.
Stone, A. A., Turkkan, J. S., Bachrach, C. A., Jobe, J. B., Kurtzman, H. S., & Cain, V. S. (2000). The science of self-report: Implications for research and practice. Mahwah, NJ: Lawrence Erlbaum Associates.
Stueve, A., & O’Donnell, L. N. (1997). Item nonresponse to questions about sex, substance use, and school: Results from the reach for health study of African American and Hispanic young adolescents. In J. H. J. Bancroft (Ed.), Researching sexual behavior: Methodological issues. Bloomington, IN: Indiana University Press.
Sudman, S., Bradburn, N. M., & Schwarz, N. (1996). Thinking about answers: The applications of cognitive processes to survey methodology. San Francisco, CA: Jossey-Bass.
Swadi, H. (1990). Validating and improving the validity of self-reports in adolescent substance misuse surveys. Journal of Drug Issues, 20, 473–486.
Swaim, R. C., Beauvais, E. L., Chavez, E. L., & Oetting, E. R. (1997). The effect of school dropout rates on estimates of substance use among three racial/ethnic groups. American Journal of Public Health, 87, 51–55.
Tassiopoulos, K., Bernstein, J., Heeren, T., Levenson, S., Hingson, R., & Berstein, E. (2006). Predictors of disclosure of continued cocaine use. Addictive Behaviors, 31, 80–89.
Thrasher, J. F., Quah, A. C. K., Dominick, G., Borland, R., Driezen, P., Awang, R., et al. (2011). Using cognitive interviewing and behavioral coding to determine measurement equivalence across linguistic and cultural groups: An example from the International Tobacco Control Policy Evaluation Project. Field Methods, 23, 439–460.
Thygesen, L. C., Johansen, C., Keiding, N., Giovannucci, E., & Grønbæk, M. (2008). Effects of sample attrition in a longitudinal study of the association between alcohol intake and all-cause mortality. Addiction, 103, 1149–1159.
Tibblin, G. (1965). A population study of 50-year-old men: An analysis of the non-participation group. Acta Medica Scandinavica, 178, 453–459.
Tolonen, H., Laatikainen, T., Helakorpi, S., Talala, K., Martelin, T., & Prättälä, R. (2010). Marital status, educational level and household income explain part of the excess mortality of survey non-respondents. European Journal of Epidemiology, 25, 69–76.
Torvik, F. A., Rognmo, K., & Tambs, K. (2012). Alcohol use and mental distress as predictors of non-response in a general population health survey: The HUNT study. Social Psychiatry and Psychiatric Epidemiology, 47, 805–816.
Tourangeau, R. (2000). Remembering what happened: Memory errors and survey reports. In A. A. Stone, J. S. Turkkan, C. A. Bachrach, J. B. Jobe, H. S. Kurtzman, & V. S. Cain (Eds.), The science of self report: Implications for research and practice. Mahwah, NJ: Lawrence Erlbaum Associates.
Tourangeau, R., Rips, L. J., & Raskinski, K. (2000). The psychology of survey response. Cambridge, UK: Cambridge University Press.
Tourangeau, R., & Smith, T. W. (1996). Asking sensitive questions: The impact of data collection mode, question format, and question context. Public Opinion Quarterly, 60, 275–304.
Tourangeau, T., Smith, T. W., & Rasinski, K. (1997). Motivation to report sensitive behaviors in surveys: Evidence from a bogus pipeline experiment. Journal of Applied Social Psychology, 27, 209–222.
Tourangeau, R., & Yan, T. (2007). Sensitive questions in surveys. Psychological Bulletin, 133, 869–883.
Traugott, M., & Katosh, J. P. (1979). Response validity in surveys of voting behavior. Public Opinion Quarterly, 43, 359–377.
Trinkoff, A. M., & Storr, C. L. (1997). Collecting substance use data with an anonymous mailed survey. Drug and Alcohol Dependence, 48, 1–8.
Turner, C. F., Gribble, J. N., Al-Tayyib, A. A., & Chromy, J. R. (2002). Falsification in epidemiologic surveys: Detection and remediation (Prepublication Draft). Technical Papers on Health and Behavior Measurement, No. 53. Washington, D. C.: Research Triangle Institute. Available from: http://qcpages.qc.cuny.edu/~cturner/TechPDFs/53_Falsify.pdf
Turner, C. F., Lessler, J. T., & Devore, J. (1992). Effects of mode of administration and wording on reporting of drug use. In C. Turner, J. Lessler, & J. Gfroerer (Eds.), Survey measurement of drug use: Methodological Studies. DHHS Pub. No., ADM 92-1929. Rockville, MD: National Institute on Drug Abuse.
United States General Accounting Office. (1993). Drug use measurement: Strengths, limitations, and recommendations for improvement, GAO/PEMD-93-18. Washington, D.C.: Program Evaluation and Methodology Division.
Valleroy, L. A., MacKellar, D. A., Karon, J. M., Rosen, D. H., McFarland, W., Shehan, D. A., et al. (2000). HIV prevalence and associated risks in young men who have sex with men. Young Men’s survey study group. Journal of the American Medical Association, 284, 198–204.
Van Gorp, W. G., Wilkins, J. N., Hinkin, C. H., Moore, L. H., Hull, J., Horner, M. D., et al. (1999). Declarative and procedural memory functioning in abstinent cocaine abusers. Archives of General Psychiatry, 56, 85–89.
Van Loon, A. J. M., Tijhuis, M., Picavet, H. S. J., Surtees, P. G., & Ormel, J. (2003). Survey non-response in the Netherlands: Effects on prevalence estimates and associations. Annals of Epidemiology, 13, 05–110.
Vonmoos, M., Hulka, L. M., Prelier, K. H., Baumgartner, M. R., Stohler, R., Bolla, K. I., et al. (2013). Cognitive dysfunctions in recreational and dependent cocaine users: Role of attention-deficit hyperactivity disorder, craving and early age of onset. British Journal of Psychiatry, 203, 35–43.
Wagner, J., & Lee, S. (2015). Sampling rare populations. In T. P. Johnson (Ed.), Handbook of health survey methods. New York, NY: Wiley.
Warner, S. L. (1965). Randomized response: A survey technique for eliminating evasive answer bias. Journal of the American Statistical Association, 60, 63–69.
Watten, R. G. (1996). Coping styles in abstainers from alcohol. Psychopathology, 29, 340–346.
Weinfurt, K. P., & Bush, P. J. (1996). Contradictory subject response in longitudinal research. Journal of Studies on Alcohol, 57, 273–282.
Weisner, C., Schmidt, L., & Tam, T. (1995). Assessing bias in community-based prevalence estimates: Towards an unduplicated count of problem drinkers and drug users. Addiction, 90, 391–405.
Weissman, A. N., Steer, R. A., & Lipton, D. S. (1986). Estimating illicit drug use through telephone interviews and he randomized response technique. Drug and Alcohol Dependence, 18, 225–233.
Welte, J. W., & Russell, M. (1993). Influence of socially desirable responding in a study of stress and substance abuse. Alcoholism, Clinical and Experimental Research, 17, 758–761.
Werch, C. E., Gorman, D. R., Marty, P. J., Forbess, J., & Brown, B. (1987). Effects of the bogus-pipeline on enhancing validity of self-reported adolescent drug use measures. Journal of School Health, 57, 232–236.
Whitehead, P., & Smart, R. (1972). Validity and reliability of self-reported drug use. Canadian Journal of Criminology and Corrections, 14, 1–8.
Wild, T. C., Cunningham, J., & Adlaf, E. (2001). Nonresponse in a follow-up to a representative telephone survey of adult drinkers. Journal of Studies on Alcohol, 62, 257–261.
Willis, G. (1997). The use of the psychological laboratory to study sensitive survey topics. In L. Harrison & A. Hughes (Eds.), The validity of self-reported drug use: Improving the accuracy of survey estimates (pp. 97–4147). Rockville, MD: NIDA Research Monograph 167, NIH Pub No, National Institute on Drug Abuse.
Wilson, P. (1981). Improving the methodology of drinking surveys. The Statistician, 30, 159–167.
Winters, K. C., Stinchfield, R. D., Henly, G. A., & Schwartz, R. H. (1991). Validity of adolescent self-report of alcohol and other drug involvement. International Journal of the Addictions, 25, 1379–1395.
Wish, E. D., Hoffman, J. A., & Nemes, S. (1997). The validity of self-reports of drug use at treatment admission and at follow-up: Comparisons with urinalysis and hair assays. In L. Harrison & A. Hughes (Eds.), The validity of self-reported drug use: improving the accuracy of survey estimates (pp. 97–4147). Rockville, MD: NIDA Research Monograph 167, NIH Pub No, National Institute on Drug Abuse.
Witt, M., Pantula, J., Folsom, R., & Cox, C. (1992). Item nonresponse in 1988. In C. F. Turner, J. T. Lessler, & J. C. Gfroerer (Eds.), Survey measurement of drug use: Methodological studies. Rockville, MD: National Institute on Drug Abuse.
Wolff, K., Farrell, M., Marsden, J., Monteiro, M. G., Ali, R., Welch, S., et al. (1999). A review of biological indicators of illicit drug use, practical considerations and clinical usefulness. Addiction, 94, 1279–1298.
Zanes, A., & Matsoukas, E. (1979). Different settings, different results? A comparison of school and home responses. Public Opinion Quarterly, 43, 550–557.
Zhao, J., Stockwell, T., & MacDonald, S. (2009). Non-response bias in alcohol and drug population surveys. Drug and Alcohol Review, 28, 648–657.
Acknowledgements
An earlier version of this chapter was published as Johnson (2014) Sources of error in substance use prevalence surveys, International Scholarly Research Notices, Article ID 923290.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this chapter
Cite this chapter
Johnson, T.P., VanGeest, J.B. (2017). Using Surveys to Study Substance Use Behavior. In: VanGeest, J., Johnson, T., Alemagno, S. (eds) Research Methods in the Study of Substance Abuse. Springer, Cham. https://doi.org/10.1007/978-3-319-55980-3_13
Download citation
DOI: https://doi.org/10.1007/978-3-319-55980-3_13
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-55978-0
Online ISBN: 978-3-319-55980-3
eBook Packages: Social SciencesSocial Sciences (R0)