Abstract
Loot boxes are randomised rewards available in some video games, often purchasable for real-world money. Loot boxes have been likened to conventional forms of gambling and may satisfy legal requirements to be considered bona fide gambling in some jurisdictions. Research has consistently shown that people with problem gambling symptoms report spending more on these mechanisms than people without such symptoms. However, a significant gap in our current understanding is whether engaging with these mechanisms is associated with harm. Here we examine the prevalence rates of severe psychological distress among purchasers of loot boxes relative to non-purchasers. A reanalysis of two cross-sectional surveys collected online via online collection platforms. Participants were 2432 Aotearoa New Zealand, Australian, and United States residents recruited through online survey. Our results show that purchasers of loot boxes are at approximately 1.87 times higher risk of severe psychological distress on a standardised clinical screening tool than people who do not purchase loot boxes. These relative risk rates are not due to gender, age, spending on other video game related purchases, or problem gambling symptoms. Individuals who purchased loot boxes appeared to also have higher risk of severe psychological distress irrespective of demographic characteristics or problem gambling status. Loot boxes appear to be associated with significantly higher risk of experiencing psychological harm even for players without problem gambling symptoms.
Similar content being viewed by others
Introduction
Loot boxes are randomised rewards in some video games, often available for purchase with real world money1. Almost 40% of popular PC (Steam) games and 60% of popular smart phone games contain loot boxes2. Loot boxes generated approximately $15 billion US in 2020 alone3. The randomised nature of loot box rewards, and their delivery on an intermittent reward schedule, has prompted concerns that they are psychologically akin to conventional gambling1,4,5.
The structural characteristics of loot boxes appear to be psychologically similar to conventional gambling by involving an optional monetary purchase of an unknown, chance-based outcome, resulting in some players winning and others losing1,4. It is perhaps these similarities to conventional gambling which lead participants with problem gambling symptoms to typically report spending more on loot boxes than participants without such symptoms6,7,8,9,10; a robust small-moderate relationship confirmed by meta-analysis11, and one that is stronger for adolescents than adults12,13. Further, when loot boxes are removed from a game, it is primarily problem gamblers who report reduced spending14. Interestingly, the relationship between problem gambling symptoms and purchasing does not occur for other, less immediately available randomised purchases (e.g., collectable card games15). This differential association with psychopathology implies that some randomised purchases—such as loot boxes—have a greater potential for harm than others (e.g., collectable card games).
Moreover, virtual items have value to players, with some players spending substantial amounts of real-world money to acquire them16. These virtual items are sometimes traded in legitimate marketplaces16 and, when legitimate marketplaces are unavailable, grey marketplaces have emerged16. Recently, black market economies have also developed, with some players spending in excess of 1000 euros per item to bypass the randomised loot box systems and purchase the rarest items17. As virtual items obtained from loot boxes have value to players, they may satisfy the requirements of a prize, making them potentially suitable for regulation under some jurisdictions’ existing gambling legislation16. Some policymakers have opted to regulate these systems under existing gambling legislation, while others have implemented warning labels or odds disclosure requirements18.
Loot boxes and harm
A significant gap in the literature, however, is whether loot boxes are associated with harm19. Although disproportionate purchasing of loot boxes by a vulnerable group of problem gamblers might imply the existence of harm, this does not conclusively show that loot boxes are associated with harm per se19. Here, we combine two large independent datasets7,8, and make important strides toward addressing this issue by demonstrating that those who have purchased loot box have surprisingly high rates of severe psychological distress—as indexed by a standardised psychiatric screening measure, reliably predictive of clinical anxiety and depression disorders. Further, these rates are not due to gender or age. These rates exceed the rates observed for people who spend money on other kinds of video game related purchases including games, downloadable content, and non-randomised in-game virtual items. Thus, the higher rates of severe psychological distress are unlikely to be attributable to the population of gamers generally, or indicate that loot box purchasing represents a generalised form of “retail therapy” (because the higher rates of distress are not associated with other video game purchases). Most importantly, these rates are not explained by problem gambling symptoms: even those without problem gambling symptoms may experience psychological harms from engaging with loot boxes.
Psychological distress
In two separate studies we included the Kessler-10 Psychological Distress Scale to assess whether loot box spending was associated with psychological distress7,8. The Kessler-10 asks participants to indicate how frequently during the past 30 days they have experienced certain symptoms of psychological distress—for instance “About how often did you feel so nervous that nothing could calm you down?”. Weak correlations were observed between loot box spending and psychological distress in both of these studies, a finding we initially interpreted as being unlikely to be clinically meaningful due to the small effect size. To foreshadow, the reanalyses presented here imply we were wrong.
We had two primary motivations for reanalysing the psychological distress data of our previous two studies. First, as noted earlier, the previous analyses of psychological distress were designed to determine whether the continuous measures of psychological distress were correlated with loot box spending. Although interesting, this does not speak to the issue of clinical harm raised by critics of loot box regulation per se19. To understand whether loot box purchasing was associated with clinical harm in our sample, a more important question was whether participants were exceeding thresholds indicating clinically meaningful levels of distress on the Kessler-10. Indeed, the primary purpose of the Kessler-10 is to identify respondents that exceed normed population scores for psychological distress, and who are likely to be at risk for a diagnosable clinical psychological disorder. The Kessler-10 is widely employed as a validated standardized screening measure to identify individuals likely to have serious mental illness/psychopathology, such as a clinical affective disorder (e.g., anxiety/depression)20,21. Although concerns exist about the use of the Kessler-10 in culturally diverse settings22, it has been demonstrated as an effective screening tool for affective disorders in US20,21, Australian23, and Aotearoa New Zealand24 populations (the three populations sampled in the datasets re-analysed herein). The Kessler-10 has excellent discrimination for identifying affective disorders20. Taking a Bayesian probability updating perspective, assuming that any individual in the population has a base-rate for a mental disorder of around 20%, a very high score (30 or more) on the Kessler-10 increases the posterior probability of an individual having a diagnosable affective disorder to over 80%23. For this reason, extreme scores on the Kessler-10 are a valid proxy for population prevalence estimates for serious mental illness24. Second, recent evidence suggests that Kessler Psychological Distress Scales may have poor sensitivity to change when employed as a continuous outcome measure, and therefore may have limited utility in detecting subtle differences in psychological distress25. For both of these reasons, and given the need to better understand the potential for harm associated with loot box purchasing19, we evaluated whether our data showed any evidence for serious mental distress for individuals who had purchased loot boxes based on a categorical assessment of whether reported distress level met thresholds to be considered clinically meaningful.
Methods
Participants
We combined data from two different datasets collected to examine the relationship between loot box purchasing and problem gambling symptoms7,8. The first dataset was collected in 2019, and contained 436 United States, 433 Australian and 419 Aotearoa New Zealand participants using Qualtrics’ survey targeting tool. The second dataset was collected in 2020 using Prolific Academic, and contained 930 United States, 173 Australian and 41 Aotearoa New Zealand participants. There were no significant differences in psychological distress across these two datasets, χ2 (1, 2464) = 0.05, p = 0.826. When combined, these datasets provided us with a sample of 1366 United States respondents, 606 Australian respondents, and 460 Aotearoa New Zealand respondents. One thousand three hundred and fifteen (1315) participants identified as female, 1076 identified as male, and 41 identified as other. As in the original studies, we excluded participants who failed any attention check. For both datasets, ethics approval was obtained for human data collection from Massey University’s Human Ethics Southern B Committee, Approval number SOB 19/11. In both studies all research was performed in accordance with the relevant guidelines and regulations, and participants gave informed consent to participate in the study. We included dataset as a factor in all analyses to ensure that the different studies and the associated time-periods for data collection did not systematically alter our results. This was especially important as the second dataset was gathered during the COVID-19 pandemic.
In both studies, participants answered a series of questions about their gambling behaviours, loot box purchasing and spending behaviours, and their psychological distress over the past month. In both studies, the core association of interest was the association between problem gambling symptomatology and loot box spending. Participants then reported their gender (male, female, non-binary, other, prefer not to disclose) and age.
Measures
Age
In both studies, participants indicated their age by responding to the question ‘What is your age?’ using a drop down menu to indicate their current age in years.
Gender
In both studies, participants were asked “What is your gender”. Response options were male, female, non-binary, prefer not to say, other (please specify).
Dataset
Dataset was dummy coded to ensure that differences between the two studies were not contributing systematic noise to the data. Dataset was coded as either Study 1, or Study 2.
Psychological distress
Psychological distress was measured using the validated Kessler-10 psychological distress scale20,21. Exceeding a score of 30 on this scale indicates severe psychological distress and high risk for an affective disorder20,21. Participants were coded as either having exceeded this criterion or not. Internal reliability of this scale was high (α = 0.915)7.
Problem gambling symptoms
Problem gambling symptoms were measured using the Problem Gambling Severity Inventory (PGSI)26. This inventory produces a continuous measure of problem gambling symptomology which can be used to classify gamblers into four categories, non-problem gamblers, low-risk gamblers, moderate risk gamblers, and problem gamblers. Participants who score 0 on the scale are considered non-problem gamblers; low risk gamblers score 1–2 on the PGSI; moderate risk gamblers = 3–7 on the PGSI and problem gamblers score 8 or higher on the PGSI26.
Loot box purchasing
Participants reported how much money they had spent on loot boxes in the past month in their own currency. All currencies were then converted to US dollars according to the currency conversion rates at the time. For Dataset 1, we converted all spending into US dollars (USD) on the 2nd of October, 2019, using the listed currency conversion rates of the day using Google’s currency conversion. For Australian purchases, this resulted in the spending data being 0.67 times the reported amount, and for Aotearoa New Zealand purchases, this resulted in the spending data being 0.62 times the reported amount7. For Dataset 2, we converted all currencies into US dollars on the 21st of April, 2020 using the listed currency conversion rates of the day using Google’s currency conversion, which were the following exchange rates: $USD = 0.63*AUD; $USD = 0.60*$NZD8.
Other forms of game-related purchasing
Participants were asked to report how much money they had spent on buying video games, on downloadable content, and on other forms of non-randomised in game content in the past month in their own currency. As reported above in the loot box spending questions, all currencies were then converted to US dollars according the currency conversion rates at the time of data collection using the conversion rates specified above.
Relative risk estimates
For all chi-square analyses incorporating no statistical control variables, relative risk was directly calculated from the percentages by JAMOVI version 1.6.1.5. For binomial logistic regression analyses, JAMOVI only provides Odds Ratios. Therefore, we converted these Odds Ratios to Relative Risks using the formula detailed in Grant27. Manual estimation of the Relative Risks using the estimated marginal means provided by JAMOVI yielded almost identical results.
Results
First we examined whether the proportion of people scoring within the very high range on the Kessler-10 was higher for those that purchased loot boxes than those that did not. Many players that purchase loot boxes spend less than $15–25 US per month on loot boxes7,8. Thus, we might not expect differences in distress between individuals that purchased loot boxes and those that did not. If loot box purchasing is associated with distress, it seemed most likely that only the highest loot box spenders would be at elevated risk of severe distress. We were therefore surprised to find that the Relative Risk (RR) of being in the very high distress range increased markedly for those that purchased loot boxes (i.e., those who reported spending any money on loot boxes) compared to those that did not. For players that did not purchase loot boxes, 23.5% of players were suffering from severe psychological distress. In contrast, 43.9% of players that purchased loot boxes suffered from severe psychological distress. Thus, those that purchased loot boxes were at 1.87 [1.62, 2.16] times the risk of experiencing severe distress than non-purchasers, χ2 (1, 2462) = 61.0, p < 0.001. When included in a binomial logistic regression analysis with age as a covariate and gender and dataset as factors (see Table 1), the players that purchased loot boxes remained at significantly greater risk of severe psychological distress than players that did not purchase loot boxes, RR = 1.79 [1.53, 2.05], p < 0.001.The unexpectedly large size of these effects suggested to us the possibility that these differences may be attributable to a third variable. We subsequently examined (a) whether the effects were partially or fully attributable to a ‘retail therapy’ effect of purchasing patterns more generally, and (b) whether the previously observed association between loot box spending and problem gambling symptomology might partially or fully account for the observed associations.
First, we considered whether this effect might indicate a more general ‘retail therapy’ effect, where gamers experiencing severe distress might be spending more, via their hobby, in an attempt to improve their mood28. If so, gamers who spend money on any gaming-related purchases may be more likely to score in the very high range of the Kessler-10. To test this, we examined the relationship between Kessler-10 scores and spending on non-randomised video game purchases—namely games themselves, downloadable content (a form of non-randomised video game expansion), and other non-randomised in-game purchases (e.g., non-randomised virtual items). The data did not support the notion that distress was similarly elevated for all forms of gaming-related purchases. Although participants who spent any money on games, downloadable content for games, or other non-randomised in-game purchases were at slightly higher risk of scoring very high on the Kessler-10, these relative risks were consistently lower than the relative risk for those that purchased loot boxes (see Fig. 1). When these forms of spending were included in a binomial logistic regression with age as a covariate, and gender and dataset as factors (see Table 2), players that purchased loot boxes remained at substantially heightened risk compared to those that did not purchase loot boxes, RR = 1.55 [1.26, 1.85], p < 0.001. Other forms of video game related spending did not significantly predict distress, though spending on downloadable content was close to significance RR = 1.22 [0.99, 1.47], p = 0.053 (spending on games, p = 0.630, spending on other in-game content, p = 0.316). This implies that purchasers of downloadable content may be at slightly higher risk, but further research into this form of spending is required.
Research consistently indicates that problem gamblers spend more on loot boxes than non-problem gamblers11, and it is well known that problem gambling symptoms are associated with poor psychological wellbeing29. We therefore considered next whether the heightened distress observed for players that purchased loot boxes might be due to loot boxes being disproportionately purchased by those with problem gambling symptoms whose heightened risk of severe psychological distress may be due to their problem gambling symptoms and not loot box purchasing. Results of these analyses are shown in Table 3. A binomial logistic regression incorporating demographic characteristics, dataset, and problem gambling classification revealed that problem gamblers were at 2.88 [2.50, 3.25] times the risk of being severely psychologically distressed as non-problem gamblers, p < 0.001. However, players that purchased loot boxes remained at substantially heightened risk than non-purchasers when we statistically controlled for problem gambling classification, RR = 1.28 [1.05, 1.54], p = 0.017. Similar associations for players that purchased loot boxes were observed if raw problem gambling symptom scores, rather than problem gambling classification was employed, with players that purchased loot boxes being at elevated risk relative to those that did not, RR = 1.24 [1.01, 1.50], p = 0.039. Thus, although problem gambling symptoms explained a substantial amount of the elevated risk of severe psychological distress for players that purchased loot boxes, some elevated risk remained when these symptoms were controlled for.
Prevalence at various spending rates
To test whether the association between distress and loot box spending is characterised by a spike in distress associated with a given spending level, or a more gradual positive relationship between the prevalence of severe psychological distress and spending on loot boxes, we plotted Risk Curves for the prevalence of severe psychological distress for participants who reported spending more than a given amount in five dollar increments from no spending until the 75th percentile of spending on loot boxes was reached (beyond the 75th percentile, our participant numbers were too small to provide reliable prevalence estimates). As shown in Fig. 2, the rise in prevalence for severe psychological distress occurs once any spending on loot boxes occurs, and then gradually rises until it asymptotes. There is a much less pronounced increase in risk associated with general spending on video games, again suggesting that the rise in prevalence rates was not due to spending on video games per se. Similar differences were observed between loot boxes and spending on downloadable content and other non-randomised in-game virtual items (see “Supplementary analyses” available online for additional Risk Curves).
Discussion
Loot boxes have often been likened to traditional forms of gambling. Despite growing evidence that people with problem gambling symptoms tend to spend more on these mechanisms than people without such symptoms, some have argued that further evidence of harm is necessary to justify regulation19. Here, we show that individuals that purchased loot boxes were at a moderately heightened risk of experiencing severe psychological distress compared to those that did not purchase loot boxes, based on a standardised psychiatric screening questionnaire. Such heightened distress is typically highly predictive of the presence of bona fide affective disorders in the Australian, Aotearoa New Zealand, and US populations; the populations from which these samples were drawn20,21,22,23,24.
Though the results are cross-sectional and correlational, several important analyses help rule out competing explanations for the elevated risk we find for those who purchase loot boxes. First, the heightened risk was present when gender and age were statistically controlled for, suggesting that these demographics were not responsible for the heightened risk. Second, the risks do not appear to be due to any form of game-related spending. Although slightly heightened risk was also present for those who reported spending money on other forms of game-related purchases, this did not explain the differences between those that did and did not purchase loot boxes: differences in relative risk persisted even when the other forms of game-related spending were statistically controlled. Third, the heightened risk associated with loot box purchasing was only partially attenuated when problem gambling status or symptomology were controlled for. Together, these findings suggest that loot box purchasing is associated with unique variance in severe psychological distress.
We cannot rule out reverse causality: those with greater risk of severe psychological distress might be more likely to spend money on loot boxes. However, two important points bear mentioning. First, increased prevalence of severe psychological distress was associated with loot box spending, but not with other game-related spending. This speaks against a “retail therapy” mechanism, where increased distress drives increased hobby-related spending. Such a mechanism would predict general increased spending, rather than a specific increase for spending on randomised items. Second, even if psychological distress was driving loot box purchasing, this would still be concerning. It would imply that a vulnerable group of gamers—those at high risk of bona fide affective disorders—were spending disproportionately on randomised in-game purchases relative to those at lower risk of affective disorders. As analyses were not pre-registered these results should be considered exploratory and replication is therefore required.
An additional consideration is the analysis strategy employed herein—analysing dichotomous outcome variables rather than the continuous measures from which they were computed. Such an analysis strategy undoubtedly results in a decrease in the fidelity of available information. However, we believe the approach is both appropriate and defensible. Although the Kessler-10 provides continuous measures of psychological distress, it also has clearly defined clinical cut-offs that yield high positive predictive value for bona-fide affective disorders20,23. Clinical psychology makes clear distinctions between clinical and sub-clinical psychopathology, and although they share similarities, the neurological areas implicated in clinical depression and anxiety appear to be distinct from their sub-clinical counterparts30. Thus, we believe the computation of relative risk from established K-10 cut-offs is an appropriate data analysis strategy, especially in the context of examining potential for psychological harms.
Risk Curve analyses identified that the rise in prevalence of severe psychological distress was evident as soon as any loot box spending was reported, with a further gradual rise in prevalence rates as spending increased, until it reached asymptote. This further highlights the potential harm of loot boxes: even small monetary spending on them is associated with increased risk of severe distress. This should give pause to those inclined to argue that the micro-transactional nature of loot boxes, or the typically low spending patterns observed in many studies, render loot boxes harmless. This data pattern may also explain why the relationship between loot box spending and raw psychological distress scores has been relatively modest in previous studies: the rise in severe distress occurred for those spending any money and swiftly reached asymptote, a pattern that would be underestimated by linear analyses7,8.
How meaningful are the observed increases in risk likely to be? Our data indicate that, compared to those that did not purchase loot boxes, the relative risk of experiencing severe psychological distress is 1.87 times greater for those that purchased loot boxes. To place this in context, the effects approximate the smallest effect size of interest for media research proposed by Ferguson (though, as Ferguson notes, highly valid dependent measures such as those reported here may imply practical meaningfulness at lower effect sizes31). Converting the effect size to Cohen’s d32 results in d of around 0.5, exceeding the half a standard deviation difference some researchers argue is required for participants to feel a difference in well-being33. Even when problem gambling symptoms were statistically controlled for, a relative risk of 1.28 [1.05, 1.54] was observed, which suggests that the comorbidity between problem gambling symptoms and loot box spending explains some, but not all of the heightened risk of severe psychological distress for those that purchased loot boxes. It is worth noting that it is also widely acknowledged that smaller effects can accumulate over time34,35, although understanding the boundary conditions for this is important36.
Researchers have called for a better understanding of the harms associated with loot boxes; providing an important and timely reminder to this field to be appropriately cautious in their claims. It is for this reason that we have repeatedly suggested that an appropriate and cautious approach to regulating loot boxes is the judicious application of consumer warning labels for games containing them1,7, or the implementation of spending controls (e.g., limit setting) in games for those at high risk of financial harm (e.g., low income earners)37,38. We have previously demonstrated that the value of virtual items to gamers may allow for regulation under existing gambling legislation16. However, we remain in favour of a balanced regulatory approach that focuses on providing consumers with the information they need to make informed decisions for themselves and/or their children.
These findings elaborate on a previous meta-analysis showing a reliable relationship between problem gambling symptoms and spending on loot boxes11. Further to loot boxes being disproportionately purchased by people with symptoms of problem gambling11, they also appear to be disproportionately purchased by people who are psychologically distressed and, by extension, vulnerable. We again call upon industry to take responsibility for protecting vulnerable consumers by implementing appropriate consumer warning labels, and harm minimisation techniques such as spending controls in their games38. Further, policy makers should consider the implementation of warning labels on games containing loot boxes to provide consumers with adequate information to make informed decisions about the appropriateness of these mechanisms for themselves and/or their children.
Data availability
The datasets analysed during the current study, and copies of the exact analyses are available in the Open Science Framework (OSF) repository https://osf.io/nwkyz/https://doi.org/10.17605/OSF.IO/NWKYZ.
References
Drummond, A. & Sauer, J. D. Video game loot boxes are psychologically akin to gambling. Nat. Hum. Behav. 2(8), 530–532 (2018).
Zendle, D., Meyer, R., Cairns, P., Waters, S. & Ballou, N. The prevalence of loot boxes in mobile and desktop games. Addiction 115(9), 1768–1772 (2020).
Hunt, N., Moar, J. In-game gambling and loot boxes: Legislation, evolution & forecasts 2021–2025. Juniper Research. https://www.juniperresearch.com/researchstore/content-digital-media/in-game-gambling-loot-boxes-research-report?utm_campaign=pr1_ingamegamblinglootboxes_providers_content_mar21&utm_source=businesswire&utm_medium=pr. Accessed 14 March 2022.
Griffiths, M. D. Is the buying of loot boxes in video games a form of gambling or gaming?. Gaming Law Re. 22(1), 52–54 (2018).
Griffiths, M. D. Is the buying of loot boxes in video games a form of gambling or gaming?. Gaming Law Rev. 22(1), 52–54 (2018).
Brooks, G. A. & Clark, L. Associations between loot box use, problematic gaming and gambling, and gambling-related cognitions. Addict. Behav. 1(96), 26–34 (2019).
Drummond, A., Sauer, J. D., Ferguson, C. J. & Hall, L. C. The relationship between problem gambling, excessive gaming, psychological distress and spending on loot boxes in Aotearoa New Zealand, Australia, and the United States—A cross-national survey. PLoS ONE 15(3), e0230378 (2020).
Hall, L. C., Drummond, A., Sauer, J. D. & Ferguson, C. J. Effects of self-isolation and quarantine on loot box spending and excessive gaming—Results of a natural experiment. PeerJ 3(9), e10705 (2021).
Zendle, D. & Cairns, P. Video game loot boxes are linked to problem gambling: Results of a large-scale survey. PLoS ONE 13(11), e0206767 (2018).
Zendle, D. & Cairns, P. Loot boxes are again linked to problem gambling: Results of a replication study. PLoS ONE 14(3), e0213194 (2019).
Garea, S. S., Drummond, A., Sauer, J. D., Hall, L. C. & Williams, M. N. Meta-analysis of the relationship between problem gambling, excessive gaming and loot box spending. Int. Gambling Stud. https://doi.org/10.1080/14459795.2021.1914705 (2021).
Zendle, D., Meyer, R. & Over, H. Adolescents and loot boxes: Links with problem gambling and motivations for purchase. R. Soc. Open Sci. 6(6), 190049 (2019).
Kristiansen, S. & Severin, M. C. Loot box engagement and problem gambling among adolescent gamers: Findings from a national survey. Addict. Behav. 1(103), 106254 (2020).
Zendle, D. Problem gamblers spend less money when loot boxes are removed from a game: A before and after study of Heroes of the Storm. PeerJ 29(7), e7700 (2019).
Zendle D, Walasek L, Cairns, P. Meyer, R., Drummond, A. Links between problem gambling symptoms and spending on booster packs in collectable card games: A conceptual replication of research on loot boxes. PLoS One 16(4), e0247855 (2021).
Drummond, A., Sauer, J. D., Hall, L. C., Zendle, D. & Loudon, M. R. Why loot boxes could be regulated as gambling. Nat. Hum. Behav. 4(10), 986–988 (2020).
Yin-Poole, W. EA suspends all discretionary FIFA Ultimate Team content granting indefinitely amid "EA Gate" scandal. Eurogamer. 2021 March. https://www.eurogamer.net/articles/2021-03-13-ea-suspends-all-discretionary-fifa-ultimate-team-content-granting-indefinitely-amid-ea-gate-scandal. Accessed 14 March 2022.
McCaffrey, M. The macro problem of microtransactions: The self-regulatory challenges of video game loot boxes. Bus. Horiz. 62(4), 483–495 (2019).
McCaffrey, M. A cautious approach to public policy and loot box regulation. Addict. Behav. 102, 106136 (2020).
Kessler, R. C. et al. Short screening scales to monitor population prevalences and trends in non-specific psychological distress. Psychol. Med. 32(6), 959 (2002).
Kessler, R. C. et al. Screening for serious mental illness in the general population. Arch. Gen. Psychiatry 60(2), 184–189 (2003).
Stolk, Y., Kaplan, I. & Szwarc, J. Clinical use of the Kessler psychological distress scales with culturally diverse groups. Int. J. Methods Psychiatr. Res. 23(2), 161–183 (2014).
Slade, T., Grove, R. & Burgess, P. Kessler psychological distress scale: Normative data from the 2007 Australian National Survey of Mental Health and Wellbeing. Aust. New Zealand J. Psychiatry. 45(4), 308–316 (2011).
Oakley Browne, M. A., Wells, J. E., Scott, K. M. & McGee, M. A. The Kessler psychological distress scale in Te Rau Hinengaro: the New Zealand mental health survey. Aust. New Zealand J. Psychiatry. 44(4), 314–322 (2010) (New Zealand Mental Health Survey Research Team).
Cotton, S. M. et al. The psychometric characteristics of the Kessler Psychological Distress Scale (K6) in help-seeking youth: What do you miss when using it as an outcome measure?. Psychiatry Res. 1(305), 114182 (2021).
Holtgraves, T. Evaluating the problem gambling severity index. J. Gambling Stud. 25(1), 105 (2009).
Grant, R. L. Converting an odds ratio to a range of plausible relative risks for better communication of research findings. BMJ 24, 348 (2014).
Atalay, A. S. & Meloy, M. G. Retail therapy: A strategic effort to improve mood. Psychol. Mark. 28(6), 638–659 (2011).
Lorains, F. K., Cowlishaw, S. & Thomas, S. A. Prevalence of comorbid disorders in problem and pathological gambling: Systematic review and meta-analysis of population surveys. Addiction 106(3), 490–498 (2011).
Besteher B, Gaser C, Nenadić I. Brain structure and subclinical symptoms: A dimensional perspective of psychopathology in the depression and anxiety spectrum. Neuropsychobiology. 79(4), 270–83 (2020).
Ferguson, C. J. An effect size primer: A guide for clinicians and researchers. Prof. Psychol. Res. Pract. 40, 532–538 (2009).
Sánchez-Meca, J., Marín-Martínez, F. & Chacón-Moscoso, S. Effect-size indices for dichotomized outcomes in meta-analysis. Psychol. Methods 8(4), 448 (2003).
Norman, G. R., Sloan, J. A. & Wyrwich, K. W. Interpretation of changes in health-related quality of life: The remarkable universality of half a standard deviation. Med. Care 1, 582–592 (2003).
Johannes, N., Vuorre, M., & Przybylski, A. K. Video game play is positively correlated with well-being. R. Soc. Open Sci. 8(2), 202049 (2021).
Funder, D. C. & Ozer, D. J. Evaluating effect size in psychological research: Sense and nonsense. Adv. Methods Practices Psychol. Sci. 2(2), 156–168 (2019).
Sauer, J. D. & Drummond, A. Boundary conditions for the practical importance of small effects in long runs: A comment on Funder and Ozer (2019). Adv. Methods Pract. Psychol. Sci. 3(4), 502–504 (2020).
Garrett, E. P., Sauer, J. D., Drummond, A. & Lowe-Calverley, E. Problem gambling and income as predictors of loot box spending. Int. Gambl. Stud. 30, 1–1 (2022).
Drummond, A., Sauer, J. D. & Hall, L. C. Loot box limit-setting: a potential policy to protect video game users with gambling problems?. Addiction 114(5), 935–936 (2019).
Funding
Supported by the Marsden Fund Council from Government funding, managed by Royal Society Te Apārangi; MAU1804.
Author information
Authors and Affiliations
Contributions
A.D. and J.D.S. acquired the funding. All authors contributed equally to all other aspects of the paper (conceptualization, data collection, data analysis, writing and revision).
Corresponding author
Ethics declarations
Competing interests
AD prepared an impartial expert witness briefing summarizing the current state of the scientific knowledge on the subject of loot boxes for a Canadian law suit. He was financially compensated for his time. JDS and LCH declare no potential competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Drummond, A., Hall, L.C. & Sauer, J.D. Surprisingly high prevalence rates of severe psychological distress among consumers who purchase loot boxes in video games. Sci Rep 12, 16128 (2022). https://doi.org/10.1038/s41598-022-20549-1
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-022-20549-1
- Springer Nature Limited
This article is cited by
-
The associations between autistic characteristics and microtransaction spending
Scientific Reports (2024)
-
Associations between Marketing Exposure, In-game Purchases, Problem Gaming, Simulated Gambling, and Psychological Distress among Adolescents
Journal of Gambling Studies (2024)