Abstract
Hart, Webster, and Menzies (1993) recently offered several recommendations for describing the accuracy of violence predictions using 2×2 contingency tables. This Comment describes some problems with their recommendations and suggests that researchers use receiver operating characteristic (ROC) analysis to quantify prediction accuracy.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Bayes, T. (1763). An essay towards solving a problem in the doctrine of chances.Philosophical Transactions of the Royal Society of London, 53, 370–375.
Grisso, T., & Appelbaum, P. S. (1992). Is it unethical to offer predictions of future violence?Law and Human Behavior, 16, 621–634.
Hanley, J. A. (1988). The robustness of the “binormal” assumptions used in fitting ROC curves.Medical Decision Making, 8, 197–203.
Hanley, J. A., & McNiel, B. J. (1982). The meaning and use of the area under a receiver operating characteristic (ROC) curve.Radiology, 143, 29–36.
Harris, G. T., Rice, M. E., & Quinsey, V. L. (1993). Violent recidivism of mentally disordered of-fenders The development of a statistical prediction instrument.Criminal Justice and Behavior, 20, 315–335.
Hart, S. J., Webster, C. D., & Menzies, R. J. (1993). A note on portraying the accuracy of violence predictions.Law and Human Behavior, 17, 695–700.
Klassen, D., & O'Connor, W. A. (1988). A prospective study of predictors of violence in adult male mental health admissions.Law and Human Behavior, 12, 143–158.
McClish, D. K. (1989). Analyzing a portion of the ROC curve.Medical Decision Making, 9, 190–195.
McNiel, B. J., Keller, E., & Adelstein, S. J. (1975). Primer on certain elements of medical decision making.New England Journal of Medicine, 293, 211–215.
McNiel, B. J., & Hanley, J. A. (1984). Statistical approaches to the analysis of receiver operating characteristic (ROC) curves.Medical Decision Making, 4, 137–150.
McNiel, D. E., & Binder, R. L. (1987). Predictive validity of judgments of dangerousness in emergency civil commitment.American Journal of Psychiatry, 144, 197–200.
McNiel, D. E., & Binder, R. L. (1991). Clinical assessment of risk of violence among psychiatric inpatients.American Journal of Psychiatry, 148, 1317–1321.
Metz, C. E. (1986). Statistical analysis of ROC data in evaluating diagnostic performance. In D. E. Herbert & R. H. Myers (Eds.),Multiple regression analysis: Applications in the health sciences (pp. 365–384). Washington, DC: American Institute of Physics. (ROC analysis software is available from Charles E. Metz, Ph.D., Department of Radiology, University of Chicago, Chicago, IL 60637.)
Monahan, J. (1981).The clinical prediction of violent behavior. DHHS Publication ADM 81-92. Rockville, MD: National Institute of Mental Health.
Morrison, E. F. (1992). A hierarchy of aggressive and violent behaviors among psychiatric inpatients.Hospital and Community Psychiatry, 43, 505–506.
Mossman, D. (in press a). Dangerousness decisions: An essay on the mathematics of clinical violence predictions and involuntary hospitalization.University of Chicago Law School Roundtable.
Mossman, D. (in press b). Assessing predictions of violence: Being accurate about accuracy.Journal of Consulting and Clinical Psychology.
Mossman, D., & Somoza, E. (1991). Neuropsychiatric decision making: The role of prevalence in diagnostic testing.Journal of Neuropsychiatry and Clinical Neurosciences, 3, 84–88.
Otto, R. K. (1992). Prediction of dangerous behavior: A review and analysis of “second-generation” research.Forensic Reports, 5, 103–134.
Pierce, J. C., & Cornell, R. G. (1993). Integrating stratum-specific likelihood ratios with the analysis of ROC curves.Medical Decision Making, 13, 141–151.
Somoza, E., & Mossman, D. (1990). Introduction to neuropsychiatric decision-making: Binary diagnostic tests.Journal of Neuropsychiatry and Clinical Neurosciences, 2, 297–300.
Somoza, E., & Mossman, D. (1992). Comparing and optimizing diagnostic tests: an information-theoretical approach.Medical Decision Making, 12, 179–188.
Swets, J. A. (1986). Forms of empirical ROCs in discrimination and diagnostic tasks: implications for theory and measurement of performance.Psychological Bulletin, 99, 181–198.
Swets, J. A. (1992). The science of choosing the right decision threshold in high-stakes diagnostics.American Psychologist, 47, 522–532.
Author information
Authors and Affiliations
About this article
Cite this article
Mossman, D. Further comments on portraying the accuracy of violence predictions. Law Hum Behav 18, 587–593 (1994). https://doi.org/10.1007/BF01499177
Issue Date:
DOI: https://doi.org/10.1007/BF01499177