Skip to main content

Predictive Fairness

  • Conference paper
  • First Online:
Philosophy of Computing

Part of the book series: Philosophical Studies Series ((PSSP,volume 143))

Abstract

It has recently been argued that in normal decision circumstances no systematic decision method that predicts the likelihood that individuals possess some property can be fair. Either (i) the decision method correctly identifies the relevant property (e.g. recidivism) more often in one subgroup (e.g. black defendants) than another (e.g. white defendants); or (ii) the decision method systematically ascribes higher probabilities to individuals who have and/or individuals who lack the property in one group compared to the probabilities ascribed to individuals who have and/or individuals who lack the property in another group. Otherwise put, these decision methods seem inherently, and unavoidably, unfair. Besides introducing this problem to the philosophical community, this paper explores different possible responses to the problem and presents three principles that should be universally applied to promote fairness: (1) Dominance: a decision method that is better with respect to one of the dimensions of fairness and worse with respect to none is better overall; (2) Transparency: decision-makers who use these decision methods should be aware of the unintended differences in impact and also be transparent to the affected community about these unintended differences; and (3) Priority to the worse off: a decision method that is relatively better for members of a worse-off subgroup is preferable to a method that is relatively better for members of a better-off subgroup.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 139.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 179.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 179.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    For discussions of similar findings, see Chouldechova 2017 and Loi et al. 2019.

  2. 2.

    See also Loi et al. 2019.

References

  • Adler, Matthew. 2012. Wellbeing and its fair distribution. Oxford: Oxford University Press.

    Google Scholar 

  • Andrić, Vuko, and Anders Herlitz. 2021. Prioritarianism, timeslices, and prudential value. Australasian Journal of Philosophy. https://doi.org/10.1080/00048402.2021.1920043

  • Angwin, Julia, Jeff Larson, Surya Mattu, and Lauren Kirchner. 2016. Machine bias: There’s software used across the country to predict future criminals. And it’s biased against blacks. Pro Publica, May 23.

    Google Scholar 

  • Binns, Reuben. 2018a. Algorithmic accountability and public reason. Philosophy & Technology 31: 543–556.

    Article  Google Scholar 

  • ———. 2018b. Fairness in machine learning: Lessons from political philosophy. Journal of Machine Learning Research 81: 1–11.

    Google Scholar 

  • Chouldechova, Alexandra. 2017. Fair prediction with disparate impact: A study of bias in recidivism prediction instruments. arXiv:1703.00056v1.

    Google Scholar 

  • Crisp, Roger. 2003. Equality, priority, and compassion. Ethics 113: 745–763.

    Article  Google Scholar 

  • Eyal, Nir, and Anders Herlitz. 2021. Input and output in distributive theory. Noûs. https://doi.org/10.1111/nous.12392

  • Fitzgerald, Chloë, and Samia Hurst. 2017. Implicit bias in healthcare professionals: A systematic review. BMC Medical Ethics 18: 19.

    Article  Google Scholar 

  • Frick, Johann. 2015. Contractualism and social risk. Philosophy and Public Affairs 43: 175–223.

    Article  Google Scholar 

  • Herlitz, Anders. 2019. The indispensability of sufficientarianism. Critical Review of International Social and Political Philosophy 22 (7): 929–942.

    Google Scholar 

  • Holtug, Nils. 2010. Persons, interests, and justice. Oxford: Oxford University Press.

    Book  Google Scholar 

  • Jonsen, Albert, and Stephen Toulmin. 1988. The abuse of casuistry: A history of moral reasoning. Berkeley: University of California Press.

    Google Scholar 

  • Kahneman, Daniel. 2011. Thinking, fast and slow. London: Penguin.

    Google Scholar 

  • Kleinberg, Joel, Sendhil Mullainathan and Manish Raghavan. 2017. Inherent trade-offs in the fair determination of risk scores. arXiv:1609.05807v2.

    Google Scholar 

  • Loi, Michele, Anders Herlitz, and Hoda Heidari. 2019. A philosophical theory of fairness for prediction-based decisions. SSRN. https://doi.org/10.2139/ssrn.3450300.

  • Pascal, Blaise. 1952. The provincial letters, Pensées, scientific treatises. Trans. Thomas M’Crie, W.F. Trotter and Richard Scofield. London: Encyclopaedia Brittanica.

    Google Scholar 

  • Scanlon, Thomas. 1998. What we owe to each other. Cambridge, MA: Harvard University Press.

    Google Scholar 

  • Segall, Shlomi. 2016. Why inequality matters: Luck egalitarianism, its meaning and value. Cambridge: Cambridge University Press.

    Book  Google Scholar 

  • Shields, Liam. 2012. The prospects for Sufficientarianism. Utilitas 24: 101–117.

    Article  Google Scholar 

  • Temkin, Larry. 2003. Egalitarianism defended. Ethics 113: 764–782.

    Article  Google Scholar 

  • Tversky, Amos, and Daniel Kahneman. 1981. The framing of decisions and the psychology of choice. Science 211: 453–458.

    Article  Google Scholar 

  • Walzer, Michael. 1983. Spheres of justice: A defence of pluralism and equality. New York: Basic Books.

    Google Scholar 

  • Wong, Pak-Hang. 2019. Democratizing algorithmic fairness. Philosophy & Technology. https://doi.org/10.1007/s13347-019-00355-w.

    Book  Google Scholar 

  • Zimmermann, Annette, Elena Di Rosa, and Hochan Kim. 2020. Technology can’t fix algorithmic injustice. Boston Review, January 9.

    Google Scholar 

  • Zuckerman, Gregory, and Bradley Hope. 2017. The quants: The quants Run Wall street now – Software-driven trading, once a novelty, is becoming dominant. The Wall Street Journal (May 22).

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Anders Herlitz .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Herlitz, A. (2022). Predictive Fairness. In: Lundgren, B., Nuñez Hernández, N.A. (eds) Philosophy of Computing. Philosophical Studies Series, vol 143. Springer, Cham. https://doi.org/10.1007/978-3-030-75267-5_5

Download citation

Publish with us

Policies and ethics