Abstract
The acknowledged operational, ethical, legal and governance risks involved in applying Machine Learning (ML) have generated a need for a clear and thoughtful repository of best practices on how to responsibly govern, manage and implement “responsible ML”. The Foundation for Best Practices in Machine Learning (a non-profit foundation) seeks to promote responsible ML through creating an open-sourced, freely accessible repository of best practices and associated guides. Its model and organisational guides look at both the technical and institutional requirements needed to promote responsible ML. Both blueprints touch on subjects such as “Fairness & Non-Discrimination”, “Representativeness & Specification”, “Product Traceability”, “Explainability” amongst other topics. Where the organisational guide relates to organisation-wide process and responsibilities (i.e. the necessity of setting proper product definitions and risk portfolios); the model guide details issues ranging from cost function specification and optimisation to selection function characterization, from disparate impact metrics to local explanations and counterfactuals. It also addresses issues concerning thorough product management. These guidelines have been developed principally by senior ML engineers, data scientists, data science managers, and legal professionals for ML engineers, data scientists, data science managers, compliance professionals, legal practitioners, and, more broadly, management. The Foundation’s philosophy is that (a) context is key, (b) responsible ML starts with prudent MLOps and product management, and (c) responsible ML needs to be supported by all aspects of an organisation’s structure.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
The New York Times (2020) Another arrest, and jail time, due to a bad facial recognition match. https://www.nytimes.com/2020/12/29/technology/facial-recognition-misidentify-jail.html. Accessed 24 Aug 2021
The Guardian (2018) Amazon ditched AI recruiting tool that favored men for technical jobs. https://www.theguardian.com/technology/2018/oct/10/amazon-hiring-ai-gender-bias-recruiting-engine. Accessed 24 Aug 2021
BBC (2019) Apple’s ‘sexist’ credit card investigated by US regulator. https://www.bbc.com/news/business-50365609. Accessed 24 Aug 2021
Artificial Intelligence News (2020) Medical chatbot using OpenAI’s GPT-3 told a fake patient to kill themselves. https://artificialintelligence-news.com/2020/10/28/medical-chatbot-openai-gpt3-patient-kill-themselves/. Accessed 24 Aug 2021
The Verge (2018) IBM’s Watson gave unsafe recommendations for treating cancer. https://www.theverge.com/2018/7/26/17619382/ibms-watson-cancer-ai-healthcare-science. Accessed 24 Aug 2021
Partnership on AI (2021) AI incident database. https://incidentdatabase.ai/. Accessed 20 Aug 2021
Dao D (2021) Awful AI. https://github.com/daviddao/awful-ai. Accessed 20 Aug 2021
Hickok M (2021) AIethicist.org. https://www.aiethicist.org/. Accessed 20 Aug 2021
Hagendorff T (2020) The ethics of AI ethics: an evaluation of guidelines. Mind Mach 30:99–120. https://doi.org/10.1007/s11023-020-09517-8
The Foundation for Best Practices in Machine Learning. https://www.fbpml.org/
European Commission (2021) Proposal for a regulation of the european parliament and of the council laying down harmonised rules on artificial intelligence (artificial intelligence act) and amending certain union legislative acts
Information Commissioner’s Office (2021) Guidance on AI and data protection. https://ico.org.uk/for-organisations/guide-to-data-protection/key-data-protection-themes/guidance-on-artificial-intelligence-and-data-protection/. Accessed 20 Aug 2021
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this chapter
Cite this chapter
Franse, J., Misheva, V., Vale, D.S. (2022). Practical and Open Source Best Practices for Ethical Machine Learning. In: Ferreira, M.I.A., Tokhi, M.O. (eds) Towards Trustworthy Artificial Intelligent Systems. Intelligent Systems, Control and Automation: Science and Engineering, vol 102. Springer, Cham. https://doi.org/10.1007/978-3-031-09823-9_5
Download citation
DOI: https://doi.org/10.1007/978-3-031-09823-9_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-09822-2
Online ISBN: 978-3-031-09823-9
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)