Abstract
We propose, for the first time, a trustworthy acceptance metric and its measurement methodology to evaluate the trustworthiness of AI-based systems used in decision making in Food Energy Water (FEW) management. The proposed metric is a significant step forward in the standardization process of AI systems. It is essential to standardize the AI systems’ trustworthiness, but until now, the standardization efforts remain at the level of high-level principles. The measurement methodology of the proposed includes human experts in the loop, and it is based on our trust management system. Our metric captures and quantifies the system’s transparent evaluation by field experts on as many control points as desirable by the users. We illustrate the trustworthy acceptance metric and its measurement methodology using AI in decision-making scenarios of Food-Energy-Water sectors. However, the proposed metric and its methodology can be easily adapted to other fields of AI applications. We show that our metric successfully captures the aggregated acceptance of any number of experts, can be used to do multiple measurements on various points of the system, and provides confidence values for the measured acceptance.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Alfantoukh, L., Ruan, Y., Durresi, A.: Trust-based multi-stakeholder decision making in water allocation system. In: International Conference on Broadband and Wireless Computing, Communication and Applications, pp. 314–327. Springer, Cham (2017)
Alfantoukh, L., Ruan, Y., Durresi, A.: Multi-stakeholder consensus decision-making framework based on trust: a generic framework. In: 2018 IEEE 4th International Conference on Collaboration and Internet Computing (CIC), pp. 472–479. IEEE (2018)
Babbar-Sebens, M., Minsker, B.S.: Interactive genetic algorithm with mixed initiative interaction for multi-criteria ground water monitoring design. Appl. Soft Comput. 12(1), 182–195 (2012)
Barometer, E.T.: Edelman trust barometer global report. Edelman (2019). https://www.edelman.com/sites/g/files/aatuss191/files/2019-02/2019_Edelman_Trust_Barometer_Global_Report_2.pdf
Berendsen, H.J.: A Student’s Guide to Data and Error Analysis. Cambridge University Press, Cambridge (2011)
Burke, B., Cearley, D., Jones, N., Smith, D., Chandrasekaran, A., Lu, C., Panetta, K.: Gartner top 10 strategic technology trends for 2020-smarter with gartner (2019)
Chipperfield, A., Fleming, P.: The MATLAB genetic algorithm toolbox (1995)
Chomphoosang, P., Durresi, A., Durresi, M., Barolli, L.: Trust management of social networks in health care. In: 2012 15th International Conference on Network-Based Information Systems, pp. 392–396. IEEE (2012)
Chomphoosang, P., Ruan, Y., Durresi, A., Durresi, M., Barolli, L.: Trust management of health care information in social networks. In: Complex, Intelligent, and Software Intensive Systems (CISIS), 2013 Seventh International Conference on, pp. 228–235. IEEE (2013)
Chomphoosang, P., Zhang, P., Durresi, A., Barolli, L.: Survey of trust based communications in social networks. In: 2011 14th International Conference on Network-Based Information Systems, pp. 663–666. IEEE (2011)
Dong, Y., Xu, J.: Consensus Building in Group Decision Making. Springer, Singapore (2016)
Durresi, A., Durresi, M., Paruchuri, V., Barolli, L.: Trust management in emergency networks. In: 2009 International Conference on Advanced Information Networking and Applications, pp. 167–174. IEEE (2009)
EC: Ethics guidelines for trustworthy AI (2018). https://ec.europa.eu/digital-single-market/en/news/ethics-guidelines-trustworthy-ai
Gunia, B.C., Brett, J.M., Nandkeolyar, A.K., Kamdar, D.: Paying a price: culture, trust, and negotiation consequences. J. Appl. Psychol. 96(4), 774 (2011)
Gunning, D.: Explainable artificial intelligence (xai). Defense Advanced Research Projects Agency (DARPA), nd Web 2, 2 (2017)
Gursoy, D., Chi, O.H., Lu, L., Nunkoo, R.: Consumers acceptance of artificially intelligent (AI) device use in service delivery. Int. J. Inf. Manag. 49, 157–169 (2019)
Hegselmann, R., Krause, U., et al.: Opinion dynamics and bounded confidence models, analysis, and simulation. J. Artif. Soc. Soc. Simul. 5(3), 1–2 (2002)
Hüffmeier, J., Freund, P.A., Zerres, A., Backhaus, K., Hertel, G.: Being tough or being nice? a meta-analysis on the impact of hard-and softline strategies in distributive negotiations. J. Manag. 40(3), 866–892 (2014)
Hurlburt, G.: How much to trust artificial intelligence? IT Prof. 19(4), 7–11 (2017)
Information technology – Artificial intelligence – Overview of trustworthiness in artificial intelligence. Standard, International Organization for Standardization, Geneva, CH (2020)
Kambiz, M.: Multi-Stakeholder Decision Making for Complex Problems: A Systems Thinking Approach with Cases. World Scientific, Singapore (2016)
Kaur, D., Uslu, S., Durresi, A.: Trust-based security mechanism for detecting clusters of fake users in social networks. In: Workshops of the International Conference on Advanced Information Networking and Applications, pp. 641–650. Springer, Cham (2019)
Kaur, D., Uslu, S., Durresi, A.: Requirements for trustworthy artificial intelligence–a review. In: International Conference on Network-Based Information Systems, pp. 105–115. Springer, Cham (2020)
Kaur, D., Uslu, S., Durresi, A., Mohler, G., Carter, J.G.: Trust-based human-machine collaboration mechanism for predicting crimes. In: International Conference on Advanced Information Networking and Applications, pp. 603–616. Springer, Cham (2020)
Kimmel, M.J., Pruitt, D.G., Magenau, J.M., Konar-Goldband, E., Carnevale, P.J.: Effects of trust, aspiration, and gender on negotiation tactics. J. Pers. Soc. Psychol. 38(1), 9 (1980)
Kocielnik, R., Amershi, S., Bennett, P.N.: Will you accept an imperfect AI? exploring designs for adjusting end-user expectations of AI systems. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, pp. 1–14 (2019)
Lakkaraju, S., Adebayo, J.: Neurips (2020) tutorial. In: Tutorial: (track2) explaining machine learning predictions: State-of-the-art, challenges, and opportunities (2020)
Mueller, S.T., Hoffman, R.R., Clancey, W., Emrey, A., Klein, G.: Explanation in human-AI systems: A literature meta-review, synopsis of key ideas and publications, and bibliography for explainable AI. arXiv preprint arXiv:1902.01876 (2019)
Rossi, F.: Building trust in artificial intelligence. J. Int. Aff. 72(1), 127–134 (2018)
Ruan, Y., Alfantoukh, L., Durresi, A.: Exploring stock market using Twitter trust network. In: Advanced Information Networking and Applications (AINA), 2015 IEEE 29th International Conference on, pp. 428–433. IEEE (2015)
Ruan, Y., Alfantoukh, L., Fang, A., Durresi, A.: Exploring trust propagation behaviors in online communities. In: Network-Based Information Systems (NBiS), 2014 17th International Conference on, pp. 361–367. IEEE (2014)
Ruan, Y., Durresi, A.: Trust management for social networks. In: Proceedings of the 14th Annual Information Security Symposium, p. 24. CERIAS-Purdue University (2013)
Ruan, Y., Durresi, A.: A survey of trust management systems for online social communities-trust modeling, trust inference and attacks. Knowl. Based Syst. 106, 150–163 (2016)
Ruan, Y., Durresi, A.: A trust management framework for cloud computing platforms. In: Advanced Information Networking and Applications (AINA), 2017 IEEE 31st International Conference on, pp. 1146–1153. IEEE (2017)
Ruan, Y., Durresi, A.: A trust management framework for clouds. Comput. Commun. 144, 124–131 (2019)
Ruan, Y., Durresi, A., Alfantoukh, L.: Trust management framework for internet of things. In: Advanced Information Networking and Applications (AINA), 2016 IEEE 30th International Conference on, pp. 1013–1019. IEEE (2016)
Ruan, Y., Durresi, A., Alfantoukh, L.: Using Twitter trust network for stock market analysis. Knowl. Based Syst. 145, 207–218 (2018)
Ruan, Y., Durresi, A., Uslu, S.: Trust assessment for internet of things in multi-access edge computing. In: 2018 IEEE 32nd International Conference on Advanced Information Networking and Applications (AINA), pp. 1155–1161. IEEE (2018)
Ruan, Y., Zhang, P., Alfantoukh, L., Durresi, A.: Measurement theory-based trust management framework for online social communities. ACM Trans. Internet Technol. (TOIT) 17(2), 16 (2017)
Smith, C.J.: Designing trustworthy AI: A human-machine teaming framework to guide development. arXiv preprint arXiv:1910.03515 (2019)
Smuha, N.A.: The EU approach to ethics guidelines for trustworthy artificial intelligence. CRi-Comput. Law Rev. Int. 20(4), 97–106 (2019)
Sutrop, M.: Should we trust artificial intelligence? TRAMES: J. Humanit. Soc. Sci. 23(4), 499–522 (2019)
Uslu, S., Kaur, D., Rivera, S.J., Durresi, A., Babbar-Sebens, M.: Decision support system using trust planning among food-energy-water actors. In: International Conference on Advanced Information Networking and Applications, pp. 1169–1180. Springer, Cham (2019)
Uslu, S., Kaur, D., Rivera, S.J., Durresi, A., Babbar-Sebens, M.: Trust-based game-theoretical decision making for food-energy-water management. In: International Conference on Broadband and Wireless Computing, Communication and Applications, pp. 125–136. Springer, Cham (2019)
Uslu, S., Kaur, D., Rivera, S.J., Durresi, A., Babbar-Sebens, M.: Trust-based decision making for food-energy-water actors. In: International Conference on Advanced Information Networking and Applications, pp. 591–602. Springer, Cham (2020)
Uslu, S., Kaur, D., Rivera, S.J., Durresi, A., Babbar-Sebens, M., Tilt, J.H.: Control theoretical modeling of trust-based decision making in food-energy-water management. In: Conference on Complex, Intelligent, and Software Intensive Systems, pp. 97–107. Springer, Cham (2020)
Uslu, S., Kaur, D., Rivera, S.J., Durresi, A., Babbar-Sebens, M., Tilt, J.H.: A trustworthy human-machine framework for collective decision making in food-energy-water management: the role of trust sensitivity. Knowl. Based Syst. 213, 106683 (2021)
Uslu, S., Ruan, Y., Durresi, A.: Trust-based decision support system for planning among food-energy-water actors. In: Conference on Complex, Intelligent, and Software Intensive Systems, pp. 440–451. Springer, Cham (2018)
Varshney, K.R.: Trustworthy machine learning and artificial intelligence. XRDS: Crossroads, ACM Mag. Stud. 25(3), 26–29 (2019)
Wachter, S., Mittelstadt, B., Russell, C.: Counterfactual explanations without opening the black box: automated decisions and the GDPR. Harv. JL Tech. 31, 841 (2017)
Wang, W., Siau, K.: Trusting artificial intelligence in healthcare (2018)
Zhang, P., Durresi, A.: Trust management framework for social networks. In: 2012 IEEE International Conference on Communications (ICC), pp. 1042–1047. IEEE (2012)
Zhang, P., Durresi, A., Barolli, L.: Survey of trust management on various networks. In: Complex, Intelligent and Software Intensive Systems (CISIS), 2011 International Conference on, pp. 219–226. IEEE (2011)
Zhang, P., Durresi, A., Ruan, Y., Durresi, M.: Trust based security mechanisms for social networks. In: Broadband, Wireless Computing, Communication and Applications (BWCCA), 2012 Seventh International Conference on, pp. 264–270. IEEE (2012)
Zhang, Y., Liao, Q.V., Bellamy, R.K.: Effect of confidence and explanation on accuracy and trust calibration in AI-assisted decision making. arXiv preprint arXiv:2001.02114 (2020)
Acknowledgements
This work was partially supported by the National Science Foundation under Grant No.1547411 and by the U.S. Department of Agriculture (USDA) National Institute of Food and Agriculture (NIFA) (Award Number 2017-67003-26057) via an interagency partnership between USDA-NIFA and the National Science Foundation (NSF) on the research program Innovations at the Nexus of Food, Energy and Water Systems.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Uslu, S., Kaur, D., Rivera, S.J., Durresi, A., Durresi, M., Babbar-Sebens, M. (2021). Trustworthy Acceptance: A New Metric for Trustworthy Artificial Intelligence Used in Decision Making in Food–Energy–Water Sectors. In: Barolli, L., Woungang, I., Enokido, T. (eds) Advanced Information Networking and Applications. AINA 2021. Lecture Notes in Networks and Systems, vol 225. Springer, Cham. https://doi.org/10.1007/978-3-030-75100-5_19
Download citation
DOI: https://doi.org/10.1007/978-3-030-75100-5_19
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-75099-2
Online ISBN: 978-3-030-75100-5
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)