Abstract
With the ongoing penetration of conversational user interfaces, a better understanding of social and emotional characteristic inherent to dialogue is required. Chatbots in particular face the challenge of conveying human-like behaviour while being restricted to one channel of interaction, i.e., text. The goal of the presented work is thus to investigate whether characteristics of social intelligence embedded in human-chatbot interactions are perceivable by human interlocutors and if yes, whether such influences the experienced interaction quality. Focusing on the social intelligence dimensions Authenticity, Clarity and Empathy, we first used a questionnaire survey evaluating the level of perception in text utterances, and then conducted a Wizard of Oz study to investigate the effects of these utterances in a more interactive setting. Results show that people have great difficulties perceiving elements of social intelligence in text. While on the one hand they find anthropomorphic behaviour pleasant and positive for the naturalness of a dialogue, they may also perceive it as frightening and unsuitable when expressed by an artificial agent in the wrong way or at the wrong time.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
https://venturebeat.com/2017/04/18/facebook-messenger-hits-100000-bots/ (last accessed: March 11, 2019).
- 2.
https://techcrunch.com/2015/09/29/forget-apps-now-the-bots-take-over/?guccounter=2 (last accessed: March 11, 2019).
- 3.
Note: the complete list of German utterances and their English translations, incl. information on elements of SI which was given to students, is available here: https://tinyurl.com/y4zjd5cz.
- 4.
Note: the post-scenario questionnaire and its English translation is available here: https://tinyurl.com/y4zjd5cz.
- 5.
Note: the used interview guidelines and their English translations are available here: https://tinyurl.com/y4zjd5cz.
References
Abbattista, F., Degemmis, M., Licchelli, O., Lops, P., Semeraro, G., Zambetta, F.: Improving the usability of an e-commerce web site through personalization. Recommendation and Personalization in eCommerce 2, 20–29 (2002)
Albrecht, K.: Social Intelligence: The New Science of Success. Wiley (2006)
Baron-Cohen, S., Ring, H.A., Wheelwright, S., Bullmore, E.T., Brammer, M.J., Simmons, A., Williams, S.C.R.: Social intelligence in the normal and autistic brain: an fmri study. Eur. J. Neurosci. 11(6), 1891–1898 (1999). https://doi.org/10.1046/j.1460-9568.1999.00621.x
Barton, D., Lee, C.: Language Online: Investigating Digital Texts and Practices. Routledge (2013)
Benyon, D., Mival, O.: From human-computer interactions to human-companion relationships. In: Proceedings of the First International Conference on Intelligent Interactive Technologies and Multimedia, pp. 1–9. ACM (2010)
Beverland, M.: Brand management and the challenge of authenticity. J. Prod. Brand Manage. 14(7), 460–461 (2005). https://doi.org/10.1108/10610420510633413
Brooks, R.A.: Intelligence without representation. Artif. Intell. 47(1), 139–159 (1991). https://doi.org/10.1016/0004-3702(91)90053-M
Bruhn, M., Schoenmller, V., Schfer, D., Heinrich, D.: Brand authenticity: Towards a deeper understanding of its conceptualization and measurement. Adv. Consum. Res. 40, 367–576 (2012)
Buendgens-Kosten, J.: Authenticity. ELT J. 68(4), 457–459 (2014). https://doi.org/10.1093/elt/ccu034
Chen, S.C., Dhillon, G.S.: Interpreting dimensions of consumer trust in e-commerce. Inf. Technol. Manage. 4(2), 303–318 (2003). https://doi.org/10.1023/A:1022962631249
Cui, L., Huang, S., Wei, F., Tan, C., Duan, C., Zhou, M.: Superagent: a customer service chatbot for e-commerce websites. In: Proceedings of ACL 2017, System Demonstrations, pp. 97–102 (2017)
Dahlbäck, N., Jönsson, A., Ahrenberg, L.: Wizard of Oz studies: why and how. Knowl.-Based Syst. 6(4), 258–266 (1993)
De Angeli, A., Johnson, G.I., Coventry, L.: The unfriendly user: exploring social reactions to chatterbots. In: Proceedings of The International Conference on Affective Human Factors Design, London. pp. 467–474 (2001)
Decety, J., Moriguchi, Y.: The empathic brain and its dysfunction in psychiatric populations: Implications for intervention across different clinical conditions. BioPsychoSocial Med. 1(1), 22 (2007)
Dey, A.K.: Understanding and using context. Pers. Ubiquit. Comput. 5(1), 4–7 (2001). http://dx.doi.org/10.1007/s007790170019
Endsley, M.R.: Toward a theory of situation awareness in dynamic systems. Hum. Factors 37(1), 32–64 (1995). https://doi.org/10.1518/001872095779049543
Ford, M.E., Tisak, M.S.: A further search for social intelligence. J. Educ. Psychol. 75(1), 196–206 (1983)
Fulghum, R.: All I Ever Really Needed to Know I Learned in Kindergarten. Grey Spider Press (1986)
Gardner, H.: Frames of Mind: The Theory of Multiple Intelligences. Basic Books (1983)
Gefen, D., Straub, D.W.: Consumer trust in b2c e-commerce and the importance of social presence: experiments in e-products and e-services. Omega 32(6), 407–424 (2004). https://doi.org/10.1016/j.omega.2004.01.006
Gerdes, K., Segal, E., Lietz, C.: Conceptualising and measuring empathy. Br. J. Soc. Work 40(7), 2326–2343 (2010). https://doi.org/10.1093/bjsw/bcq048
Goleman, D., Boyatzis, R.: Social intelligence and the biology of leadership. Harvard Bus. Rev. 86(9), 74–81 (2008)
Gundlach, H., Neville, B.: Authenticity: further theoretical and practical development. J. Brand Manage. 19(6), 484–499 (2012)
Jacobs, I., Powers, S., Seguin, B., Lynch, D.: The top 10 chatbots for enterprise customer service. Forrester Report (2017)
Lei, H.: Context awareness: a practitioner’s perspective. In: International Workshop on Ubiquitous Data Management. pp. 43–52 (April 2005). https://doi.org/10.1109/UDM.2005.6
Lopatovska, I., Williams, H.: Personification of the amazon alexa: Bff or a mindless companion. In: Proceedings of the 2018 Conference on Human Information Interaction & Retrieval, pp. 265–268. ACM (2018)
Mauldin, M.L.: Chatterbots, tinymuds, and the turing test: entering the loebner prize competition. In: AAAI (1994)
Mayring, P.: Qualitative content analysis: theoretical foundation, basic procedures and software solution (2014)
Mcknight, D.H., Carter, M., Thatcher, J.B., Clay, P.F.: Trust in a specific technology: an investigation of its components and measures. ACM Trans. Manage. Inf. Syst. (TMIS) 2(2), 12 (2011)
McQuiggan, S.W., Lester, J.C.: Modeling and evaluating empathy in embodied companion agents. Int. J. Hum.-Comput. Stud. 65(4), 348–360 (2007)
Mori, M., MacDorman, K.F., Kageki, N.: The uncanny valley [from the field]. IEEE Rob. Autom. Mag. 19(2), 98–100 (2012)
Neururer, M., Schlögl, S., Brinkschulte, L., Groth, A.: Perceptions on authenticity in chat bots. Multimodal Technol. Interact. 2(3), 60 (2018). https://doi.org/10.3390/mti2030060
Nowak, K.L., Biocca, F.: The effect of the agency and anthropomorphism on users’ sense of telepresence, copresence, and social presence in virtual environments. Presence: Teleoperators Virtual Environ. 12(5), 481–494 (2003). https://doi.org/0.1162/105474603322761289
Ogawa, K., Ono, T.: Itaco: Constructing an emotional relationship between human and robot. In: RO-MAN 2008-The 17th IEEE International Symposium on Robot and Human Interactive Communication. pp. 35–40. IEEE (2008)
Persson, P., Laaksolahti, J., Lonnqvist, P.: Understanding socially intelligent agents—a multilayered phenomenon. Trans. Sys. Man Cyber. Part A 31(5), 349–360 (2001). http://dx.doi.org/10.1109/3468.952710
Pinhanez, C.S.: Design methods for personified interfaces. In: Proceedings of the International Conference on Computer-Human Interaction Research and Applications. pp. 39–49. INSTICC, SCITEPRESS Science and Technology Publications, Funchal, Madeira, Portugal (2017). https://doi.org/10.5220/0006487500270038
Preece, J.: Empathic communities: balancing emotional and factual communication. Interact. Comput. 12(1), 63–77 (1999)
Reeves, B., Nass, C.: How people treat computers, television, and new media like real people and places (1996)
Russell, S., Norvig, P.: Artificial Intelligence: A Modern Approach. Always Learning. Pearson (2016)
Russell, S., Norvig, P.: Social Intelligence: The New Science of Success. Pearson (2010)
Schlögl, S., Doherty, G., Luz, S.: Wizard of Oz experimentation for language technology applications: Challenges and tools. Interact. Comput. 27(6), 592–615 (2015). https://doi.org/10.1093/iwc/iwu016
Schmidt, S., Schmidt, S.: Achtsamkeit und Wahrnehmung in Gesundheitsfachberufen. Springer (2012)
Sha, G.: Ai-based chatterbots and spoken english teaching: a critical analysis. Comput. Assist. Lang. Learn. 22(3), 269–281 (2009). https://doi.org/10.1080/09588220902920284
Shawar, B.A., Atwell, E.: Using dialogue corpora to train a chatbot. In: Proceedings of the Corpus Linguistics 2003 Conference. pp. 681–690 (2003)
Short, J., Williams, E., Christie, B.: The Social Psychology of Telecommunications. Wiley (1976)
So, R., Sonenberg, L.: Situation awareness in intelligent agents: foundations for a theory of proactive agent behavior. In: Proceedings. IEEE/WIC/ACM International Conference on Intelligent Agent Technology, 2004. (IAT 2004), pp. 86–92 (Sep 2004). https://doi.org/10.1109/IAT.2004.1342928
Thorndike, E.: Intelligence and its uses. Harper’s Mag. (1920)
Turkle, S.: Authenticity in the age of digital companions. Interact. Stud. 8(3), 501–517 (2007)
Vincent, J.: Emotional attachment to mobile phones: An extraordinary relationship. In: Mobile World, pp. 93–104. Springer (2005)
Wallis, P., Norling, E.: The trouble with chatbots: social skills in a social world. Virtual Soc. Agents 29, 29–36 (2005)
Weisberg, J., Te’eni, D., Arman, L.: Past purchase and intention to purchase in ecommerce: The mediation of social presence and trust. Internet Res. 21(1), 82–96 (2011). https://doi.org/10.1108/10662241111104893
Weizenbaum, J.: Eliza–a computer program for the study of natural language communication between man and machine. Commun. ACM 9(1), 36–45 (1966)
Wooldridge, M., Jennings, N.R.: Agent theories, architectures, and languages: a survey. In: Wooldridge, M.J., Jennings, N.R. (eds.) Intelligent Agents, pp. 1–39. Springer, Berlin, Heidelberg (1995)
Xu, A., Liu, Z., Guo, Y., Sinha, V., Akkiraju, R.: A new chatbot for customer service on social media. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, pp. 3506–3510. ACM (2017)
Yuasa, M., Saito, K., Mukawa, N.: Emoticons convey emotions without cognition of faces: an fmri study. In: CHI’06 Extended Abstracts on Human Factors in Computing Systems, pp. 1565–1570. ACM (2006)
Acknowledgments
The research presented in this paper has been supported by the project EMPATHIC that has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 769872.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this chapter
Cite this chapter
Mariacher, N., Schlögl, S., Monz, A. (2021). Investigating Perceptions of Social Intelligence in Simulated Human-Chatbot Interactions. In: Esposito, A., Faundez-Zanuy, M., Morabito, F., Pasero, E. (eds) Progresses in Artificial Intelligence and Neural Systems. Smart Innovation, Systems and Technologies, vol 184. Springer, Singapore. https://doi.org/10.1007/978-981-15-5093-5_44
Download citation
DOI: https://doi.org/10.1007/978-981-15-5093-5_44
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-5092-8
Online ISBN: 978-981-15-5093-5
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)