Abstract
User studies, involving both qualitative and quantitative data about user experiences, can complement and contextualize the insights and data afforded by web and social media analytics, providing an extension to these analytics areas, which we refer to as user study analytics. In this chapter, we discuss some of the dos and don’ts of user studies, including what user studies are, how they are planned and created, and how user study results can be analyzed for positive effects on usability and user experience.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Blascheck, T., John, M., Koch, S., Bruder, L., Ertl, T.: Triangulating user behavior using eye movement, interaction, and think aloud data. In: The Ninth Biennial ACM Symposium on Eye Tracking Research and Applications, pp. 175–182 (2016)
Carrol, J.M.: Five reasons for scenario-based design. In: Proceedings of the 32nd Annual Hawaii International Conference on Systems Sciences. 1999. HICSS-32., vol. Track3, p. 11 (1999)
Fisher, R.J.: Social desirability bias and the validity of indirect questioning. J. Consumer Res. 20(2), 303–315 (1993). US Publisher: University of Chicago Press
Gwizdka, J., Hosseini, R., Cole, M., Wang, S.: Temporal dynamics of eye-tracking and EEG during reading and relevance decisions. J. Assoc. Inf. Sci. Technol. 68(10), 2299–2312 (2017)
Jansen, B.J., Salminen, J., Jung, S.g., Almerekhi, H.: The illusion of data validity: why numbers about people are likely wrong. Data Inf. Manage. 6(4), 100020 (2022)
Kramer, A.D.I., Guillory, J.E., Hancock, J.T.: Experimental evidence of massive-scale emotional contagion through social networks. Proc. Nat. Acad. Sci. 111(24), 8788–8790 (2014)
Nielsen, L., Salminen, J., Jung, S.G., Jansen, B.J.: Think-aloud surveys. In: IFIP Conference on Human-Computer Interaction, pp. 504–508. Springer, Cham (2021)
Salminen, J., Jansen, B.J., An, J., Jung, S.g., Nielsen, L., Kwak, H.: Fixation and confusion-investigating eye-tracking participants’ exposure to information in personas. In: Proceedings of the ACM SIGIR Conference on Human Information Interaction and Retrieval (CHIIR 2018), pp. 110–119. ACM (2018)
Salminen, J., Jung, S.g., Chowdhury, S.A., Sengün, S., Jansen, B.J.: Personas and analytics: A comparative user study of efficiency and effectiveness for a user identification task. In: Proceedings of the ACM Conference of Human Factors in Computing Systems (CHI’20). ACM (2020)
Salminen, J., Jung, S.g., Jansen, B.J.: Suggestions for online user studies. In: Stephanidis, C., Soares, M.M., Rosenzweig, E., Marcus, A., Yamamoto, S., Mori, H., Rau, P.L.P., Meiselwitz, G., Fang, X., Moallem, A. (eds.) HCI International 2021 - Late Breaking Papers: Design and User Experience, Lecture Notes in Computer Science, pp. 127–146. Springer International Publishing (2021)
Salminen, J., Jung, S.g., Kamel, A., Froneman, W., Jansen, B.J.: Who is in the sample? an analysis of real and surrogate users as participants in user study research in the information technology fields. PeerJ Comput. Sci. 8, e1136 (2022). PeerJ Inc
Turner, C.W., Lewis, J.R., Nielsen, J.: Determining usability test sample size. Int. Encyclop. Ergonom. Human Factors 3(2), 3084–3088 (2006). CRC Press, Boca Raton
Wilson, T.D.: On user studies and information needs. J. Document. 37(1), 3–15 (1981). MCB UP Ltd
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this chapter
Cite this chapter
Jansen, B.J., Aldous, K.K., Salminen, J., Almerekhi, H., Jung, Sg. (2024). User Study Analytics. In: Understanding Audiences, Customers, and Users via Analytics. Synthesis Lectures on Information Concepts, Retrieval, and Services. Springer, Cham. https://doi.org/10.1007/978-3-031-41933-1_10
Download citation
DOI: https://doi.org/10.1007/978-3-031-41933-1_10
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-41932-4
Online ISBN: 978-3-031-41933-1
eBook Packages: Synthesis Collection of Technology (R0)