Abstract
This paper presents a questionnaire-based approach to evaluate the user experience (UX) while interacting with interactive Television (iTV) systems. Current contributions in the field of UX propose generic methods applicable to various application domains, whereas our contribution is dedicated to the specific domain of interactive TV systems. Based on a classification of UX dimensions from a literature review, the first version of the questionnaire is focusing on the dimension’s aesthetics, emotion, stimulation and identification. A validation study with 106 participants was performed to assess the relations between the evaluated UX dimensions, as well as their fit to the underlying theoretical assumptions. Results showed that the UX dimensions aesthetics, emotion and stimulation are important for the domain of iTV, while identification was not confirmed. The study revealed significant correlations between the type of IPTV system used and the emotional and stimulation dimension. Additionally, a significant effect of the TV reception mode and the type of IPTV box owned on the emotion towards the system was observed. Beyond the contribution of the questionnaire that is directly applicable for any iTV system, the findings described in the paper demonstrate the need for user experience evaluation methods targeted at specific domains: the validation of the questionnaire shows that identification is not a central dimension of user experience when interacting with interactive TV.
Chapter PDF
Similar content being viewed by others
Keywords
References
Alben, L.: Quality of experience: defining the criteria for eff. interaction design. Interactions 3, 11–15 (1996)
Battarbee, K.: Co-Experience the social UX. In: Proc. CHI 2003 EA, pp. 730–731. ACM (2003)
Bargas-Avila, J., Hornbæk, K.: Old wine in new bottles or novel challenges. In: Proc. CHI 2011, pp. 2689–2698 (2011)
Bernhaupt, R.: User Experience Evaluation in Games and Entertainment. Springer (2010)
Bernhaupt, R., Pirker, M., Weiss, A., Wilfinger, D., Tscheligi, M.: Security, Privacy, and Personalization: ACM C. Entertainment 6, 2 (2012)
Brislin, R.W.: Back-Translation for Cross-Cultural Research. Journ. Cross-Cultural Psych. 1(3), 185–216 (1970)
Cronbach, L.J.: Coefficient alpha and the internal structure of tests. Psychometrika 16(3), 297–334 (1951)
Csikszentmihalyi, M.: Flow: The Psych. of Opt. Experience. Harper Perennial, N.Y (1991)
De Angeli, A., Sutcliffe, A., Hartmann, J.: Interaction, usability and aesthetics: what influences users’ preferences? In: Proc. DIS 2006. ACM, New York (2006)
Desmet, P.M.A., Hekkert, P.: Framework of product experience. International Journal of Design 1(1), 57–66 (2007)
Desmet, P.M.A., Overbeeke, C.J., Tax, S.J.E.T.: Designing products with added emotional value. The Design Journal 4(1), 32–47 (2001)
Forbrig, P., Bernhaupt, R., Winckler, M., Wesson, J.: 5th Workshop on Software and Usability Eng. Cross-Pollination: Patterns, Usability and UX. In: Campos, P., Graham, N., Jorge, J., Nunes, N., Palanque, P., Winckler, M. (eds.) INTERACT 2011, Part IV. LNCS, vol. 6949, pp. 718–719. Springer, Heidelberg (2011)
Forlizzi, J., Battarbee, K.: Understanding experience in interactive systems. In: Proc. DIS 2004, pp. 261–268. ACM, New York (2004)
Gaver, B., Martin, H.: Alternatives: exploring information appliances through conceptual design proposals. In: Proc. CHI 2000, pp. 209–216. ACM, New York (2000)
Geerts, D., De Grooff, D.: Supporting the social uses of television: sociability heuristics for social tv. In: Proc. CHI 2009, pp. 595–604. ACM, New York (2009)
Hartmann, J., De Angeli, A., Sutcliffe, A.: Framing the user experience: information biases on website quality judgement. In: Proc. CHI 2008. ACM, New York (2008)
Hassenzahl, M.: The interplay of beauty, goodness, and usability in interactive products. J. of HCI 19(4), 319–349 (2004)
Hassenzahl, M., Tractinsky, N.: User Experience - a research agenda. Behavior & Information Technology 25(2), 91–97 (2006)
Hassenzahl, M.: Aesthetics in interactive products: Correlates and consequences of beauty, ch.11. Product Experience, pp. 287–302. Elsevier (2008)
Hassenzahl, M., Diefenbach, S., Göritz, A.: Needs, affect, and interactive products - Facets of user experience. Interacting with Computers 22(5), 353–362 (2010)
Hekkert, P.: Design aesthetics: Principles of pleasure in product design. Psychology Science 48(2), 157–172 (2006)
IJsselsteijn, W.A., Poels, K., de Kort, Y.A.W.: Measuring Player Experiences in Digital Games. Development of the Game Experience Questionnaire (GEQ)
ISO 9241, ISO 9241: Ergonomic requirements for office work with visual display terminals (VDTs)—Part 11: Guidance on usability. ISO, Geneva, Switzerland (1998)
ISO 9241-210, Ergonomics of Human–System Interaction – Part 210: Human-centred Design for Interactive Systems (2010)
Izard, L.: Die Emotionen des Menschen. Psychologie Verlags Union, Weinheim (1971)
Järvinen, A., Heliö, S., Mäyrä, F.: Communication and Community in Digital Entertainment Services. Online (2002)
Jääskö, V., Mattelmäki, T.: Observing and probing. In: Proc. DPPI 2003, pp. 126–131. ACM, New York (2003)
Jordan, P.: Designing Pleasurable Products. Taylor & Francis, London (2000)
Karapanos, E., Zimmerman, J., Forlizzi, J., Martens, J.-B.: Measuring the dynamics of remembered experience over time. IwC 22(5), 328–335 (2010)
Kline, P.: The handbook of psychological testing. Routledge, London (1993)
Lavie, T., Tractinsky, N.: Assessing dimensions of perceived visual aesthetics of web sites. Int. Journ. of Human-Computer Studies 60(3), 269–298 (2004)
Law, E., Roto, V., Hassenzahl, M., Vermeeren, A., Kort, J.: Understanding, scoping and defining user experience: a survey approach. In: Proc. CHI 2009, ACM (2009)
Law, E., Van Schaik, P.: Modelling user experience - An agenda for research and practice. Interacting with Computers 22(5), 313–322 (2010)
Law, E.: The measurability and predictability of user experience. In: Proc. EICS 2011, pp. 1–10. ACM, NY (2011)
Mahlke, S.: Studying affect and emotions as important parts of the UX. Position Paper HCI 2005 (2005)
Mandryk, R., Inkpen, K., Calvert, T.: Using psychophysiological techniques to measure UX with entertainment technologies. Beh. and Inf. Techn. 25(2) (2006)
McCarthy, J., Wright, P.: Technology as experience. Interactions 11(5), 42–43 (2004)
Minge, M.: 2005. Methoden zur Erhebung emotionaler Aspekte bei der Interaktion mit technischen Systemen. Master’s thesis, Freie Universität Berlin (2005)
Nacke, L.E., Grimshaw, M.N., Craig, A., Lindley, C.A.: More than a feeling: Measurement of sonic UX and psychophysiology in a first-person shooter game. Interact. Comput. 22(5), 336–343 (2010)
Norman, D.A.: Emotional design: why we love (or hate) everyday things. Basic Books, New York (2004)
O’Brien, J., Rodden, T.: Interactive systems in domestic environments. In: Proc. DIS 1997. ACM, NY (1997)
Obrist, M., Bernhaupt, R., Tscheligi, M.: Interactive television for the home: An ethnographic study on users’ requirements and experiences. Int. Journ. of HCI 24(2) (2008)
Oliveira, E., Benovoy, M., Ribeiro, N., Chambel, T.: Towards emotional interaction: Using movies to automatically learn users’ emotional states. In: Campos, P., Graham, N., Jorge, J., Nunes, N., Palanque, P., Winckler, M. (eds.) INTERACT 2011, Part I. LNCS, vol. 6946, pp. 152–161. Springer, Heidelberg (2011)
Pirker, M., Bernhaupt, R.: Measuring User Experience in the Living Room: Results from an Ethnographically Oriented Field Study Indicating Major Evaluation Factors. In: Proc. EuroITV 2011, pp. 79–82 (2011)
Pirker, M., Bernhaupt, R., Mirlacher, T.: Investigating usability and user experience as possible entry barriers for touch interaction in the living room. In: Proc. EuroITV 2010, pp. 145–154. ACM, New York (2010)
Quinn, J.M., Tran, T.Q.: Attractive phones don’t have to work better: independent effects of attractiveness, effectiveness, and efficiency on perceived usability. In: Proc. CHI 2010, pp. 353–362. ACM, NY (2010)
Rajae-Joordens, R.: Measuring experiences in gaming and TV applications. In: Probing Experience: From Assessment of User Emotions and Behaviour to Development of Products, pp. 77–90 (2008)
Roibás, A., Johnson, S.: Unfolding the user experience in new scenarios of pervasive interactive TV. In: CHI 2006 Extended Abstracts. ACM (2006)
Roto, V., Ketola, P., Huotari, S.: User Experience Evaluation in Nokia. In: Now Let’s Do It in Practice - User Experience Evaluation Methods in Product Development Workshop in CHI 2008, Florence, Italy (2008)
Sheldon, K.M., Elliot, A.J., Kim, Y., Kasser, T.: What Is Satisfying About Satisfying Events? Testing 10 Candidate Psychological Needs. Journal of Personality and Social Psychology 80(2), 325–339 (2001)
Sproll, S., Peissner, M., Sturm, C.: From product concept to user experience: exploring UX potentials at early product stages. In: Proc. NordiCHI 2010. ACM, NY (2010)
Steen, M., Koning, N.: d. and Hoyng, L. 2003. The ‘wow’ experience – Conceptual model and tools. In: COST269 Conference Helsinki (2003)
Turunen, M., et al.: User expectations and user experience with different modalities in a mobile phone controlled home entertainment system. In: Proc MobileHCI, ACM, NY (2009)
Tsekleves, E., Whitham, R., Kondo, K., Hill, A.: Bringing the television experience to other media in the home: an ethnographic study. In: Proc. EuroITV 2009. ACM (2009)
Vermeeren, A., Law, E., Roto, V., Obrist, M., Hoonhout, J., Väänänen-Vainio-Mattila, K.: User experience evaluation methods. In: Proc. NordiCHI 2010. ACM, NY (2010)
Wright, P., McCarthy, J., Meekison, L.: Making Sense of Experience. In: Funology: From Usability to Enjoyment, Kluwer Academic Publ., Dordrecht (2003)
http://www.allaboutux.org/ (accessed January 20, 2012)
Heise, D.R.: The Semantic Differential and Attitude Research. Attitude Measurement, pp. 235–253. Rand McNally, Chicago (1970)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 IFIP International Federation for Information Processing
About this paper
Cite this paper
Bernhaupt, R., Pirker, M. (2013). Evaluating User Experience for Interactive Television: Towards the Development of a Domain-Specific User Experience Questionnaire. In: Kotzé, P., Marsden, G., Lindgaard, G., Wesson, J., Winckler, M. (eds) Human-Computer Interaction – INTERACT 2013. INTERACT 2013. Lecture Notes in Computer Science, vol 8118. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-40480-1_45
Download citation
DOI: https://doi.org/10.1007/978-3-642-40480-1_45
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-40479-5
Online ISBN: 978-3-642-40480-1
eBook Packages: Computer ScienceComputer Science (R0)