Abstract
Anthropomorphism is defined as attributing human traits and emotions to non-human entities. In the field of emotional design in multimedia learning, anthropomorphising essential learning elements has been associated with promoting positive learning experiences. Although it has been widely used for educational purposes, there are still limitations when considering different contexts, learning variables, and non-invasive measurement. Therefore, in this study, we investigated how anthropomorphising affects and associates with learning based on three perspectives: learning outcomes, epistemic emotions, and gaze behaviour. The findings indicate that anthropomorphism did not directly affect learning achievement, perceived satisfaction, and effort or when moderated by the need for cognition. However, anthropomorphism reduced the effect of perceived negative epistemic emotions, namely Bored and Anxiety. Additionally, a comparative correlation analysis indicated that anthropomorphism significantly reduced the perception of negative epistemic emotions for learning achievement (Confused and Frustrated) and effort (Frustrated). The gaze behaviour analysis revealed that anthropomorphism only influenced the initial view and not the number of views or dwell time. However, dwell time reflected partiality towards anthropomorphised elements showing negative emotions. The results implicate design and research considerations for future studies.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
1 Introduction
Emotions are essential to learning as they influence various cognitive processes, such as perception, cognition, problem-solving, and creativity (Li et al., 2020). Empirical findings focusing on emotions in learning revealed that emotional experiences are also fundamental in technology-based learning (Loderer et al., 2020), and there is a need to investigate such implication towards cognitive and affective learning outcomes (Mayer, 2020). Likewise, numerous measures have been applied to investigate these outcomes by focusing on different theories, models, designs, tools, and measurements (Hillaire, 2021), where the key approach is commonly associated with studies focusing either on affective computing or emotional design. Nevertheless, in regard to multimedia-based learning, two main concepts were unified, which were the Emotional Design Theory (Norman, 2004) and the Cognitive and Affective Theory of Multimedia Learning (CATLM) (Moreno & Mayer, 2007) to evaluate how emotions could be induced based on the manipulation of multimedia elements. The concept was based on the ideation focusing on user experience and multimedia learning theories in the hopes of gaining a broader perspective on how 'visually designed learning emotions' could influence cognitive and affective learning outcomes. Hence, one strategy is to redesign essential instructional elements to create appeal without adding extraneous elements (Mayer & Estrella, 2014; Um et al., 2012) by hypothesising that it may induce positive emotions and learning outcomes (Kumar et al., 2019; Shangguan et al., 2020a).
On the other hand, applying multimedia unlocks various design possibilities as it implies that essential instructional elements manifested based on colours, images, sounds, or a combination could have different learning implications. Hence, design considerations, such as applying colour combinations (Kumar et al., 2019; Mayer & Estrella, 2014; Park et al., 2015; Plass & Kaplan, 2015), shapes, anthropomorphism (Wang et al., 2022), baby-face bias (Um et al., 2012; Moremoholo & de Lange, 2018; Plass et al., 2020) and fonts (Kumar et al., 2018) have been considered, yet Uzun and Yıldırım (2018) claimed that the outcomes sporadically portrayed an improvement in learning. Shangguan et al. (2020b) explained that these empirical findings only provided scarce evidence on the potential benefits of visually attractive elements, and researchers such as Brom et al. (2018), Endres et al. (2020), Münchow and Bannert (2019) and Shangguan et al. (2020b) questioned if positive emotional designs could effectively influence positive learning outcomes. Moreover, emotions can facilitate or impede learning, and similar could be said about using emotionally designed multimedia elements (Wong & Adesope, 2021). However, Chung and Cheon (2020) argued that such a misconception could be by virtue attributed to limited studies on the manipulation of emotional design elements and research strategies in multimedia learning, while Endres et al. (2020) suggested exploring untested moderators that could influence these learning outcomes. Additionally, studies tend to primarily utilise the self-perception method, focusing on questionnaires to measure emotional change and learning behaviour, and recent studies question the validity of such measurement while suggesting a shift towards non-invasive methods (Mayer, 2020).
2 Anthropomorphism in multimedia learning
Subsequently, by considering previous findings, we focus on building upon the application anthropomorphised multimedia elements as a means to execute emotional design principles. Anthropomorphising happens when inanimate objects are characterised by human features to represent emotions and motivation (Cao et al., 2022; Epley et al., 2007). Airenti (2018) describes it as a basic human tendency developed during childhood to comprehend situations, and this tendency persisted throughout adulthood as a coping and learning mechanism. In digital learning environments, empirical findings indicate that the degree of anthropomorphising could possibly influence learning adaption, perception, and outcomes as anthropomorphised elements could be associated as a social interaction partner (Schneider et al., 2022). The degree stipulated here could vary from a simple addition of eyes and mouth, such as in a smileyϑ or by adding complex human qualities, such as gestures, attributes, and emotions. Likewise, with humanlike appearances, the anthropomorphised objects tend to reflect novelty in interaction and can visually attract users towards engagement and interaction (Chowdhury et al., 2018) while predominantly inducing positive emotions (Cao et al., 2021).
Fittingly, in the context of multimedia learning, the emotional significance of anthropomorphism was initially investigated to manipulate emotions through positive emotional design in a seven-minute presentation on "How Immunization Works" by Um (2008). While the findings did not reflect a direct relationship between anthropomorphism and learning outcomes, Um reported that positive designs induced positive emotions, which indirectly improved cognitive and affective learning outcomes. Ensuing, Mayer and Estrella (2014), using an eight-slide multimedia presentation titled "How a Cold Virus Attacks the Body" investigated the effects of colour combinations with anthropomorphised elements and reported that anthropomorphised lessons yielded better learning achievement and mental effort. In retrospect, studies on anthropomorphism as strategised for emotional design in multimedia learning tend to mainly focus on building on the seminal work by Um (2018) and Mayer and Estrella (2014). Nevertheless, there are a growing number of studies in other areas, such as Münchow and Bannert (2019) explored the effects of anthropomorphised organelles of eukaryotic cells, Hight et al. (2021) on chemistry concepts, Brown et al. (2022) on pharmaceutical concepts, Liew et al. (2022) on computer viruses, Shangguan et al. (2020a) on the formation of lightning, Slabbert et al. (2022) with solar systems and Haaranen et al. (2015) on programming concepts. These studies indicate a need to consider reproducibility with other subject domains, as suggested by Liew et al. (2022) and Pang et al. (2021), while also deliberating on the importance of culture and context (Kumar et al., 2019; Schneider et al., 2022). Collectively, studies in this context outside the western countries have also been scarce (Stárková et al., 2019), with a handfull of studies from China (Li et al., 2020; Shangguan et al., 2020a, b), Malaysia (Liew et al., 2022), South Africa (Slabbert et al., 2022) and Türkiye (Türkoguz & Ercan, 2022; Uzun & Yıldırım, 2018) which warrants further exploration.
In retrospect, despite decades of study on the effect of anthropomorphism, it remains unclear why and how it captures people's attention (Cao et al., 2021). Anthropomorphism has been regarded as an attention-holding variable (Dehn & van Mulken, 2000) and in the recently introduced Cognitive-Affective-Social Theory of Learning in digital Environments (CASTLE), Schneider et al. (2022) regards anthropomorphism as a social process that supports the transfer of information into working memory through association with attention. Likewise, in emotional design studies, Park et al. (2015) initially examined attention by utilising eye-tracking methodology on Um's presentation and found that expressive anthropomorphisms have possibilities to improve learning attention. Following this, Brom et al. (2018) highlighted the need for non-invasive measurements such as eye-tracking to further understand anthropomorphism's role in attention-capturing effects. Subsequently, Stárková et al. (2019) extended the seminal work on anthropomorphism by Mayer and Estrella (2014) and revealed that anthropomorphism only affected attention through initial fixation, which was supported by Wang et al. (2022) by adding that it may also affect the length of fixation and warranted further investigation.
2.1 Gaze behavior
Non-invasive methods, namely eye-tracking technology, have immerged as a vital tool in understanding the cognitive process involved in multimedia-based learning (Arslanyilmaz & Sullins, 2021; Coskun & Cagiltay, 2022; Tzafilkou et al., 2021). Furthermore, empirical evidence in e-learning and human-computer interaction observed that eye-gaze movement could be associated with cognitive processes such as attention (Ramachandra & Joseph, 2021). In retrospect, anthropomorphism usually represents a form of visual cue (Frischen et al., 2007; Stárková et al., 2019; van Wermeskerken & van Gog, 2017) that promotes guidance that deliberately forces users' eye gaze to move toward the stimuli (Moon and Ryu, 2021). Hence, gaze data could be vital in determining the effect of multimedia elements in directing learners' attention (Coskun & Cagiltay, 2022) by analysing fixation time (Arslanyilmaz & Sullins, 2021), the number of views, initial view, and dwell time by referring to the areas of interest (AOIs) (Moon and Ryu, 2021).
3 Research aim
In this study, we developed a new learning material focusing on solar systems to identify if the results obtained from empirical findings on anthropomorphisms could be replicated for different topics and contexts. Hence, an anthropomorphised multimedia learning material was compared with one void of anthropomorphic design. Next, we also considered the role of epistemic emotions, as recommended by Loderer et al. (2020), as there is a dearth of research focusing on its effect and correlation with multimedia learning outcomes. Epistemic emotions such as surprise, curiosity, enjoyment, confusion, anxiety, frustration, and boredom (Pekrun et al., 2017) are defined as emotions developed due to cognitive inaptness that occurs from unanticipated or differing information (Millis et al., 2011). We observed that epistemic emotions are fundamental in this study as the learning material was designed based on a general topic that was not aligned with the respondents' course. Moreover, epistemic emotions address emotions primarily developed due to cognitive tasks and activities (Pekrun et al., 2017), and we identified this as an essential consideration, especially when Mayer (2020) highlighted the need to identify a causal link between affective and cognitive processing. Furthermore, Schneider et al. (2022), emphasis the need to explore emotions when learning with media especially when social cues are concerned such as by anthropomorphism.
Likewise, emotions are a cognitive process (Triberti et al., 2017) that defines the inclination and need to engage (Park et al., 2008). For that reason, we theorised that the need for cognition (NC) might have a moderating role in learning outcomes, as Cacioppo et al. (1996) describes relates to learning performance. While Cacioppo et al. (1984) define NC as a predisposition to engage and enjoy a cognitive activity, the researchers stipulates that it may provide further insights into affective-cognitive outcomes. Epley et al. (2007) describe individuals with high NC usually negatively reflect on anthropomorphism, yet to the researchers' knowledge, this has not been investigated in the scope of emotional design in multimedia learning. As a result, we aimed to investigate the role of NC in moderating learning outcomes, namely achievement, perceived satisfaction, and effort. Lastly, we explored gaze behavior by measuring AOI's initial view, the number of views, and dwell time, in which we specifically focus on the anthropomorphised essential elements. While some studies have used eye-tracking such as Stark et al. (2018) and Stárková et al. (2019), according to Othman et al. (2020), such application are often costly. Therefore, as an alternative approach, we used a webcam-based tracker called GazeRecorder to analyse users' gazes while viewing the learning material. GazeRecorder uses a mobile interface, and according to Tzafilkou et al. (2021), mobile sensing has a high potential for identifying learning behaviours in a natural environment. Therefore, while the self-perception method was employed to investigate learning outcomes and moderators, the researchers utilized gaze tracking to understand gaze behaviours based and answer the following questions:
-
RQ1. What are the differences in learning outcomes when anthropomorphised elements are used, and does NC moderate these outcomes?
-
RQ2. What are the differences in correlation between epistemic emotions and learning outcomes when anthropomorphosis elements are used?
-
RQ3. How does fixation defer when anthropomorphosis elements are used?
4 Methodology
4.1 Participant
A total of 68 undergraduates from a social science course at a university in Malaysia participated in this study. The sampling was based on purposive sampling, referring to an intact classroom grouped into two groups. Of the 68 respondents, the intervention group had N = 33 participants, whereas the control group had N = 35 respondents. Six respondents in each group were randomly selected and given access to a separate link to the videos to facilitate gaze-tracking data collection.
4.2 Intervention
Two designs of multimedia-based video were used to control the effect of treatments, namely Non-Anthropomorphised (NAT) (Fig. 1) and Anthropomorphised (AT) (Fig. 2). Both videos had the same contents and duration and varied only based on anthropomorphic attributes. Anthropomorphic characters were not designed by emotional valance but were randomly selected and associated with the content in line with the description by Airenti (2018). For example, Venus was depicted with a female character, Neptune, which was the furthers from the Sun was reflected as 'crying' while Pluto with uncertainty due to being downgraded as a planet (Table 1).
4.3 Variables
Ten multi-choice questions measured students' pre- and post-achievement. Ensuing, NC was measured prior to the intervention using the 18-item questionnaire adapted from the Need for Cognition Scale (Cacioppo et al., 1984). Next, we measured perceived satisfaction which Topala and Tomozii (2014) defined as a multifaceted measurement of learning attitude based on an adapted version of the System Usability Scale (SUS). Whereas perceived effort is defined as the perception of work students recognise, they put in while learning and was adapted from Mayer and Estrella (2014). According to Needham (1978), effort relates to satisfaction, and the outcome of effort can be represented as knowledge gained that may yield satisfaction. Nevertheless, as students were unaware of their scores, satisfaction due to achievement will be disregarded. Subsequently, emotions were measured using Epistemically Related Emotion Scales by Pekrun et al. (2017) to measure Surprise, Curiosity, Enjoyment, Confusion, Anxiety, Frustration, and Bored. All items except the pre and post-test were measured using a five-point Likert scale ranging from strongly agree to strongly disagree. As for the Epistemically Related Emotion Scales, a four-point scale was used to reflect; Not at all, Very little, Moderate Strong, and Very Strong.
4.4 Eye gaze tracking
A mobile eye-tracking tool from https://gazerecorder.com was used where eye position was captured via the mobile device's integrated camera, reflecting a more natural setting. The gaze recorder captures information based on dwell time, first view, and the number of views in the selected AOI, as shown in Fig. 3. Dwell time represents the length of time viewers focus on an area (Bruno et al., 2021) based on the AOI (Moon & Ryu, 2021).
4.5 Procedure
Both groups answered the pre-test followed by the NC questionnaires before the intervention. Next, respondents were given the video link through their email to access the assigned video. Similarly, the six respondents randomly selected from each group were provided with the link to the gazerecorder system where these twelve students were briefed on the calibration procedures required one day before the intervention. When the students click the link, the calibration process starts, where the student will have to look at several targets at a fixed position on the screen to map the gaze coordinates. Next, students were provided links to respond to the satisfaction, effort, and emotion instrument, followed by the post-test using Google forms. Lastly, students were thanked and debriefed. The analysis in this study was done using SPSS v27, where the data from the forms were first transferred into Microsoft Excel to match respondents' pre and post-test results. Five respondents were eliminated due to missing pretest results. Based on the data obtained, the reliability for learning effort (α = .632), satisfaction (α = .909), and NC (α = .661) indicated that the Cronbach α could be accepted as satisfactory (0.58–0.97) (Taber, 2018).
5 Findings
The findings of this study are reported based on effects on learning outcomes (RQ1), epistemic emotions (RQ2), and gaze behaviour (RQ3).
5.1 Learning outcomes
NC levels were categorized based on mean = 3.132, s.d. = .417, where 18 High and 15 Low respondents were observed for AT, whereas NAT had 16 High and 19 Low respondents, respectively (Table 2). A two-way ANCOVA indicated no significant difference between the groups on achievement between AT (M = 6.76, s.d. =1.324) and NAT (M = 7.03, s.d. =1.248) at F (1,63) = .259, p = .612, ηp2 = .004 and levels of NC at F (1,63) = .381, p = .539, ηp2 = .006. Similarly, there were no significant interaction effect at F (1,63) = 1.493, p = .226, ηp2 = .023. As for satisfaction, a two-way ANOVA indicated no significant difference between the groups between AT (M = 3.596, s.d. =0.740) and NAT (M = 3.448 s.d. =.672) at F (1,64) = .633, p = .429, ηp2 = 010 and levels of NC at F (1,64) = .456, p = .502, ηp2 = .007. There was also no significant interaction effect at F (1,64) = .867, p = .355, ηp2 = .013 as also indicated for effort F (1,64) = .198, p = .658, ηp2 = .003. The AT group (M = 3.855, s.d.=.690) reflected more mental effort than NAT (Mean = 3.737, s.d.=.559), however there was no significant difference between groups at F (1,64) = .686, p = .411, ηp2 = .011 nor based on levels of NC at F (1,64) = .560, p = .457, ηp2 = .009.
5.2 Epistemic emotions
We analyzed the difference between the groups using a series of t-tests which indicated no significant difference for all positive emotions (Surprised, Curious, and Excited) and the cumulative positive experience for AT (M = 3.647, s.d.=.601) and NAT (M = 3.724, s.d. =.730) (Table 3). However, there were significant difference in negative emotions at t (66) = 2.307, p = .024, d = .755 between AT (M = 1.849, s.d.=.731) and NAT (M = 2.271, s.d.= .777) for Anxious at t (66) = 2.624, p =. 011, d = .896 and Bored at t (66) = 2.184, p =. 033, d = 1.028.
Next, we investigated how these emotions are correlated with the learning outcomes by conducting a Pearson correlation for both groups individually. For the AT group (Table 4), it was observed that learning gain had a significant negative relationship with Confused at r = − .506, p < 0.01, and overall negative emotions at r = − .368, p < 0.05. While no significant relationship was observed for learning effort, there was a significant negative relationship between learning satisfaction and Frustrated at r = − .344*, p < 0.05. As for the NAT group (Table 5), while there were no significant relationships between learning gain with any of the emotions, learning effort indicated a significant negative relationship with Confused (r =-.404, p < .05) and Frustrated (r = − .396, p < 0.05) whereas learning satisfaction indicated a significant negative relationship with Bored (r =-.490, p < 0.01) and interestingly with learning effort at r =-.356, p < .001.
Concurrently, the Fisher-z transformation method, as suggested by Eid et al. (2011), was applied to compare the correlation difference between learning outcomes and emotional relationships for AT and NAT. The comparison was done using the online calculator available at https://www.psychometrica.de/correlation.html#independent (Lenhard & Lenhard, 2014) and reported in Table 6. The findings reflected no significant difference between the groups for perceived satisfaction, however, there were significant difference between AT and NAT for learning achievement focusing on confused (z = -1.758, p = 0.039) and frustrated (z = -1.675, p = 0.047) and perceived effort focusing on emotions namely frustrated (z = 2.160, p = 0.015) and overall negative emotions (z = 1.742, p = 0.041).
5.3 Gaze tracking behaviour
The AT group indicated faster response (tavg =8.79, s.d.= 4.953) (Fig. 4), compared to the NAT group (tavg =10.408, s.d. =5.258) except for Saturn, Uranus and Neptune. However, the frequency of views for each planet was higher in the NAT group (favg=4.273, s.d.=.647) in comparison with the AT group (favg =3.00, s.d. = .447) (Fig. 5) except for Venus and Jupiter, where both groups had the same number of views. In terms of dwell time (Fig. 6), it was observed that while initially AT (Mean t = 1.19s) had a higher dwell time compared to NAT(t = 0.47s), the dwell time was lower than NAT for every other planet until Pluto. Interestingly, throughout the mid of the video (Venus, Earth, Mars, Jupiter, Saturn, and Uranus), the dwell time for AT was significantly lower compared to the NAT group. However, among all the planets, the highest dwell time is for Uranus (t = 5.49s), which was observed in the NAT group. The average dwell time for AT group was tavg =1.041, s.d.= .923 where else for NAT was tavg = 2.468, s.d.= 1.487).
6 Discussion
The findings indicated no significant difference between AT and NAT on learning outcomes, namely learning achievements, satisfaction, and effort. Thus, supporting the findings of Endres et al. (2020) and Stárková et al. (2019). Nevertheless, it was found that while achievement was higher for NAT, AT indicated higher satisfaction and perceived effort. Similar findings were also reported by Um et al. (2012) for satisfaction and Mayer and Estrella (2014) and Shangguan et al. (2020a) for effort. According to Shangguan et al. (2020b), emotionally designed elements may stimulate learning effort as additional cognitive resources are required to process these elements. Additionally, even attentional focus, which we theorized was implicated by anthropomorphised elements could be associated with effort as described by Kanfer and Ackerman (1989) and satisfaction (Needham, 1978). Likewise, while NC motivates additional attention and evidence indicate a low preference for anthropomorphism (Epley et al., 2007), NC did not moderate any learning outcomes. Nevertheless, high NC respondents in the AT group indicated higher achievement, perceived satisfaction, and less effort when exposed to the intervention. We stipulate that this group may view anthropomorphised elements solely for decorative purposes and ignore their attributes, as also explained by Slabbert et al. (2022).
Subsequently, in view of epistemic emotions, we observed a partiality towards reducing negative emotions. The findings revealed no significant difference between the groups concerning all epistemic emotions except for Anxious and Bored, which transpired into effects relating to negative emotions, and the impact was deemed high (danxious=.896 and dbored=1.028). According to Wong and Adesope (2021), positive and negative emotions may lead to different learning behaviours, attitudes, and outcomes, and Shangguan et al. (2020b) claimed that positive emotions relate to students learning control which was not assessed in this study. While empirical findings have indicated that the aesthetic appeal of anthropomorphism may foster positive emotions and learning outcomes (Plass & Kaplan, 2015), Loderer et al. (2020) explained that both positive and negative epistemic emotions have a similar impact. Hence, as anxiety and boredom were reduced, the experience can be reflected as a positive experience as anthropomorphised elements successfully improved intent and interest (opposite of bored). Next, we observed favourable outcomes for the AT groups as a higher mean value was observed for the overall gain in positive emotion, as negative emotions were also significantly reduced. Additionally, by observing how each emotion was associated with learning outcomes, the AT group only reflected significant negative correlations between learning achievement with Confused and learning satisfaction with Frustrated. However, negative associations were observed in the NAT group between learning effort with Confused and Frustration and interestingly between learning satisfaction with effort. Next, the relationship between epistemic emotions and learning outcomes further differed in both groups based on learning achievement with Confused and Frustrated and perceived effort with Frustaration. Nevertheless, Bored and Anxious were not associated with any learning outcomes; we theorized that the influence might be directed towards other outcomes not tested in this study. These epistemic emotions could also be associated with emotions when exposed to a new learning material, namely Confusion, Frustration, and Boredom (D’Mello, 2013), while anthropomorphism could contribute to reducing anxiousness and adaptability.
Next, as emotional design is a tool used to improve attention (Chung & Cheon, 2020; Endres et al., 2020), anthropomorphism was measured based on gaze behaviour to determine attention based on the initial view, the number of views, and dwell time. According to Lodge and Harrison (2019), the clarity of the term attention in digital learning is still widely speculated and differs from the cognitive neuroscience perspective. Endres et al. (2020), as an example, explained that attention to new learning materials usually happens in the first minute, but manipulation is still needed to maintain the attention where the instruction should create situational interest. In this study, we observed that the AT group viewed the intended objects in the AOI earlier than the NAT group. Nevertheless, the number of average views for each AOI was higher for the NAT group. Henceforth, while this study's findings supported Stárková et al. (2019), indicating that anthropomorphisms affect initial fixation, we are unable to speculate the reason behind such findings as sensibly anthropomorphism should create such situational attention.
However, Lodge and Harrison (2019) explained that attention to learning could also be speculated based on voluntary and involuntary attention. In this study, anthropomorphism was regarded as a stimulus for saliency, and the design was intended to create involuntary attention. For that reason, to further provide in-depth understanding, the dwell time, which is the duration viewers spend focusing on a section (Bruno et al., 2021), was imperative. It was observed that the AT group showed a higher dwell time for anthropomorphised elements at the beginning of the video, but the dwell time for the same AOI for the NAT group was surprisingly higher for other elements. Additionally, we observed a U-shape trend behavior reflecting a prolonged stagnation in dwell time before increasing again when there is situational interest that we hypothesized may be due to the anthropomorphised characters portraying negative emotions (Neptune and Pluto) or the anticipated end of the video. Additionally, we speculated that the addition of anthropomorphism might at times mask the original attributes of the essential multimedia element that implies a need to consider design implications such as proportional sizes and colour variations.
7 Conclusion
The finding indicates that anthropomorphised elements did not influence achievement, perceived satisfaction, and effort even when considering NC. Nevertheless, the addition of anthropomorphised elements reduced negative emotions, specifically epistemic emotions, which were Bored and Anxiety. Furthermore, the difference in the relationship between epistemic emotions and learning outcomes indicated that adding anthropomorphised elements influenced learning achievement by minimizing Confused and Frustrated emotions and perception of mental effort by Frustrated. In hindsight, gaze behaviour indicated that while anthropomorphisms influenced the initial view, it did not improve the number of views or dwell time in the AOI. Interestingly, we observe that anthropomorphised elements depicting negative emotions may improve the dwell time.
7.1 Limitations and recommendations for future studies
This study is limited to undergraduate students in Malaysia, and further exploration is required to investigate if the findings of this study can be applied to other age groups, populations, larger sample sizes, subject matter areas, and types of learning material. Next, additional multimodal considerations such as sound effects and animation should be considered, as using idle anthropomorphised elements may not be sufficient to understand how anthropomorphism influences learning. Furthermore, Wong and Adesope (2021) claim that the nature of presentation (animated or static) in emotional design is still understudied, with empirical findings indicating an influence on mental effort and learning outcomes. Similarly, as Krämer et al. (2013) described, emotions are influenced by the unconscious mimicry of characters' expressive cues; we stipulate that animating these cues may have a different impact on emotions and learning. Hence, another consideration is exploring anthropomorphised elements in educational chatbots, as mobile users today vastly use 'stickers' and 'emoticons.' Furthermore, this will provide insights into the complex dynamics as to the influence of mobile interaction in educational environment (Kumar, 2021) as chatbots have possibilities to create social cue replicating humanlike interaction (Kumar & Silva, 2020). Consequently, an interesting perspective is also to consider special education and senior citizens and how anthropomorphised elements could aid learning by reducing anxiousness. Moreover, we hypothesise three design considerations for anthropomorphism manipulation that should be considered in future studies: aesthetics, emotional expression, and size proportion. Future studies could also consider new content, context, culture, and testing methods beyond the typical self-evaluation method. Hence, we encourage using emotion recognition systems (Triberti et al., 2017) as such measurement could provide an in-depth understanding of emotions, such as the effect of boredom, engagement (Barron-Estrada et al., 2018), and emotional valance in real-time.
References
Airenti, G. (2018). The development of anthropomorphism in interaction: intersubjectivity, imagination, and theory of mind. Frontiers in Psychology, 9, 2136. https://doi.org/10.3389/fpsyg.2018.02136
Arslanyilmaz, A., & Sullins, J. (2021). Eye-gaze data to measure students' attention to and comprehension of computational thinking concepts. International Journal of Child-Computer Interaction, 100414. https://doi.org/10.1016/j.ijcci.2021.100414
Barron-Estrada, M. L., Zatarain-Cabada, R., & Aispuro-Gallegos, C. G. (2018). Multimodal recognition of emotions with application to mobile learning. Proceedings - IEEE 18th International Conference on Advanced Learning Technologies, ICALT 2018, 416–418. https://doi.org/10.1109/ICALT.2018.00104
Brom, C., Stárková, T., & D’Mello, S. K. (2018). How effective is emotional design? A meta-analysis on facial anthropomorphisms and pleasant colors during multimedia learning. Educational Research Review, 25, 100–119. https://doi.org/10.1016/j.edurev.2018.09.004
Brown, B., Gielissen, K. A., Soares, S., Gao, C. A., Moeller, J., & Windish, D. (2022). Anthropomorphic character animations versus digital chalk talks in a resident diabetes pharmacotherapy curriculum: a randomized controlled trial. Journal of General Internal Medicine, 37(9), 2251–2258.
Bruno, A., Lancette, S., Zhang, J., Moore, M., Ward, V. P., & Chang, J. (2021). A saliency-based technique for advertisement layout optimisation to predict customers' behaviour. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 12662 LNCS, 495–507. https://doi.org/10.1007/978-3-030-68790-8_39
Cao, Y., Proctor, R. W., Ding, Y., Duffy, V. G., Zhang, Y., & Zhang, X. (2022). Is an anthropomorphic app icon more attractive than a non-anthropomorphic one? A case study using multimodal measurement. International Journal of Mobile Communications, 20(4), 419–439.
Cao, Y., Zhang, Y., Ding, Y., Duffy, V. G., & Zhang, X. (2021). Is an anthropomorphic app icon more attractive? Evidence from neuroergonomomics. Applied Ergonomics, 97, 103545.
Cacioppo, J. T., Petty, R. E., & Kao, C. F. (1984). The efficient assessment of need for cognition. Journal of Personality Assessment, 48, 306–307. https://doi.org/10.1207/s15327752jpa4803_13
Cacioppo, J. T., Petty, R. E., Feinstein, J. A., & Jarvis, W. B. G. (1996). Dispositional differences in cognitive motivation: The life and times of individuals varying in need for cognition. Psychological Bulletin, 119, 197–253.
Chowdhury, A., Chakrabarti, D., & Karmakar, S. (2018). Anthropomorphic televisions are more attractive: the effect of novelty. Ergonomics in Caring for People (pp. 243–249). Springer.
Chung, S., & Cheon, J. (2020). Emotional design of multimedia learning using background images with motivational cues. Journal of Computer Assisted Learning, 36(6), 922–932. https://doi.org/10.1111/jcal.12450
Coskun, A., & Cagiltay, K. (2022). A systematic review of eye-tracking‐based research on animated multimedia learning. Journal of Computer Assisted Learning, 38(2), 581–598.
Dehn, D. M., & Van Mulken, S. (2000). The impact of animated interface agents: a review of empirical research. International Journal of Human-Computer Studies, 52(1), 1–22.
D’Mello, S. (2013). A selective meta-analysis on the relative incidence of discrete affective states during learning with technology. Journal of Educational Psychology, 105(4), 1082–1099. https://doi.org/10.1037/a0032674
Eid, M., Gollwitzer, M., & Schmitt, M. (2011). Statistik und Forschungsmethoden, Psychologie Verlagsunion: Beltz.
Endres, T., Weyreter, S., Renkl, A., & Eitel, A. (2020). When and why does emotional design foster learning? Evidence for situational interest as a mediator of increased persistence. Journal of Computer Assisted Learning, 36(4), 514–525. https://doi.org/10.1111/jcal.12418
Epley, N., Waytz, A., & Cacioppo, J. T. (2007). On seeing human: a three-factor theory of anthropomorphism. Psychological Review, 114(4), 864–886. https://doi.org/10.1037/0033-295X.114.4.864
Frischen, A., Bayliss, A. P., & Tipper, S. P. (2007). Gaze cueing of attention: Visual attention, social cognition, and individual differences. Psychological Bulletin, 133(4), 694–724. https://doi.org/10.1037/0033-2909.133.4.694
Haaranen, L., Ihantola, P., Sorva, J., & Vihavainen, A. (2015, May). In search of the emotional design effect in programming. In 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering (Vol. 2, pp. 428–434). IEEE.
Hight, M. O., Nguyen, N. Q., & Su, T. A. (2021). Chemical anthropomorphism: acting out general chemistry concepts in social media videos facilitates student-centered learning and public engagement. Journal of Chemical Education, 98(4), 1283–1289.
Hillaire, G. E. (2021). Understanding emotions in online learning: Using emotional design and emotional measurement to unpack complex emotions during collaborative learning [Doctoral dissertation, The Open University]. https://doi.org/10.21954/ou.ro.00012ded
Kanfer, R., & Ackerman, P. L. (1989) . Motivation and cognitive abilities: An integrative/aptitude-treatment interaction approach to skill acquisition. Journal of Applied Psychology, 74(4) 657-690. https://doi.org/10.1037/0021-9010.74.4.657
Krämer, N., Kopp, S., Becker-Asano, C., & Sommer, N. (2013). Smile and the world will smile with you—the effects of a virtual agent's smile on users' evaluation and behavior. International Journal of Human-Computer Studies, 71, 335–349. https://doi.org/10.1016/j.ijhcs.2012.09.006
Kumar, J. A. (2021). Educational chatbots for project-based learning: investigating learning outcomes for a team-based design course. International journal of educational technology in higher education, 18(1), 1–28.
Kumar, J. A., Muniandy, B., & Wan Yahaya, W. A. J. (2018). Exploring the effects of visual aesthetics in e-learning for engineering students. Knowledge Management and E-Learning, 10(3), 250–264. https://doi.org/10.34105/j.kmel.2018.10.015
Kumar, J. A., Muniandy, B., & Wan Yahaya, W. A. J. (2019). Exploring the effects of emotional design and emotional intelligence in multimedia-based learning: an engineering educational perspective. New Review of Hypermedia and Multimedia, 25(1–2), 57–86. https://doi.org/10.1080/13614568.2019.1596169
Kumar, J. A., & Silva, P. A. (2020, April). Work-in-progress: A preliminary study on students' acceptance of chatbots for studio-based learning. In 2020 IEEE Global Engineering Education Conference (EDUCON) (pp. 1627–1631). IEEE.
Lenhard, W., & Lenhard, A. (2014). Hypothesis tests for comparing correlations. Bibergau. Psychometrica. https://doi.org/10.13140/RG.2.1.2954.1367
Li, J., Luo, C., Zhang, Q., & Shadiev, R. (2020). Can emotional design really evoke emotion in multimedia learning? International Journal of Educational Technology in Higher Education, 17(1), https://doi.org/10.1186/s41239-020-00198-y
Liew, T. W., Pang, W. M., Leow, M. C., & Tan, S. M. (2022). Anthropomorphizing malware, bots, and servers with humanlike images and dialogues: the emotional design effects in a multimedia learning environment. Smart Learning Environments, 9(1). https://doi.org/10.1186/s40561-022-00187-w
Loderer, K., Pekrun, R., & Lester, J. C. (2020). Beyond cold technology: A systematic review and meta-analysis on emotions in technology-based learning environments. Learning and Instruction, 70, 101162. https://doi.org/10.1016/j.learninstruc.2018.08.002
Lodge, J. M., & Harrison, W. J. (2019). The role of attention in learning in the digital age. Yale Journal of Biology and Medicine, 92(1), 21–28.
Mayer, R. E. (2020). Searching for the role of emotions in e-learning. Learning and Instruction. https://doi.org/10.1016/j.learninstruc.2019.05.010
Mayer, R. E., & Estrella, G. (2014). Benefits of emotional design in multimedia instruction. Learning and Instruction, 33, 12–18. https://doi.org/10.1016/j.learninstruc.2014.02.004
Millis, K., Forsyth, C., Butler, H., Wallace, P., Graesser, A., & Halpern, D. (2011). Operation ARIES!: A serious game for teaching scientific inquiry. In M. Ma, A. Oikonomou, & L. C. Jain (Eds.), Serious games and edutainment applications (Vol. 195, p. 169). Springer.
Moon, J., & Ryu, J. (2021). The effects of social and cognitive cues on learning comprehension, eye-gaze pattern, and cognitive load in video instruction. Journal of Computing in Higher Education, 33(1), 39–63. https://doi.org/10.1007/s12528-020-09255-x
Moremoholo, T. P., & de Lange, R. W. (2018). Anthropomorphic graphics: How useful are they as an instructional aid to facilitate learning? The Independent Journal of Teaching and Learning, 13(2), 67–81.
Moreno, R., & Mayer, R. (2007). Interactive multimodal learning environments. Educational Psychology Review, 19, 309–326.
Münchow, H., & Bannert, M. (2019). Feeling good, learning better? Effectivity of an emotional design procedure in multimedia learning. Educational Psychology, 39(4), 530–549. https://doi.org/10.1080/01443410.2018.1524852
Needham, D. (1978). Student effort, learning, and course evaluation. The Journal of Economic Education, 10(1), 35–43.
Norman, D. A. (2004). Emotional design: Why we love (or hate) everyday things. Basic Books.
Othman, Y., Khalaf, M., Ragab, A., Salaheldin, A., Ayman, R., & Sharaf, N. (2020). Eye-to-eye: towards visualizing eye gaze data. 2020 24th International Conference Information Visualisation (IV), 689–693. https://doi.org/10.1109/IV51561.2020.00128
Pang, W. M., Liew, T. W., & Leow, M. C. (2021, July). Emotional design for educational multimedia: A mini-review. In 2021 14th International Conference on Human System Interaction (HSI) (pp. 1–8). IEEE.
Park, B., Knörzer, L., Plass, J. L., & Brünken, R. (2015). Emotional design and positive emotions in multimedia learning: An eyetracking study on the use of anthropomorphisms. Computers and Education, 86, 30–42. https://doi.org/10.1016/j.compedu.2015.02.016
Park, H. S., Baker, C., & Lee, D. W. (2008). Need for cognition, task complexity, and job satisfaction. Journal of Management in Engineering, 24(2), 111–117. https://doi.org/10.1061/(ASCE)0742-597X. (2008)24:2(111).
Pekrun, R., Vogl, E., Muis, K. R., & Sinatra, G. M. (2017). Measuring emotions during epistemic activities: the epistemically-related emotion Scales. Cognition and Emotion, 31(6), 1268–1276. https://doi.org/10.1080/02699931.2016.1204989
Plass, J. L., & Kaplan, U. (2015). Emotional design in digital media for learning: an integrated cognitive affective model of learning with multimedia (ICALM). In S. Tettegah, & M. Gartmeier (Eds.), Emotions, technology, design & learning (pp. 131–162). Elsevier.
Plass, J. L., Homer, B. D., MacNamara, A., Ober, T., Rose, M. C., Pawar, S., Hovey, C. M., & Olsen, A. (2020). Emotional design for digital games for learning: The effect of expression, color, shape, and dimensionality on the affective quality of game characters. Learning and Instruction, 70, 101194. https://doi.org/10.1016/j.learninstruc.2019.01.005
Ramachandra, C. K., & Joseph, A. (2021). IEyeGASE: An intelligent eye gaze-based assessment system for deeper insights into learner performance. Sensors, 21(20), 6783.
Schneider, S., Beege, M., Nebel, S., Schnaubert, L., & Rey, G. D. (2022). The Cognitive-Affective-Social Theory of Learning in digital Environments (CASTLE). Educational Psychology Review. https://doi.org/10.1007/s10648-021-09626-5
Shangguan, C., Gong, S., Guo, Y., Wang, X., & Lu, J. (2020a). The effects of emotional design on middle school students' multimedia learning: the role of learners' prior knowledge. Educational Psychology, 40(9), 1076–1093. https://doi.org/10.1080/01443410.2020.1714548
Shangguan, C., Wang, Z., Gong, S., Guo, Y., & Xu, S. (2020b). More attractive or more interactive? The effects of multi-leveled emotional design on middle school students' multimedia learning. Frontiers in Psychology, 10, 1–12. https://doi.org/10.3389/fpsyg.2019.03065
Slabbert, C., de Lange, R. W., & Mason, H. (2022). Anthropomorphisms in multimedia learning: Do they facilitate learning in primary school learners? Cogent Education, 9(1). https://doi.org/10.1080/2331186X.2022.2034390
Stark, L., Brünken, R., & Park, B. (2018). Emotional text design in multimedia learning: A mixed-methods study using eye tracking. Computers & Education, 120, 185–196. https://doi.org/10.1016/j.compedu.2018.02.003
Stárková, T., Lukavský, J., Javora, O., & Brom, C. (2019). Anthropomorphisms in multimedia learning: Attract attention but do not enhance learning? Journal of Computer Assisted Learning, 1–4. https://doi.org/10.1111/jcal.12359
Taber, K. S. (2018). The Use of Cronbach's alpha when developing and reporting research instruments in science education. Research in Science Education, 48, 1273–1296. https://doi.org/10.1007/s11165-016-9602-2
Topala, I., & Tomozii, S. (2014). Learning satisfaction: validity and reliability testing for students' learning satisfaction questionnaire (SLSQ). Procedia - Social and Behavioral Sciences, 128, 380–386. https://doi.org/10.1016/j.sbspro.2014.03.175
Triberti, S., Chirico, A., La Rocca, G., & Riva, G. (2017). Developing emotional design: emotions as cognitive processes and their role in the design of interactive technologies. Frontiers in Psychology, 8, 1773. https://doi.org/10.3389/fpsyg.2017.01773
Türkoguz, S., & Ercan, İ. (2022). Effect of visual anthropomorphic stories on students' understanding of the particulate nature of matter and anthropomorphic discourse. Chemistry Education Research and Practice, 23(1), 206–225.
Tzafilkou, K., Economides, A. A., & Protogeros, N. (2021). Mobile sensing for emotion recognition in smartphones: a literature review on non-intrusive methodologies. International Journal of Human–Computer Interaction, 1–15. https://doi.org/10.1080/10447318.2021.1979290
Um, E. R. (2008). The effect of positive emotions on cognitive: Processes in multimedia-based learning. [Doctoral Dissertation, New York University].
Um, E. R., Plass, J. L., Hayward, E. O., & Homer, B. D. (2012). Emotional design in multimedia learning. Journal of Educational Psychology, 104(2), 485–498. https://doi.org/10.1037/a0026609
Uzun, A. M., & Yıldırım, Z. (2018). Exploring the effect of using different levels of emotional design features in multimedia science learning. Computers & Education, 119, 112–128. https://doi.org/10.1016/j.compedu.2018.01.002
van Wermeskerken, M., & van Gog, T. (2017). Seeing the instructor's face and gaze in demonstration video examples affects attention allocation but not learning. Computers & Education, 113, 98–107. https://doi.org/10.1016/j.compedu.2017.05.013
Wang, X., Mayer, R. E., Han, M., & Zhang, L. (2022). Two emotional design features are more effective than one in multimedia learning. Journal of Educational Computing Research, 0(0), https://doi.org/10.1177/07356331221090845
Wong, R. M., & Adesope, O. O. (2021). Meta-analysis of emotional designs in multimedia learning: A replication and extension study. Educational Psychology Review, 33(2), 357–385. https://doi.org/10.1007/s10648-020-09545-x
Funding
This research was funded by the Ministry of Higher Education Malaysia for Fundamental Research Grant Scheme with Project Code: FRGS/1/2020/SSI0/USM/02/23 awarded to Jeya Amantha Kumar.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Competing interests
The authors report that there are no competing interests to declare.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Kumar, J.A., Ibrahim, N., McEvoy, D. et al. Anthropomorphised learning contents: Investigating learning outcomes, epistemic emotions and gaze behaviour. Educ Inf Technol 28, 7877–7897 (2023). https://doi.org/10.1007/s10639-022-11504-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10639-022-11504-8