Abstract
In this study, a one-year program was conducted to investigate the relationships between students’ perceptions of mobile learning and their tendencies of peer interaction and higher-order thinking in issue-based mobile learning activities. To achieve the research objective, a survey consisting of eight scales, namely, usability, continuity, adaptive content, collaboration, communication, problem-solving, critical thinking and creativity, was developed. A total of 658 students from 38 high schools in Taiwan filled in the questionnaire after experiencing issue-based mobile learning activities. From the exploratory and confirmatory factor analyses, it was found that the questionnaire had high reliability and validity. The structural equation model further revealed that the provision of adaptive content in the mobile learning had positive impacts on the students’ tendency to interact with peers (i.e., collaboration and communication), which further affected their tendency to engage in higher-order thinking (i.e., problem-solving, critical thinking, and creativity). The findings of this study provide a good reference for researchers and school teachers who intend to promote mobile learning in school settings.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
Introduction
Following the advancements in information technology, the educational mode has shifted from teacher-centered to student-centered learning (Al-Samarraie et al. 2013). In a student-centered learning environment, learning is regarded as a knowledge constructing process whereby students are able to acquire, reorganize, and apply knowledge to analyze and solve problems (González-Marcos et al. 2016). With the rapid advancement and popularity of mobile technology, researchers have further indicated the potential of mobile devices in enabling students to link what they have learned to real-world contents; that is, using mobile technology to support learning could be an effective learning mode for facilitating student-centered learning (Chang et al. 2011). Researchers have called the learning mode that employs mobile technology to facilitate or support learning “mobile learning” (m-learning).
Mobile learning refers to a learning context in which learners utilize their individual portable devices to access a mobile network to conduct their learning, whether in or out of the classroom (Song 2014). This approach provides more opportunities and flexibility for learners to engage in self-directed and collaborative learning (Swallow 2015). Due to the potential of mobile learning, the issue of cultivating students’ cognitive abilities has been recognized by researchers (Kong and Song 2014; Lai and Wu 2012). For instance, Mouza and Barrett-Greenly (2015) incorporated mobile devices into the school settings of several low-income underserved schools, and found that the approach empowered the students’ academic performance. Several studies have further signified the positive impacts of incorporating mobile technologies into school curriculums on students’ higher-order thinking performances, such as their problem-solving, critical thinking and creativity (Kim et al. 2015; Kong and Song 2014). For example, (Toh et al. 2013) indicated that the merits of using handheld devices and wireless networks for accessing required information could facilitate students’ problem-solving and critical thinking performances. The studies of (Boyce et al. 2014) and (Kim et al. 2014) also revealed that using mobile technology to access supplementary materials in the field not only enabled students to apply what they had learned to problems in real-world contexts, but also fostered their higher-order thinking skills such as critical thinking and creativity.
As a consequence, several countries, such as Singapore, Thailand and Taiwan, have put a great deal of effort into implementing mobile learning in school settings to improve students’ higher-order thinking (Looi et al. 2014; Ozdamli and Uzunboylu 2014). For instance, in Taiwan, a nation-wide mobile learning promotion program aimed at improving the higher order thinking of high school students was initiated in 2013. It encouraged students to learn by utilizing their personal devices, and was aimed specifically at learning in mainstream education settings. However, few studies have examined how students perceive the impacts of mobile learning environments on their higher-order thinking, such as problem-solving, critical thinking, and creativity. In order to avoid pedagogical pitfalls and to develop mobile learning activities for effectively engaging students in higher-order thinking activities, educators and teachers need to understand students’ perceptions of the learning activities or environments in which they are situated (Zhu 2013). Therefore, the purpose of this study was to investigate the relationship between the perceptions of mobile learning and the tendency of the students who participated in a long-term mobile learning program to engage in higher order thinking.
Literature review
Interaction and higher order thinking competences
Due to the trend of globalization, several competences are regarded as key elements in empowering people’s technology literacy and competitiveness (Kong et al. 2014; Bellanca and Brandt 2010). In the educational field, the Partnership for 21st Century Skills (2009) first proposed that learning and innovation skills have been recognized as the skills that students must prepare for the increasingly complex life and working environments they will face. They also classified the skills of communication, collaboration, critical thinking, problem solving, and creativity as being essential to prepare students for their future.
On the other hand, several governmental organizations have successively pointed out the need to incorporate higher order thinking competences training into classrooms (The Ministry of Education in Singapore 2010; The U.S. Department of Education 2012). In Taiwan, several strategies and indicators for fostering and evaluating students’ interaction and higher order thinking have been proposed, including collaboration (Chuang et al. 2012), communication (Lan et al. 2012), problem-solving (Hwang et al. 2014), critical thinking (Yang et al. 2014), and creativity (Chuang et al. 2012; Chen and Chiu 2016). In summary, cultivating students’ interaction and higher order thinking competences is regarded as an important issue and a critical educational policy in many countries (Kong et al. 2014; Washor et al. 2013). Moreover, it is urgent for schools to develop teaching plans to help students develop these competences (Looi et al. 2011).
Collaboration is an important strategy that engages students in interacting with their peers to share their perspectives and ideas for achieving learning goals or completing learning tasks (Osman et al. 2011; Morrison et al. 2009). Communication refers to the ability that “articulates thoughts and ideas effectively by using oral, written and nonverbal communication skills in a variety of forms and contexts” (Frazier and Reynolds 2012, p. 10). Problem solving refers to the abilities of identifying problems, collecting and analyzing relevant information, proposing possible solutions, and choosing the most effective solution for dealing with the problem (Wang and Chiew 2010; Wiley 1998). Critical thinking refers to a cognitive strategy that students use to judge their methods and beliefs in a reflective way (Kozma and Voogt 2003; OECD 2008). Creativity refers to the ability of developing innovative ideas or products via elaborating, refining, analyzing and evaluating existing ones (Jarvis et al. 2013; Yang and Cheng 2010). It has been regarded as one of the most important skills that students need to acquire (Zeng et al. 2011).
Research of mobile learning for fostering interaction and higher order thinking competences
The potential of incorporating mobile technology into school settings for cultivating students’ 21st century core competences has also been recognized (Chang et al. 2011). For instance, Guerrero, Ochoa, Pino, and Collazos (2006) have reported the need to incorporate collaborative tasks into mobile learning activities, and have argued that mobile computing should fulfill the goal of engaging students in effective communication and collaboration. Kong (2014) also noted that the integration of mobile learning with well-developed pedagogical designs benefits the students’ development of their information literacy competency as well as their critical thinking skills. Moreover, Lai and Hwang (2014) also revealed the positive correlation of engagement in mobile learning to students’ problem-solving, critical thinking and creativity.
Several researchers have also reported that employing effective learning strategies or tools in mobile learning activities could be an empowering approach for cultivating those competences (Kim et al. 2014; Wong et al. 2015). For instance, Tsai, Tsai and Hwang (2012) developed a context-aware ubiquitous learning environment survey (CULES) for investigating the factors that might affect students’ acceptance and learning outcomes of mobile technology-enhanced learning. The findings signified that the provision of real-context information, timely guidance, and collaboration mechanisms is important for engaging students in higher level cognitive processes. Other studies have also reported the potential of mobile and wireless communication technologies in fostering students’ interaction and higher order thinking competences (Song 2014; Zydney and Warner 2016). For example, the merits of wireless communication and personalized devices have facilitated students’ discussion and collaboration in learning activities (Toh et al. 2013); the provision of relevant learning materials in the field via mobile devices can encourage students to use their learning knowledge in real contexts, and can also sharpen their higher-order thinking skills (Boyce et al. 2014; Looi and Wong 2014). Moreover, some studies have investigated students’ improvement, such as in their critical thinking, collaboration and problem solving as a result of mobile learning (Vogel et al. 2014; Wang and Wu 2008), and have proved that integrating seamless mobile technology into students’ learning activities may enhance their higher order thinking. According to previous research, it was concluded that proper learning devices and platforms, ubiquitous learning environments, and adaptive learning content were the basic elements of students’ mobile learning activities (Hwang et al. 2008; Al-Samarraie et al. 2013).
In Taiwan, a nation-wide mobile learning promotion program funded by the government has been conducted. The aim of the program is to engage students in higher order thinking activities via using mobile technology in school settings. As indicated by several researchers, the use of new technologies is likely to make learning different from conventional technology-enhanced learning (e.g., using projectors and PowerPoint), and thus teachers or educators need to rethink the structure and the procedure of learning activities and take students preferences into account (Kamarainen et al. 2013; Ruchter et al. 2010). Therefore, exploring students’ mobile technology preferences and their relation to their higher order thinking tendency in mobile learning has gained importance. In this study, the questionnaire of 4C1P awareness (i.e., “collaboration,” “communication,” “critical thinking,” “creativity” and “problem-solving”) was adopted to explore students’ awareness of interaction and higher order thinking. This study also probed whether the students’ mobile learning preferences, such as “ease of use”, “continuity”, and “adaptive content”, could affect their 4C1P awareness. This study first explored the component of the students’ 4C1P awareness in mobile learning, and then explored the structural relationship of their 4C1P awareness and mobile learning preferences. Accordingly, the factors affecting students’ higher order thinking and peer interaction tendencies were discussed and provided to school teachers or educators as a reference (Tsai 2005) for modifying their mobile learning activities and learning systems.
Research framework
In this study, an exploration of students’ mobile learning preferences and their awareness of peer interaction and higher-order thinking was conducted. To ensure that all of the participants had the same mobile learning experience, the teachers were guided to develop mobile learning activities based on a recommended learning mode. In this learning mode, the students utilized the same type of tablet computers (i.e., HTC Flyers) donated by an enterprise to collaboratively search for information on the Internet; moreover, they needed to select and summarize the searched information based on a series of questions related to an issue specified by the teachers.
Furthermore, this study developed the framework of higher-order thinking tendency in issue-based mobile learning activities based on the characteristics of the activities and with reference to previous studies (Kong et al. 2014). Three aspects were cataloged as the important elements in this framework, namely technology preferences, interaction with learners, and higher order thinking tendency, as shown in Fig. 1. The “technology preference” aspect refers to the characteristics of technologies in mobile learning, which can be regarded as the fundamental aspect relating to the “interaction with learners” aspect (Hwang et al. 2008; Lee and Kim 2015). The “interaction with learners” aspect refers to the interactions between students in dealing with learning tasks (Jones et al. 2013), while the “higher order thinking tendency” aspect refers to students’ higher-order thinking tendencies or awareness after experiencing the issue-based mobile learning activities (Liu et al. 2010). According to the studies reported by Kong et al. (2014) and Tsai et al. (2012), the “technology preference” and “interaction with learners” aspects could be the predictors of the “higher order thinking tendency” aspect.
In particular, the “technology preference” aspect refers to students’ mobile adoption and learning behaviors in inquiry (Vogel et al. 2014). Some studies have signified that the provision of a user-friendly interface on devices is important for engaging students in higher-level cognitive processes (Hwang et al. 2008). Moreover, the merits of wireless communication and personalized devices have facilitated students’ continuous engagement in learning activities (Toh et al. 2013). Finally, the provision of adaptive learning materials that meet students’ needs can encourage students to use their learning knowledge in real contexts, and sharpens their higher-order thinking skills (Looi and Wong 2014; Kim et al. 2014).
In addition, when dealing with issue-based tasks in teams, the interaction between team members is an important element of learning; therefore, “collaboration” and “communication” need to be taken into account (Frazier and Reynolds 2012; Osman et al. 2011; Morrison et al. 2009).
The context of mobile learning achieves the goal of providing opportunities to develop higher-order thinking skills. Anderson and Krathwohl (2001) asserted that the higher-order thinking skills include analysis, evaluation, and creativity. Analysis refers to the problem-solving abilities of identifying problems, exploring relationships, and collecting and analyzing relevant information for dealing with problems (Lazakidou and Retalis 2010); evaluation refers to critical thinking, a strategy that students employ to judge their methods and beliefs in a reflective way (Kozma and Voogt 2003), while creativity refers to the ability of developing innovative ideas or products via elaborating, refining, analyzing and evaluating existing ones (Yang et al. 2014; Yang and Cheng 2010). It is regarded as one of the most important skills a student needs to acquire (Zeng et al. 2011).
In order to examine the students’ higher-order thinking tendency in mobile learning, in this study, the issue-based mobile learning activities which were conducted and the framework and questionnaire were developed by previous researchers (Kong et al. 2014; Tsai et al. 2012). According to the literature review, these three aspects (technology preference, interaction with learners, and higher-order thinking tendency) were suitable for explaining the relationship of mobile learning and higher-order thinking from students’ perspectives.
Method
Participants
In this study, a long-term mobile learning program supported by the Ministry of Education in Taiwan was conducted (http://mlearning.ntust.edu.tw/). A total of 38 schools voluntarily participated in the program from August 2014 to July 2015. In order to help the high school teachers develop quality mobile learning activities, a series of training courses was provided, and a consultant team made up of 40 experienced scholars from several universities in Taiwan was formed to assist individual schools. In addition, nine training courses (about 70 h) were provided to help the school teachers develop mobile learning activities in school settings based on the mobile learning model and strategies provided by the consultant team. During the academic year, an advisor from the consultant team was invited to visit a school 4–6 times to give comments on the mobile learning activities the teachers had designed. Several demonstrated examples were also provided to the teachers to ensure that quality issue-based mobile learning activities were conducted in those schools to engage students in higher-order thinking. In each learning activity, a series of learning tasks related to a specific issue was raised by the teacher. The students learned in teams. Each team of students needed to search for information on the Internet, collect data in the field, discuss with team members, and summarize their findings to complete the learning tasks, as shown in Fig. 2.
The participants were the students from ten randomly selected schools. They were aged from 16 to 18 (from K10 to K12). After experiencing one year of mobile learning activities, a total of 809 students voluntarily responded to a survey with open-ended questions via an online survey system. A total of 658 effective responses were included in this study, including responses from 318 males and 340 females. The ratio of the students who voluntarily responded compared to the total student population in the selected schools was 34%, while the ratio of the effective responses compared to the students who voluntarily responded was 81%. In addition, the distribution of students in northern, central and southern Taiwan was 25, 35, and 40%, respectively.
Instruments
To meet the purpose of this study, the questionnaires of Mobile Learning Preferences and awareness of Collaboration, Communication, Critical thinking, Problem-solving and Creativity were adopted to measure the students’ perceptions after the mobile learning program. All of the items in the questionnaires were presented using a five-point Likert scale, ranging from “1—strongly disagree” to “5—strongly agree”.
The Mobile Learning Preference (MLP) questionnaire was revised from the measure developed by Tsai et al. (2012) for investigating learners’ preferences in mobile learning environments. It consists of three dimensions: ease of use (3 items), continuity (3 items), and adaptive content (3 items), which have been identified as important elements affecting students’ mobile learning performance (Hwang et al. 2012). Ease of use (EU) refers to students’ perceptions of the ease with which they can use the mobile learning system (e.g., “When navigating m-learning environments, I prefer that they have well-suited mobile devices”). Continuity (CN) refers to students’ preference for learning continuously when situated in the mobile learning environment (e.g., “When navigating m-learning environments, I prefer that they can provide the function of recording what I have learned”). Adaptive content (AC) refers to students’ perceived importance of whether the information provided by the mobile learning system meets their requirements (e.g., “When navigating m-learning environments, I prefer that they can provide information which I need, e.g. documents, images, voice, etc.”).
The 4C1P Awareness questionnaire (4C1PA) consists of five dimensions, that is, collaboration, communication, complex problem solving, critical thinking, and creativity with 5, 6, 4, 4, and 3 items, respectively. The Collaboration (CL) dimension was developed by Jeng and Tang (2004); for example, “I try to provide useful and sufficient information when I conduct collaborative learning.” The Communication (CO) dimension was revised from the Communicative Adaptability Scale (Duran 1992) for investigating students’ conceptions of communicating with others (e.g., I am verbally and nonverbally supportive of other people). The Problem-Solving (PS) dimension was a modified version of the problem-solving questionnaire developed by Pan (2001); for example, “When facing problems, I believe I have the ability to solve them.” The Critical thinking (CT) dimension was modified from the measure developed by Schraw and Dennison (1994); for example, “I consider several alternatives to a problem before I answer.” The Creativity (CA) dimension was proposed by Lin and Wang (1994) for measuring the creative tendency of students (e.g., “I like to observe something I haven’t seen before and understand it in detail”).
Data analysis
This study involved three phases of the data analysis procedure, including exploratory factor analysis (EFA), confirmatory factor analysis (CFA), and structural equation modeling (SEM).
The finalization of the questionnaires was conducted through exploratory factor analysis (EFA) and confirmatory factor analysis (CFA). The EFA was conducted to clarify the structure of each aspect (interaction with technologies, interaction with learners, and higher-order thinking tendency), and the CFA was used to examine the construct validity of the questionnaires and clarify the consequent structures. The participants (n = 658) were randomly split into two subsets, where half (n = 329, including 147 males and 182 females) were used for the EFA and the other half (n = 329, including 171 males and 158 females) for the CFA.
In the EFA, the items with factor loadings of less than 0.50 and with many cross loadings were omitted (Bentler 1990; Walker and Fraser 2005). The validity and reliability of the questionnaire were further evaluated accordingly. The scales of each aspect were clarified by employing IBM Statistical Product and Service Solutions (SPSS) version 20. The CFA employed Linear Structure RELationships (LISREL) to confirm the validity of the scales in the questionnaires (Jöreskog and Sörbom 1993).
Finally, the structure relationships existing between the three aspects were explored through a structural equation modeling (SEM) analysis, which offers a flexible and powerful means of examining the relationships among constructs (Kelloway 1998). In this study, LISREL version 8.80 was used to conduct SEM analysis.
Results
Validity and reliability of the students’ higher-order thinking tendency in issue-based mobile learning activities
To validate the questionnaires on the students’ higher-order thinking tendency in mobile learning, three principal component analyses with varimax rotation were performed to clarify the structure of all aspects. Table 1 shows the results of the EFA analysis of the students’ interaction with technologies. The total variance explained was 77.94%, and the overall KMO value was greater than 0.50 (Field 2000), indicating that the factor analysis was favorable for explaining the students’ perception of interaction with technologies in the issue-based mobile learning activities. The students’ responses regarding their interaction with technologies were grouped into three dimensions with a total of 9 items. Each dimension consisted of 3 items. The Cronbach’s alpha coefficients for the three dimensions were 0.85, 0.90, and 0.81, and the overall Cronbach’s alpha was 0.90. This suggests that these dimensions have high reliability for assessing students’ perceptions of technologies in mobile learning.
On the other hand, the EFA result of the students’ responses regarding interaction with learners is shown in Table 2. The total variance explained was 67.12% and the overall KMO value was 0.90, indicating that those factors were favorable for explaining the students’ perceptions of interaction with learners in issue-based mobile learning activities. The students’ responses regarding interaction with learners were grouped into two dimensions: collaboration and communication. The dimension of “collaboration” consisted of 5 items and “communication” consisted of 6 items. The Cronbach’s alpha coefficients for the two factors were 0.87, 0.90, and the overall alpha was 0.89. This suggests that these factors have high reliability for assessing students’ perceptions of interaction with learners.
Lastly, EFA analysis was also employed to examine the students’ higher-order thinking tendency in issue-based mobile learning activities. The overall KMO value was 0.85, and the total variance explained was 69.62%. This result suggested that the students’ responses related to their higher-order thinking tendency were favorable for explaining their perceptions of the learning activities. The students’ responses were grouped into three dimensions with a total of 11 items, as shown in Table 3. The Cronbach’s alpha coefficients for the three factors were 0.85, 0.84, and 0.80, and the overall alpha was 0.86. This suggests that these factors have high reliability for assessing students’ higher-order thinking tendency in issue-based mobile learning activities.
On the other hand, the confirmatory factor analysis (CFA) further confirmed the construct validity and the structure of the students’ tendency of higher-order thinking in issue-based mobile learning activities. The CFA factor loadings and the t-values of all the items for each scale are presented in Table 4. The fitness of the items for each scale of the questionnaire (Χ2 per degree of freedom = 1.85, RMSEA = 0.05, GFI = 0.87, NFI = 0.95, CFI = 0.98) indicated a sufficient fit and also confirmed the questionnaire structure. Moreover, the examination of the composite reliability and the convergent and discriminant validities were also employed. Composite reliability (CR) of each scale was greater than 0.7, indicating an acceptable value for a reliable construct (Fornell and Larcker 1981). The average variance extracted (AVE) ranged from 0.52 to 0.78, which exceed the value of 0.5, indicating that the model was acceptable.
The structural equation model of the students’ higher-order thinking tendency in issue-based mobile learning activities
According to previous research (Hwang et al. 2008; Kong et al. 2014), the aspect of “interaction with technologies” (EU, CN, and AC) was utilized as the exogenous variable to explain the aspect of “interaction with learners” and “higher-order thinking tendency.” Furthermore, “interaction with learners” (CL and CO) was regarded as the predictor variable to explain the “higher-order thinking tendency” (PS, CT, and CA). The results of the fit measures for the students’ higher-order thinking tendency in the issue-based mobile learning activities model are shown as Table 5, indicating a good satisfactory fit and confirming the structures (Jöreskog and Sörbom 1993). Since the GFI indices (0.87 for CFA, and 0.86 for the structural equation model) approached the recommended value (0.9), this study meets the requirements defined by researchers (Browne and Cudeck 1993).
The structural equation model of the students’ higher-order thinking tendency in the issue-based mobile learning activities, the summary of the maximum-likelihood parameter estimates and the significance of the t-values are presented in Fig. 3. The statistically significant relationships are shown with solid lines, and, for a cleaner display, other non-significant relationships are concealed. Furthermore, the level of significance of the t-value was 3.29 (p < 0.001) (Jöreskog and Sörbom 1993).
According to the structural equation model, CA (Creativity) had a strong relationship with CO (communication) and CL (collaboration) in the aspect of interaction with learners. This indicates that, when students engage in the creative process, regular communication and collaboration with their peers is important. The students’ critical thinking process (CT) was also related to communication and collaboration in the aspect of interaction with learners. Similar to the creativity aspect, the interaction with their peers and frequent discussion with their group members may engage students in evaluation and judgments.
In addition, the students’ problem-solving (PS) was strongly related to their collaboration. In other words, the engagement of collaboration in mobile learning activities plays an important role when students analyze problems. Compared with the tendency of critical thinking and creativity, the communication aspect did not relate to the students’ problem-solving process, which implies that these students regarded that the opportunity to communicate with their peers was not the essential element when they engaged in examining problems, exploring relationships, or solving tasks.
Regarding the interaction with learners (communication and collaboration), CO (communication) was highly related to AC (adaptive content) and CN (continuity), indicating that the quality of the wireless connection and the provision of learning content that meets the students’ needs should be considered in the communicating process. Moreover, CL (collaboration) was highly related to AC (adaptive content), which also indicated that, in order to assist the students in collaborative mobile learning, the provision of multiple and relevant learning material is essential.
In sum, with regard to helping students engage at the analyzing level in issue-based mobile learning activities, it would be better to take into account the process of collaboration and the provision of information based on students’ needs. Moreover, for employing critical thinking and creativity in students’ learning, the consideration of group discussion and collaboration in mobile learning is essential, while a continuous mobile learning environment that provides students with information based on their requirements should also be included.
Finally, it is interesting to note that the ease of use (EU) dimension of the interaction with technologies was not related to any dimension of the interaction with learners or their higher-order thinking tendency. This indicates that these students thought the interface of their mobile learning approach may not influence their higher-order thinking tendency in mobile learning.
Discussion and conclusions
In recent years, the investigation of improving students’ interaction and higher-order thinking skills has been increasingly discussed (Yang and Wu 2012; Zydney and Warner 2016). Some researchers have implemented experimental designs to explore the effects of mobile technology on students’ specific skills (Vogel et al. 2014), but have rarely paid attention to students’ actual views on mobile technology and the technology support for the interaction and higher-order thinking skills. Since mobile technology has been recognized as an important technology in learning (Chang et al. 2010), it is urgent that students’ views on the effectiveness of mobile learning for cultivating their interaction and higher-order thinking skills be understood. In this study, a long-term mobile learning program was conducted. Moreover, several instruments were developed and used to explore the relationships between the students’ technology uses (ease of use, continuity, and adaptive content), peer interaction (communication and collaboration) and their higher-order thinking skills tendency (problem-solving, critical thinking, and creativity).
According to the structural equation model, the positive predictive link from “Adaptive content” to “Collaboration” and “Communication” indicated the importance of providing proper content to students (e.g., text, voice data, and image data) in mobile learning. Moreover, students’ engagement in communication and collaboration are important mediators between their technology preferences and higher-order thinking tendency (e.g., problem-solving, critical thinking, and creativity). This result signifies that, in order to stimulate students to reach the higher-order thinking level, it is important to encourage them to engage in more communication and collaboration in mobile learning activities, and hence experience more discussion with group members, which could in turn allow them to engage in self-reflection and in-depth knowledge exploration (Carbonaro et al. 2010; Cheung and Lau 2013; Morrison et al. 2009). Moreover, when taking adaptive learning content into account, those learning supports not only assisted the students to acquire available information, but also led them to explore task related information, and to solve their learning problems effectively and collaboratively. This finding is consistent with the results reported by Gan and Balakrishnan (2014) who found that real-time accessible learning sources and quality wireless communications are important criteria for developing mobile learning environments.
Nevertheless, the technical preference of “ease of use” did not play any positive role in any aspect, implying that those students might think an appropriate interface is a common and basic element of a mobile learning environment (Hwang et al. 2008). Therefore, they considered that the provision of a good learning interface in mobile activities is not an important element.
Unlike most mobile learning studies which aimed at the lead-in of sensing technologies or the provision of learning guidance mechanisms for individuals (e.g., Chu 2014; Hwang et al. 2014), this study explored the students’ perceptions of using mobile technologies in school settings and the impacts of mobile learning on their higher order thinking. Moreover, some qualitative data based on the students’ open-ended feedback were also analyzed. Accordingly, several findings are derived as follows:
-
(1)
The enabling of seamless learning: a stable wireless connection in the mobile learning environment for students to have continuous learning should be considered when developing the environment for learning (Hsiao et al. 2010). For example, one student with experience of an in-class issue-based discussion stated that, “It is helpful that I can access the network and search for the information I want. Without the tablet, I might forget the question that I want to find out.” Another student who participated in an in-field activity of a geography course indicated that, “I can learn by employing some Apps at any real location, and I can compare the real objects with the information in the textbook; it made me enjoy the geography courses more than before.” These findings confirm what has been indicated by Sharples (2015), namely that well-constructed mobile wireless technology could guide students to experience seamless and effective learning.
-
(2)
The enabling of peer interactions: the design of collaborative tasks to facilitate peer interactions through mobile technologies is necessary, as indicated by several researchers (Nova et al. 2005; Spikol and Otero 2012). For example, a student who studied in a mobile learning context for a chemistry course stated that, “It was fun that I could work together with my classmates and we could share our own thinking about the chemistry concept.” Another student also shared the same feeling, saying that, “I was afraid to answer questions before. The use of mobile devices changed my thinking. Now I find that answering questions in front of lots of classmates is not so embarrassing after reading the answers and opinions they shared through their devices.” Several students also indicated that they were more willing to share information with peers and to participate in brainstorming after using mobile technologies to learn.
-
(3)
Encouragement of higher-order thinking: One student stated that, “When I was taking the civics course, our teacher asked us to search for the issue on the Internet; it surprised me that I can discuss some social issues in our life rather than just memorizing the knowledge in the text book.” Another student said, “The issue of national identity raised by our teacher really reflected the phenomenon in Taiwan; we found different kinds of opinions on the Internet and then we thought and developed our personal opinion critically and seriously.” Several students also shared similar opinions. It was found that mobile learning can provide students with opportunities to apply what they have learned to their daily-life contexts (Pérez-Sanagustín et al. 2012). Moreover, through frequent collaboration and communication, the students’ performance could be more satisfactory and they could attain a more in-depth level of thinking (Hwang et al. 2014).
On the other hand, some limitations and suggestions are provided for consideration in future studies. First, this current model only involves several technical, interaction aspects and several complex learning skills. It is encouraged that more variables of students’ competences be considered in future explorations. Second, it is also suggested that the relationship between students’ mobile learning and their learning outcomes in those environments be the subject of future discussion.
References
Al-Samarraie, H., Teo, T., & Abbas, M. (2013). Can structured representation enhance students’ thinking skills for better understanding of E-learning content? Computers & Education, 69, 463–473.
Anderson, L. W., & Krathwohl, D. R. (2001). A taxonomy for learning, teaching, and assessing: A revision of Bloom’s educational objectives. New York: Longamn.
Bellanca, J., & Brandt, R. (2010). 21st Century skills: Rethinking how students learn. Indiana, IN: Solution Tree.
Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107, 238–246.
Boyce, C. J., Mishra, C., Halverson, K. L., & Thomas, A. K. (2014). Getting students outside: Using technology as a way to stimulate engagement. Journal of Science Education and Technology, 23(6), 815–826.
Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. Sage Focus Editions, 154, 136.
Carbonaro, M., Szafron, D., Cutumisu, M., & Schaeffer, J. (2010). Computer-game construction: A gender-neutral attractor to computing science. Computers & Education, 55(3), 1098–1111.
Chang, C. S., Chen, T. S., & Hsu, W. H. (2011). The study on integrating WebQuest with mobile learning for environmental education. Computers & Education, 57(1), 1228–1239.
Chang, K. E., Lan, Y. J., Chang, C. M., & Sung, Y. T. (2010). Mobile-device-supported strategy for Chinese reading comprehension. Innovations in Education and Teaching International, 47(1), 69–84.
Chen, C. H., & Chiu, C. H. (2016). Employing intergroup competition in multitouch design-based learning to foster student engagement, learning achievement, and creativity. Computers & Education, 103, 99–113.
Cheung, P. C., & Lau, S. (2013). A tale of two generations: Creativity growth and gender differences over a period of education and curriculum reforms. Creativity Research Journal, 25(4), 463–471.
Chu, H. C. (2014). Potential negative effects of mobile learning on students’ learning achievement and cognitive load -a format assessment perspective. Educational Technology & Society, 17(1), 332–344.
Chuang, P. J., Chiang, M. C., Yang, C. S., & Tsai, C. W. (2012). Social networks-based adaptive pairing strategy for cooperative learning. Educational Technology & Society, 15(3), 226–239.
Duran, R. L. (1992). Communicative adaptability: A review of conceptualization and measurement. Communication Quarterly, 40(3), 253–268.
Field, A. (2000). Discovering statistics using SPSS for Windows: Advanced techniques for the beginner. London, England: Sage publications Ltd.
Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of marketing research, 18(1), 39–50.
Frazier, K., & Reynolds, E. (2012). Power up your creative mind. Marion, Israel: Pieces of Learning.
Gan, C. L., & Balakrishnan, V. (2014). Determinants of mobile wireless technology for promoting interactivity in lecture sessions: An empirical analysis. Journal of Computing in Higher Education, 26(2), 159–181.
González-Marcos, A., Alba-Elías, F., Navaridas-Nalda, F., & Ordieres-Meré, J. (2016). Student evaluation of a virtual experience for project management learning: An empirical study for learning improvement. Computers & Education, 102, 172–187.
Guerrero, L., Ochoa, S., Pino, J., & Collazos, C. (2006). Selecting computing devices to support mobile collaboration. Group Decision and Negotiation, 15(3), 243–271.
Hsiao, H. S., Lin, C. C., Feng, R. T., & Li, K. J. (2010). Location based services for outdoor ecological learning system: Design and implementation. Educational Technology & Society, 13(4), 98–111.
Hwang, G. J., Hung, P. H., Chen, N. S., & Liu, G. Z. (2014). Mindtool-assisted in-field learning (MAIL): An advanced ubiquitous learning project in Taiwan. Educational Technology & Society, 17(2), 4–16.
Hwang, G. J., Tsai, C. C., Chu, H. C., Kinshuk, K., & Chen, C. Y. (2012). A context-aware ubiquitous learning approach to conducting scientific inquiry activities in a science park. Australasian Journal of Educational Technology, 28(5), 931–947.
Hwang, G. J., Tsai, C. C., & Yang, S. J. H. (2008). Criteria, strategies and research issues of context-aware ubiquitous learning. Educational Technology & Society, 11(2), 81–91.
Jarvis, C. H., Dickie, J., & Brown, G. (2013). Going mobile: Perspectives on aligning learning and teaching in geography. Journal of Geography in Higher Education, 37(1), 76–91.
Jeng, J. H., & Tang, T. I. (2004). A model of knowledge integration capability. Journal of Information, Technology and Society, 4(1), 13–45.
Jones, A. C., Scanlon, E., & Clough, G. (2013). Mobile learning: Two case studies of supporting inquiry learning in informal and semiformal settings. Computers & Education, 61, 21–32.
Jöreskog, K. G., & Sörbom, D. (1993). LISREL 8: Structural equation modeling with the SIMPLIS command language. Lincolnwood, IL: Scientific Software International.
Kamarainen, A. M., Metcalf, S., Grotzer, T., Browne, A., Mazzuca, D., Tutwiler, M. S., et al. (2013). EcoMOBILE: Integrating augmented reality and probeware with environmental education field trips. Computers & Education, 68, 545–556.
Kelloway, E. K. (1998). Using LISREL for structural equation modeling: A researcher’s guide. Newbury Park, CA: Sage.
Kim, H., Lee, M., & Kim, M. (2014). Effects of mobile instant messaging on collaborative learning processes and outcomes: The case of South Korea. Educational Technology & Society, 17(2), 31–42.
Kim, P., Suh, E., & Song, D. (2015). Development of a design-based learning curriculum through design-based research for a technology-enabled science classroom. Educational Technology Research and Development, 63(4), 575–602.
Kong, S. C. (2014). Developing information literacy and critical thinking skills through domain knowledge learning in digital classrooms: An experience of practicing flipped classroom strategy. Computers & Education, 78, 160–173.
Kong, S. C., Chan, T. W., Griffin, P., Hoppe, U., Huang, R. H., Kinshuk, et al. (2014). E-learning in school education in the coming 10 years for developing 21st century skills: Critical research issues and policy implications. Educational Technology & Society, 17(1), 70–78.
Kong, S. C., & Song, Y. J. (2014). The impact of a principle-based pedagogical design on inquiry-based learning in a seamless learning environment in Hong Kong. Educational Technology & Society, 17(2), 127–141.
Kozma, R. B., & Voogt, J. (2003). Technology, innovation, and educational change: A global perspective. Washington, DC: International Society for Technology in Education.
Lai, C. L., & Hwang, G. J. (2014). Effects of mobile learning time on students’ conception of collaboration, communication, complex problem-solving, meta-cognitive awareness and creativity. International Journal of Mobile Learning and Organisation, 8(3), 276–291.
Lai, C. Y., & Wu, C. C. (2012). Supporting nursing students’ critical thinking with a mobile web learning environment. Nurse Educator, 37(6), 235–236.
Lan, Y. F., Tsai, P. W., Yang, S. H., & Hung, C. L. (2012). Comparing the social knowledge construction behavioral patterns of problem-based online asynchronous discussion in e/m-learning environments. Computers & Education, 59(4), 1122–1135.
Lazakidou, G., & Retalis, S. (2010). Using computer supported collaborative learning strategies for helping students acquire self-regulated problem-solving skills in mathematics. Computers & Education, 54(1), 3–13.
Lee, S., & Kim, B. G. (2015). Users’ preferential factors in Web-based e-learning systems for ease of workplace learning in Korea. Learning and Individual Differences, 39, 96–104.
Lin, H. T., & Wang, M. J. (1994). Creativity assessment packet. Taipei: Psychological Publishing.
Liu, Y., Bui, E. N., Chang, C. H., & Lossman, H. G. (2010). PBL-GIS in secondary geography education: Does it result in higher-order learning outcomes? Journal of Geography, 109(4), 150–158.
Looi, C. K., So, H. J., Toh, Y., & Chen, W. (2011). The Singapore experience: Synergy of national policy, classroom practice and design research. International Journal of Computer-Supported Collaborative Learning, 6(1), 9–37.
Looi, C. K., Sun, D., Wu, L., Seow, P., Chia, G., Wong, L. H., et al. (2014). Implementing mobile learning curricula in a grade level: Empirical study of learning effectiveness at scale. Computers & Education, 77, 101–115.
Looi, C. K., & Wong, L. H. (2014). Implementing mobile learning curricula in schools: A programme of research from innovation to scaling. Educational Technology & Society, 17(2), 72–84.
Ministry of Education, Singapore. (2010). MOE to enhance learning of 21st century competencies and strengthen art, music and physical education. Retrieved March 26, 2014, from http://www.moe.gov.sg/media/press/2010/03/moe-to-enhance-learning-of-21s.php
Morrison, G. R., Morrison, G. R., & Lowther, D. L. (2009). Integrating computer technology in to the classroom: Skills for the 21st century. London, United Kingdom: Pearson.
Mouza, C., & Barrett-Greenly, T. (2015). Bridging the app gap: An examination of a professional development initiative on mobile learning in urban schools. Computers & Education, 88, 1–14.
Nova, N., Girardin, F., & Dillenbourg, P. (2005). ‘Location is not enough!’: An empirical study of location-awareness in mobile collaboration. Paper presented at the IEEE International Workshop on Wireless and Mobile Technologies in Education (WMTE’05).
OECD. (2008). Innovating to learn, learning to innovate. Paris, France: OECD Publishing.
Osman, G., Duffy, T. M., Chang, J. Y., & Lee, J. (2011). Learning through collaboration: Student perspectives. Asia Pacific Education Review, 12(4), 547–558.
Ozdamli, F., & Uzunboylu, H. (2014). M-learning adequacy and perceptions of students and teachers in secondary schools. British Journal of Educational Technology, 46(1), 159–172.
Pan, I. Y. (2001). A study on the effects of the play-based elementary science teaching (Master). Taipei Municipal University of Education, Taiwan.
Partnership for 21st century skills. (2009). Museums, libraries, and 21st century skills. Washington, DC: Institute of Museum and Library Services.
Pérez-Sanagustín, M., Santos, P., Hernández-Leo, D., & Blat, J. (2012). 4SPPIces: A case study of factors in a scripted collaborative-learning blended course across spatial locations. International Journal of Computer-Supported Collaborative Learning, 7(3), 443–465.
Ruchter, M., Klar, B., & Geiger, W. (2010). Comparing the effects of mobile computers and traditional approaches in environmental education. Computers & Education, 54(4), 1054–1067.
Schraw, G., & Dennison, R. S. (1994). Assessing metacognitive awareness. Contemporary Educational Psychology, 19(4), 460–475.
Sharples, M. (2015). Seamless learning despite context. In L.-H. Wong, M. Milrad, & M. Specht (Eds.), Seamless learning in the age of mobile connectivity (pp. 41–55). Singapore: Springer.
Song, Y. J. (2014). “Bring Your Own Device (BYOD)” for seamless science inquiry in a primary school. Computers & Education, 74, 50–60.
Spikol, D., & Otero, N. (2012). Designing better mobile collaborative laboratories for ecology field work for upper secondary schools. Paper presented at the Wireless, Mobile and Ubiquitous Technology in Education (WMUTE), 2012 IEEE Seventh International Conference on.
Swallow, M. (2015). The year-two decline: Exploring the incremental experiences of a 1:1 technology initiative. Journal of Research on Technology in Education, 47(2), 122–137.
Toh, Y., So, H. J., Seow, P., Chen, W. L., & Looi, C. K. (2013). Seamless learning in the mobile age: A theoretical and methodological discussion on using cooperative inquiry to study digital kids on-the-move. Learning Media and Technology, 38(3), 301–318.
Tsai, C. C. (2005). Preferences toward Internet-based learning environments: High school students’ perspectives for science learning. Educational Technology & Society, 8(2), 203–213.
Tsai, P. S., Tsai, C. C., & Hwang, G. J. (2012). Developing a survey for assessing preferences in constructivist context-aware ubiquitous learning environments. Journal of Computer Assisted Learning, 28(3), 250–264.
U.S. Department of Education. (2012). 21st century skills: A global imperative. Retrieved March 26, 2014, from http://www.ed.gov/blog/2012/03/21st-century-skills-a-global-imperative/
Vogel, B., Kurti, A., Milrad, M., Johansson, E., & Muller, M. (2014). Mobile inquiry learning in Sweden: Development insights on interoperability, extensibility and sustainability of the LETS GO software system. Educational Technology & Society, 17(2), 43–57.
Walker, S. L., & Fraser, B. J. (2005). Development and validation of an instrument for assessing distance education learning environments in higher education: The distance education learning environments survey (DELES). Learning Environments Research, 8(3), 289–308.
Wang, Y., & Chiew, V. (2010). On the cognitive process of human problem solving. Cognitive Systems Research, 11(1), 81–92.
Wang, S. L., & Wu, P. Y. (2008). The role of feedback and self-efficacy on web-based learning: The social cognitive perspective. Computers & Education, 51(4), 1589–1598.
Washor, E., Mojkowski, C., & Robinson, S. K. (2013). Leaving to learn: How out-of-school learning increases student engagement and reduces dropout rates. New Hampshire, USA: Heinemann Publishing.
Wiley, J. (1998). Expertise as mental set: The effects of domain knowledge in creative problem solving. Memory & Cognition, 26(4), 716–730.
Wong, L. H., Chai, C. S., Aw, G. P., & King, R. B. (2015). Enculturating seamless language learning through artifact creation and social interaction process. Interactive Learning Environments, 23(2), 130–157.
Yang, H. L., & Cheng, H. H. (2010). Creativity of student information system projects: From the perspective of network embeddedness. Computers & Education, 54(1), 209–221.
Yang, Y. T. C., Gamble, J. H., Hung, Y. W., & Lin, T. Y. (2014). An online adaptive learning environment for critical-thinking-infused English literacy instruction. British Journal of Educational Technology, 45(4), 723–747.
Yang, Y. T. C., & Wu, W. C. I. (2012). Digital storytelling for enhancing student academic achievement, critical thinking, and learning motivation: A year-long experimental study. Computers & Education, 59(2), 339–352.
Zeng, L., Proctor, R. W., & Salvendy, G. (2011). Can traditional divergent thinking tests be trusted in measuring and predicting real-world creativity? Creativity Research Journal, 23(1), 24–37.
Zhu, C. (2013). Students’ and teachers’ thinking styles and preferred teacher interpersonal behavior. Journal of Educational Research, 106(5), 399–407.
Zydney, J. M., & Warner, Z. (2016). Mobile apps for science learning: Review of research. Computers & Education, 94, 1–17.
Acknowledgements
This study is supported in part by the Ministry of Science and Technology of the Republic of China under contract numbers MOST-105-2511-S-011-008-MY3 and MOST 106-2511-S-011-005-MY3.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Hwang, GJ., Lai, CL., Liang, JC. et al. A long-term experiment to investigate the relationships between high school students’ perceptions of mobile learning and peer interaction and higher-order thinking tendencies. Education Tech Research Dev 66, 75–93 (2018). https://doi.org/10.1007/s11423-017-9540-3
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11423-017-9540-3