Abstract
The evolution and the growth of mobile applications (“apps”) in our society is a reality. This general trend is still upward and the app use has also penetrated the medical education community. However, there is a lot of unawareness of the students’ and professionals’ point of view about introducing “apps” within Medical School curriculum. The aim of this research is to design, implement and verify that the Technology Acceptance Model (TAM) can be employed to measure and explain the acceptance of mobile technology and “apps” within Medical Education. The methodology was based on a survey distributed to students and medical professionals from University of Salamanca. This model explains 46,7 % of behavioral intention to use mobile devise or “apps” for learning and will help us to justify and understand the current situation of introducing “apps” into the Medical School curriculum.
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
Introduction
The new digital area is being part of the lives of the Society. People are using mobile devices and new technologies for making their lives easier. Step by step, new technologies have been introduced in our lives, first of all as only a telephone with the possibility to call or send a message. After that, it was possible to access Internet but Society was demanding more and more products to be used with mobile phones. Then, the smartphones emerged with the possibility to do sports, control your diet, or even learn cooking using mobile applications (“apps”), which play an important role in the use of mobile devices.
In fact, according to the last report of International Telecommunications Unit [1], there will be around 7.000 million users in the world with a mobile line by end 2014, which represents a penetration rate of 96 %. The number of Internet users globally will be almost 3 billion (40 % of world’s population). In Europe, ITU estimates the mobile users penetration will be around 125 % and the Internet penetration rate will reach 75 % by end 2014.
As for the number of apps, there are more than one million apps in each main marketplace [2]: Google Play market (for Android System Operating) and App Store (for iOS) . Not only that, the Global Research Study [3] reports that the mobile technology offers real opportunities for mhealth. Besides, some figures also support this new emerging market. The physicians have a preference for using smartphones and tablets [4]. In Spain, this trend is also very similar as 90 % of the physicians access Internet at least with two different devices [5]. Some Medical Schools have adopted this new trend [6] making mobile devices and apps become a new tool for learning.
However, there have been few researches about the inquiries and the acceptance of mobile technology in medical education. In order to enhance the understanding of that issue, a TAM model was selected and implemented in the University of Salamanca. The purpose of this paper is to assess and verify that this TAM model can be employed to measure and explain the acceptance of introducing mobile devices and apps within Medical Education. The methodology was based on a survey distributed to students and medical professionals from University of Salamanca. This model will help us to justify and understand the current situation of the mobile technologies within Medical Schools.
The paper is structured in four parts. The first part consists on a brief introduction; the second part describes the methodology and the items of the TAM model used in this research. The third part presents the results of the study divided in two types: descriptive and inferential statistics. Finally, the last part draws the discussion and the conclusion.
Methodology
Method
The study carried out within this research, performed a survey in University of Salamanca among students and professionals of medical sector that investigated to which extent they accept the mobile devices and the apps in their medical curriculum.
The survey consisted of 29 questions grouped into two sections and the number of participants was 124. The first section included 19 questions related with demographic information and the second section included ten measurement items. The first TAM designed by Davis [7] omitted the external influences of others on behavior intention, but these external variables are added in the model as it is explained in [8]. In this research, the first eight items considered for the survey were based on the constructs reported by both articles [7, 8]. In addition, this study added two constructs more (Reliability and Recommendation) [9].
Table 1 shows the constructs and the assigned variables for this research framework. In order to quantify the different dimensions or constructs, the survey used a 5-point Likert scale. The participants were asked to respond to each statement in terms of their own degree of agreement of disagreement [10]. Likert scale is based on five possible answers ranging from strongly disagree (mapped to number 1) and strongly agree (mapped to number 5). The ANX construct has been reversed-scored.
Results
Descriptive statistics
The total number of participants that answered the survey was 124. There was a major proportion of female participants than male participants (64 % female, 36 % male). The reason could be that there is a growing tendency of women signed up in Medical Schools. Approximately, since 1998, the proportion of new female students in Medical Schools in Spain is roughly 65–71 % [11]. The dominant age presented in the sample was ranging from 18 to 35 years with a 71 % of the participants [12]. Most part of the participants (93,6 %) owned only a Smartphone or a Smartphone and a tablet. Then, we analyze the main descriptive statistics of the selected constructs.
The Table 2 describes the different values for media, mean, standard deviation, standard error, and variance. All means are above the midpoint 3000 and the standard deviations are within the range from 0,99 to 1,34 indicating a narrow spread around the mean.
Besides, the study calculates the skewness and kurtosis tests normality. Kline [13] suggests cutoff of absolute values of 3.0 and 8.0 for skewness and kurtosis respectively to ensure univariate normality. The results show that skewness values (≤|1,88|) and kurtosis values (≤|3,447|) are within the range of recommended values, so it is possible to assume that the responses were relatively normally distributed.
Inferential statistics
When using Likert-type scales it is imperative to calculate and report Cronbach’s alpha coefficient for internal consistency reliability [14]. The Cronbach’s alpha is an index of inter-item homogeneity [15], that is, how related a set of items is as a group [16].
The value of Cronbach’s alpha is 0,787, a value considered by experts as acceptable [17]. However, it is needed to run the factorial analysis to confirm if the proposed TAM model is adequate and the set of items is homogenous.
The objective of Factorial Analysis is “to represent a set of variables in terms of a smaller number of hypothetical variables” [18]. Structural Equation modeling was used to test all the hypothesized relationship.
A measure of sampling adequacy is a useful method for determining the appropriateness of running a factor analysis. These measures are also known as Keiser-Meyer Olkin (KMO statistics). In this case, the value obtained with SPSS program v21 is 0,748, what means that the correlation is good [19] and the factorial analysis is possible.
The CFA method is widely used for examining hypothesized relations among Likert-type items [20] and it provides a general analytic approach to assess construct validity. In this case, it is necessary to use AMOS program v16 to run the structured model and to test the relationship between the constructs of the research.
The significance tests of the hypothesis are presented in Fig. 1. This figure shows the path coefficients and R2 represents the proportion of the variance of the variable that could be explained. The path coefficients are marked with * if t > 1,96 (the level of ρ < 0,05). They are marked with ** if t-value > 2,58 (the level of ρ < 0,01) and it is marked with *** if t-value > 3,3 (the level of ρ < 0,001). In this research, the proposed model can explain 47 % of variance. It is difficult to find a standard criterion for how much a variance must be explained to be considered adequate. Some authors consider the adequate range from 40to 70 % [21]. It should be noted that all direct hypothesis were supported.
This research based the examination of the goodness of fit (GOF) indices on the assumption that the observed variables were normally distributed. The Table 3 reveals the output data of the proposed hypothesized model.
In this study, the final GOF indices considered for the analysis are the following: relative X 2, TLI, CFI and RMSEA parameters [13]. The relative X 2 is calculated as X 2/df as an alternative to X 2 goodness of fit which has been falling out of favor because it is influenced by sample size [25]. RMSEA and CFI seem to be less sensitive to sample size [26]. According to Mars & Balla [27] TLI (NNFI) is also no dependent of sample size.
The acceptable values of the parameters are obtained from different sources. RMSEA tells how well the model would fit the populations covariance matrix [28] and the accepted values were within the range 0,05–0,08 [22–24]. The CFI cutoff must be equal or higher than 0,95 [22]. On the other hand, NNFI parameter should have values equal or higher than 0,95 [22].
The TLI, CFI and RMSEA values obtained in the hypothesized model are within the recommended cutoff values. Therefore, these fit indices indicate that the proposed measurement model exhibits a good fit with the observed data.
Discussion and conclusion
This study attempts to provide some insights about factors that may affect the acceptance of mobile devices and apps by undergraduate students and medical professionals in their curriculum.
The use of mobile devices for learning has been analyzed by several articles (among others) [29–31] and several studies have been conducted to measure the acceptance of different technologies [32–35]. However, the results therefore need to be interpreted with caution to extend the results to different sectors as it is as well reported by Huang et al. [35]. Most part of the researches does not describe the type of the participants involved in the survey in order to determine the homogeneity of the respondents.
There are few studies that investigate specifically the medical education area [36, 37]. This paper is conducted within this area and the participants of the survey were undergraduate students and medical professionals. As a result, there are many factors influencing the mobile technology use that have yet to be fully explored [6]. This investigation can be considered a first research framework to demonstrate that individual characteristics and external variables may have a significant influence on individuals to predict BI.
Hence, this study found that overall two constructs (REC and SE) are key determinants for the BI of using apps for learning (ρ < 0,0001). The ATU is also important to predict the BI and this research also suggests that SI may affect the ATU in the same proportion than PU does. This is very important, as external factors must be considered to predict the attitude for using apps. The FC and ANX variables have been considered as external variables to affect indirectly the ATU and the BI. Consistent with prior research [6, 7], PEOU has a significant influence on PU, with ρ < 0,001.
However, while PU has a significant effect on ATU, PEOU does not. Other important finding of the research is that ATU significantly increases the degree of recommendation (REC) or the necessity of an app certification (REL).
Future research can be conducted to analyze the score results obtained and the benefits and drawbacks to encourage the use of mobile devices and apps for learning. In addition, it should be recommended to compare the collected data by using different subgroups such as profile, age or gender to gain deeper insights into the impact of these external variables on this TAM model.
References
International Telecommunication Union. (2014). ICT Facts Figures 2014. Retrieved from www.itu.int.
Number of mobile apps available in Apple Store y Google Play (2013) Statista. Retrieved from: http://www.statista.com.
Emerging Mhealth: Paths for growth.(n.d) PriceWaterHouseCooper research. http://www.pwc.com.
Reston, V. A., New Study on Physician Online Behaviors. Comscore press release. Retrieved from http://www.comscore.com, 2013.
La sociedad de la Información en España 2013, Fundación Telefónica. www.fundacion.telefonica.com, 2014.
Briz, L., Juanes, J. A., and García, F. J., Analysis of mobile devices as a support tool for professional medical education in the University School, EDULEARN14 Proceedings, pp. 4653–4658, 2014.
Davis, F. D., Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Q. 13(3):319, 1989. doi:10.2307/249008.
Venkatesh, V., Morris, M. G., Davis, G. B., and David, F. D., User acceptance of information technology: Toward a unified view. MIS Q. 27(3):425–478, 2003. doi:10.2307/30036540.
Briz-Ponce, L., Juanes Méndez, J. A., and García-Peñalvo, F. J., Analysis of certificated mobile application for medical Education purposes. In Proceedings of the Second International Conference on Technological Ecosystem for Enhancing Multiculturality - TEEM’14 (pp. 13–17). ACM New York. doi: http://dx.doi.org/10.1145/2669711.2669871, 2014a.
McIver, J., and Carmines, E. G., Unidimensional Scaling. SAGE Publications, 1981.
Estadística de Enseñanza Universitaria, In Instituto Nacional de Estadística. Retrieved from http://www.ine.es, 1998 a 2011.
Briz Ponce, L., Juanes Méndez, J. A., and García-Peñalvo, F. J., First approach of mobile applications study for medical Education purposes. In Proceedings of the Second International Conference on Technological Ecosystem for Enhancing Multiculturality - TEEM’14. ACM New York doi: http://dx.doi.org/10.1145/2669711.2669968, 2014b.
Kline, R. B., Principles and practice of structural equation modeling. Guilford Press, 2005.
Gliem, J. A., and Gliem, R. R., Calculating, Interpreting, and Reporting Cronbach’s Alpha Reliability Coefficient for Likert-Type Scales. Midwest Research to Practice Conference in Adult, Continuing, and Community Education, 82–88, 2003.
Cronbach, L. J., Coefficient alpha and the internal structure of tests. Psychometrika 16(3):297–334, 1951.
Tavakol, M., and Dennick, R., Making sense of Cronbach’s alpha. Int. J. Med. Educ. 2:53–55, 2011.
George, D., and Mallery, P., SPSS for Windows step by step: a simple guide and reference, 11.0 update. Allyn and Bacon, 2003.
Kim, J. O., and Mueller, C. W., Introduction to factor analysis: What it is and how to do it, vol. 13. Sage, Newbury Park, 1978.
Hutcheson, G. D., and Sofroniou, N., The multivariate social scientist: Introductory statistics using generalized linear models. SAGE Publications, London, 1999.
Flora, D. B., and Curran, P. J., An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychol. Methods 9(4):466–491, 2004.
Warner, R. M., Applied statistics: From bivariate through multivariate techniques: From bivariate through multivariate techniques. Sage, California, 2012.
Hu, L., and Bentler, P. M., Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct. Equ. Model. Multidiscip. J. 6(1):1–55, 1999. doi:10.1080/10705519909540118.
MacCallum, R. C., Browne, M. W., and Sugawara, H. M., Power analysis and determination of sample size for covariance structure modeling. Psychol. Methods 1(2):130–149, 1996.
Steiger, J. H., Understanding the limitations of global fit assessment in structural equation modeling. Pers. Individ. Differ. 42:893–898, 2007.
Munro, B. H., Statistical Methods for Health Care Research. Lippincott Williams & Wilkins, 2005
Fan, X., Thompson, B., and Wang, L., Effects of sample size, estimation methods, and model specification on structural equation modeling fit indexes. Struct. Equ. Model. 6(1):56–83, 1999.
Marsh, H. W., and Balla, J. R., Goodness-of-Fit indices in confirmatory analysis: The effect of sample size. Psychol. Bull. 103:391–410, 1986.
Hooper, D., Coughlan, J., and Mullen, M. R., Structural equation modelling: Guidelines for determining model fit. Electron. J. Bus. Res. Methods 6(1):53–60, 2008.
Chen, B., and Denoyelles A., Exploring students’ mobile learning practices in higher education. EDUCAUSE Review Online. Retrieved from http://www.educause.edu, 2013.
Ally, M., and Prieto-Blazquez, J., What is the future of mobile learning in education? Mobile Learning Applications in Higher Education [Special Section]. Rev. Univ. Soc. Knowl.(RUSC) 11(1):142–151, 2014. doi:10.7238/rusc.v11i1.2033.
Herrington, J., Herrington, A., Mantei, J., Olney, I. W., and Ferry, B., Using mobile tecnologies to develop new ways of teaching and learning. In New technologies, new pedagogies: Mobile learning in higher education (pp. 1–14). Wollongong: University of Wollongong. Retrieved from: http://researchrepository.murdoch.edu.au, 2009.
Dünnebeil, S., Sunyaev, A., Blohm, I., Leimeister, J. M., and Krcmar, H., Determinants of physicians’ technology acceptance for e-health in ambulatory care. Int. J. Med. Inform. 81(11):746–760, 2012. doi:10.1016/j.ijmedinf.2012.02.002.
Gagnon, M.-P., Ghandour, E. K., Talla, P. K., Simonyan, D., Godin, G., Labrecque, M., and Rousseau, M., Electronic health record acceptance by physicians: Testing an integrated theoretical model. J. Biomed. Inform. 48:17–27, 2014. doi:10.1016/j.jbi.2013.10.010.
Gefen, D., and Straub, D. W., Gender differences in the perception and use of e-mail: An extension to the technology acceptance model. MIS Q. 21(4):389–400, 1997. doi:10.2307/249720.
Huang, J.-H., Lin, Y.-R., and Chuang, S.-T., Elucidating user behavior from mobile learning: A perspective of the extended technology acceptance model. Electron. Libr. 25(5):585–598, 2007.
Taylor, J. D., Dearnley, C. A., Laxton, J. C., Coates, C. A., Treasure-Jones, T., Campbell, R., and Hall, I., Developing a mobile learning solution for health and social care practice. Dist. Educ. 31(2):175–192, 2010. doi:10.1080/01587919.2010.503343.
Vafa, S., and Chico, D. E., A needs assessment for mobile technology use in medical education. Int. J. Med. Educ. 4:230–235, 2013. doi:10.5116/ijme.5259.4a88.
Acknowledgments
This research work is made within University of Salamanca PhD Programme on Education in the Knowledge Society.
Author information
Authors and Affiliations
Corresponding author
Additional information
This article is part of the Topical Collection on Education & Training
Rights and permissions
About this article
Cite this article
Briz-Ponce, L., García-Peñalvo, F.J. An Empirical Assessment of a Technology Acceptance Model for Apps in Medical Education. J Med Syst 39, 176 (2015). https://doi.org/10.1007/s10916-015-0352-x
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10916-015-0352-x