Abstract
The use of remote augmented reality (AR) guidance is seen as an opportunity to address the growing complexity of industrial tasks. Previous research showed benefits of AR for different industrial tasks especially for novice users. However, there is not much work that examines the relation between experience level of users with AR and the nature of the task to be addressed (whether it requires remote AR guidance or not). In this chapter, addressing the field of complex machine maintenance and repair, we look into the question of whether and how remote AR support using smart glasses reduces the maintenance time, and two factors that influence acceptance aspects of AR smart glass technology for productive use. A design science approach was adopted to define the requirements and design and develop a prototype for a state-of-the-art smart glass for a German small and medium enterprise (SME) with complex machinery. An evaluation was conducted with two industries (one with low and the other with high requirement of AR technology) as well as under field conditions. In addition to the reduction in maintenance time, we examined whether task suitability and low privacy concerns increase acceptance of an AR application for remote maintenance. Our field study reveals interesting insights. First, we show that using a remote maintenance application, a time reduction of up to 46% was expected to be achieved by the manufacturer. Second, despite its novelty and the corresponding added time, we found that guidance via AR is more accepted when data privacy concerns are addressed by providing information on the system, and when the enterprise has a higher requirement for AR maintenance. This work shows the potential of AR for remote consultation and maintenance of industrial tasks in practice, and it brings up design suggestions for acceptance of smart glass technology for maintenance.
Access provided by Autonomous University of Puebla. Download chapter PDF
Keywords
1 Company Description
CAS Software AG was founded in 1986 and is led and managed by Martin Hubschneider. More than 400 co-creators work together on the CAS Campus in Karlsruhe, Germany, on leading software solutions of the industry that are used across several industries. The company’s product portfolio includes cloud-based customer relationship management (CRM) systems and product and quote configurators that help organisations build successful and sustainable business relationships, make better use of corporate knowledge, and increase the efficiency of their employees. The products of the company are customised to several industries, including automobile, energy and utilities industry, research and education institutions, aviation industry, mechanical and plant engineering, and manufacturing companies. Over 400,000 users worldwide work with CAS Software products every day.
2 Project Summary
Knowledge transfer is defined as “the conveyance of knowledge from one place, person, system or ownership to another” (Liyanage et al., 2009). Service and maintenance processes in particular require efficient knowledge transfer methods, where knowledge is rarely documented and important skills are limited to a few people (Webel et al., 2013; Zhou et al., 2008). The current worldwide pandemic has necessitated remote digital service processes and collaborative digital tools. These tools should enable information and knowledge exchange between employees of different levels of expertise (Wang et al., 2014) as well as achieve remote services seamlessly with available personnel on the customer end, where conducting service procedures with own maintenance personnel is time-consuming and expensive.
Augmented reality (AR) smart glasses have been identified as a powerful supporting technology in various tasks such as product design, assembly, maintenance, quality control, and material handling (Syberfeldt et al., 2017). In the area of maintenance, the crucial advantages of smart glasses lie in moving away from hand-held devices to head-mounted devices and an alternative control system by voice (Quint et al., 2017; Schulzrinne, 2018). Del Amo et al. (2018) present a systematic review to identify the relations between AR visualisation techniques in authoring, context awareness, and interaction analysis in the context of maintenance applications, to identify which knowledge transfer goals can be achieved by AR. According to Fu et al. (2010), remote maintenance allows time-saving to the traditional process of 60–90%. Despite these exceeding advantages reported in research, adoption of AR in practice by manufacturing companies has been slow (Syberfeldt et al., 2017).
In this project, we investigate the usability and acceptance aspects of augmented reality glasses for maintenance processes of a German manufacturing SME. A voice-controlled augmented reality application was designed, developed, and evaluated. Evaluation results of employees of the manufacturing SME with real-time maintenance use cases are presented. The chapter concludes with an outlook and implications for SMEs in adopting smart glass technology for maintenance in practice.
3 Project Details
The design science research methodology (Peffers et al., 2007) was adopted to define the requirements, design and develop a solution artefact, and evaluate and disseminate information about the artefact. Specifically, requirements were gathered by analysing the current maintenance process of the SME and proposing customer journeys for the targeted maintenance process. Touchpoints with existing CRM systems were identified, and actions and interactions of the service expert and the customer with the intended remote application were prioritised. These requirements were verified by means of in-depth interviews with service experts, and preliminary evaluations of mockup designs.
A comparison of state-of-the-art smart glasses for remote maintenance revealed several advantages of the RealwearFootnote 1 head-mounted tablets (HMT) for remote collaboration. (1) The availability of an open-source API compatible for building Unity and Android applications and (2) the availability of documentation and an online support community were two important factors in favour thereof. Moreover, (3) the RealWear enables adaption to the voice control system with its embedded API for WearML, the mark-up language of RealWear. The remote service application was built on Android, and components such as video calling and communication with CRM system were integrated over the Android base. A dedicated open-source video call server was hosted, thus enabling manufacturers to have a data-compliant way to communicate and store their sensitive data.
The remote service application generated identification numbers for each service request, which were sent to both the service personnel and the customer (as confirmation and e-mail invitation). Video call invitations were automatically generated for the specific machine type and service problem and sent along with the e-mail invitation to the assigned personnel. On the application, the list of previous service sessions was fetched from the cloud-enabled CRM system SmartWe2,Footnote 2 from a dedicated tenant (database silo) using its REST API. Video calls were initiated by the service employee on the smart glasses using voice command, allowing multiple personnel to join at the same time, from different networks. Video sessions were recorded and cloud links were integrated on the CRMFootnote 3 tenant. The CRM tenant thus stored and visualised the complete overview of the progress of the maintenance sessions and tickets, as well as information on video recordings, service-call history, images taken during the service processes, and the corresponding contact details of the service personnel and customer. The information can be administered with the required rights and permissions, to ensure that only relevant service personnel have access to the service process.
4 Evaluation
The evaluation was carried out in three phases, wherein the results of each phase were incorporated iteratively into the next phase. The first evaluation was a usability and feature comparison test to evaluate the feature layout, particularly due to the constraints of the screen in the form of design mockups. The second evaluation aimed to evaluate the first prototype with smart glasses. Here, employees of a German SME software provider performed a mock maintenance task by assembling wooden blocks with instructions from another colleague remotely. They provided feedback on usability and specific features of the app, in addition to open feedback. The third evaluation was conducted with the employees of the manufacturer. Participants had to perform a typically occurring maintenance task remotely, with help of an experienced service team at a German SME manufacturer. Aspects such as high noise levels, intermittent network, and environmental lighting issues were also present in this evaluation, thus mimicking conditions of real-life usage.
Feedback on AR suitability, usability, and feature design was gathered from 20 participants in each evaluation. Think-aloud protocols (Kussmaul & Tirkkonen-Condit, 1995; Jääskeläinen, 2010) were used during evaluations, where feedback from the users were directly recorded in a structured protocol. The System Usability Scale (SUS) was used to obtain a “global view of subjective assessments of usability” (Brooke, 1996). The SUS is based on a Likert scale (Brooke, 1996; Baumgartner et al., 2021) and has also been used in the analysis of wearable devices (Liang et al., 2018). Acceptance of smart glasses in the area of the usual tasks of an employee was investigated with the questionnaire of Berkemeier et al. (2017). Finally, the AR suitability questionnaire was adapted from Palmarini et al. (2017) to gauge suitability of smart glasses for the given maintenance task, as well as to assess whether AR content and annotations are considered a necessity by the users.
The results of all three evaluations showed that the majority of the participants were enthusiastic about the concept of the prototype. The fictitious as well as real-life maintenance task was fulfilled during the call with the service employee by all participants. In the third evaluation, participants reported that the application allows manufacturers to save their average maintenance time by 46% (measured in days), in comparison to their existing duration. The acceptance of the smart glass application (Realwear HMT-1) was dependent on the use case and requirement of the remote maintenance process. Usability scores of the application were, however, high for both non-maintenance and maintenance firm’s employees. This resulted from the use of the recommended UX design guidelines by RealWear HMT3 and the improvements based on findings of previous evaluations. The reported acceptance scores in the second evaluation (by the software provider enterprise) were lower in comparison to those reported by the manufacturing enterprise employees in the third evaluation. Augmented reality content and annotations were not reported to be necessary for a successful application and adoption in this specific use case but was viewed upon as a helpful add-on. The prototype application was coded with open-source libraries and environments, and this information was communicated to the participants, before gathering feedback on privacy concerns. Open-source and dedicated servers are expected to allow SMEs to implement prototypes without lock-in problems, as well as achieve improved digital sovereignty and reduced privacy concerns surrounding the application. This was confirmed by the correlation between low reported privacy concerns and high acceptance scores in the two evaluations, as reported by the participants from the software provider as well as the manufacturing enterprise.
5 Future Outlook and Conclusion
This work demonstrated the process of developing a remote smart glass-based maintenance process for an SME. Whilst usability of the remote service application was reported to be high, the acceptance of technology was dependent on the need for remote processes and digital tools. Acceptance was improved further by integrating the remote tools with existing CRM and maintenance management systems, thus creating a seamless process for the service technician as well as the remote customer.
Limitations in the current design and evaluation process mainly involved the external circumstances of the global COVID-19 pandemic, which led to assumptions during the development and evaluation phase, such as social distancing measures, as well as in the evaluation process—where a complete remote evaluation at the manufacturer was designed. These measures might have led to crucial information about the maintenance process being overlooked during the evaluation. Further, the application was tested on one specific device, the RealWear HMT-1, which might have led to device-specific advantages as well as disadvantages influencing the acceptance scores. Another general limitation in the use of a remote maintenance application is the availability of a stable network connection and adapting video calls for low bandwidth requirements. As of today, there is a lack of ubiquitous high-speed Internet connection, particularly in Germany (Rauschnabel et al., 2015). This resulted in difficult circumstances for the video calls which partly reflected in the usability ratings.
As future work, the above-mentioned points need to be revisited and improved upon in further evaluations with pilot customers. Second, a detailed business analysis should be conducted and a revenue model for different companies would be necessary to facilitate further development and adoption of the technology. Moreover, the application should be developed for different smart glasses towards an accessible and generic remote maintenance application. Since most state-of-the-art smart glasses are Android-based devices, developing an Android application is a promising step in this direction. Integration with existing CRM systems should be expanded to allow for more possibilities—such as re-ordering of service machinery, or pre-shipping maintenance parts before scheduling the remote service procedure. Finally, long-term safety and health consequences on employees for wearing the RealWear HMT-1 have to be investigated, for successful adoption by employees and customers (Kim et al., 2016).
This research provides learnings from practice to increase adoption of smart glasses, particularly in manufacturing industries, where remote maintenance has become the need of the hour. Future work in providing a seamless experience across existing (CRM) systems would not only improve the acceptance of the smart glasses in maintenance but also extend it to areas of application in manufacturing—such as design, development, quality control, and other scenarios necessitating remote collaboration.
References
Baumgartner, J., Ruettgers, N., Hasler, A., Sonderegger, A., & Sauer, J. (2021). Questionnaire experience and the hybrid System Usability Scale: Using a novel concept to evaluate a new instrument. International Journal of Human-Computer Studies, 147, 102575.
Berkemeier, L., Werning, S., Zobel, B., Ickerott, I., & Thomas, O. (2017). Der Kunde als Dienstleister: Akzeptanz und Gebrauchstauglichkeit von Smart Glasses im Self-Service. HMD, 54(5), 781–794.
Brooke, J. (1996). In P. W. Jordan, B. Thomas, I. L. McClelland, & B. Weerdmeester (Eds.), SUS. A quick and dirty usability scale: Usability evaluation in industry (pp. 189–194). Taylor and Francis.
del Amo, I. F., Erkoyuncu, J. A., Roy, R., Palmarini, R., & Onoufriou, D. (2018). A systematic review of Augmented Reality content-related techniques for knowledge transfer in maintenance applications. Computers in Industry, 103, 47–71.
Fu, H., Pao, H. T., & Tseng, C. L. (2010). Internet based remote customer services. In 2010 IEEE Region 8 International Conference on Computational Technologies in Electrical and Electronics Engineering. SIBIRCON 2010 (pp. 733–735); Irkutsk, Russia, 11–15 July 2010; [proceedings]. Piscataway, NJ: IEEE.
Jääskeläinen, R. (2010). Think-aloud protocol. In Y. Gambier & L. van Doorslaer (Eds.), Handbook of translation studies (Vol. 1, pp. 371–373). John Benjamins.
Kim, S., Nussbaum, M. A., & Gabbard, J. L. (2016). Augmented Reality “Smart Glasses” in the workplace: Industry perspectives and challenges for worker safety and health. IIE Transactions on Occupational Ergonomics and Human Factors, 4(4), 253–258.
Kussmaul, P., & Tirkkonen-Condit, S. (1995). Think-aloud protocol analysis in translation studies. TTR, 8(1), 177–199. https://doi.org/10.7202/037201ar
Liang, J., Xian, D., Liu, X., Fu, J., Zhang, X., Tang, B., & Lei, J. (2018). Usability study of mainstream wearable fitness devices: Feature analysis and system usability scale evaluation. JMIR mHealth and uHealth, 6(11), e11066. https://doi.org/10.2196/11066
Liyanage, C., Elhag, T., Ballal, T., & Li, Q. (2009). Knowledge communication and translation–a knowledge transfer model. Journal of Knowledge Management.
Palmarini, R., Erkoyuncu, J. A., & Roy, R. (2017). An innovative process to select Augmented Reality (AR) technology for maintenance. Procedia CIRP, 59, 23–28.
Peffers, K., Tuunanen, T., Rothenberger, M. A., & Chatterjee, S. (2007). A design science research methodology for information systems research. Journal of Management Information Systems, 24(3), 45–77.
Quint, F., Loch, F., & Bertram, P. (2017). The challenge of introducing AR in industry – Results of a participative process involving maintenance engineers. Procedia Manufacturing, 11, 1319–1323. https://doi.org/10.1016/j.promfg.2017.07.260
Rauschnabel, P., Brem, A., & Ro, Y. (2015). Augmented Reality smart glasses. Definition, conceptual insights, and managerial importance.
Schulzrinne, H. (2018). Proceedings of the 15th EAI International Conference on Mobile and Ubiquitous Systems Computing, Networking and Services. ACM (ACM Other conferences).
Syberfeldt, A., Danielsson, O., & Gustavsson, P. (2017). Augmented Reality smart glasses in the smart factory: Product evaluation guidelines and review of available products (pp. 9118–9130). https://doi.org/10.1109/ACCESS.2017.2703952
Wang, J., Feng, Y., Zeng, C., & Li, S. (2014). An augmented reality based system for remote collaborative maintenance instruction of complex products. In IEEE (Ed.), 2014 IEEE International Conference on Automation Science and Engineering (CASE). Taipei, 18–22 August 2014 (pp. 309–314).
Webel, S., Bockholt, U., Engelke, T., Gavish, N., Olbrich, M., & Preusche, C. (2013). An augmented reality training platform for assembly and maintenance skills. Robotics and Autonomous Systems, 61(4), 398–403. https://doi.org/10.1016/j.robot.2012.09.013
Zhou, F., Duh, H. B.-L., & Billinghurst, M. (2008). Trends in augmented reality tracking, interaction and display: A review of ten years of ISMAR. In IEEE Computer Society (Ed.), 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality (pp. 193–202). ISMAR, Cambridge, UK, 15–18 September 2008.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this chapter
Cite this chapter
Hariharan, A., Risling, M., Felic, A., Ostertag, T. (2023). Integration of Smart Glasses for Knowledge Transfer in Industrial Remote Maintenance: Learnings from Practice. In: Jung, T., tom Dieck, M.C. (eds) XR-Metaverse Cases. Business Guides on the Go. Springer, Cham. https://doi.org/10.1007/978-3-031-30566-5_7
Download citation
DOI: https://doi.org/10.1007/978-3-031-30566-5_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-30565-8
Online ISBN: 978-3-031-30566-5
eBook Packages: Business and ManagementBusiness and Management (R0)