Abstract
Virtual reality (VR)-based assembly training has been an interesting topic for the last decades. Generally, there are two shortcomings for nowadays virtual assembly training systems. One is that the operators cannot move around the virtual environment in a natural way as people activity in the real world: they are constrained in a fixed position or can only move in a limited space. The other is that most of the virtual assembly training systems are based on geometry constraint modeling only, which lacks haptics feedback. A new type haptics-based virtual environment system for assembly training of complex products is described in this paper. A new low-cost motion simulator is designed and integrated with the virtual environment to realize free walking by human. An automatic data integration interface is developed to transfer geometry, topology, assembly, and physics information from a computer-aided design system to a VR application, and a hierarchical constraint-based data model is rebuilt to construct the virtual assembly environment. Physics-based modeling and haptics feedback are undertaken to simulate the realistic assembly operations. The application examples and evaluation experiments demonstrate that both motion simulator and haptics have great value for training of assembly processes.
Article PDF
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
References
Li JR, Khoo LP, Tor SB (2003) Desktop virtual reality for maintenance training: an object oriented prototype system (V-REALISM). Comput Ind 52:109–125
Gaoliang P, Haiquin Y, Xinhua L, Yang J, He X (2010) A desktop virtual reality-based integrated system for complex product maintainability design and verification. Assem Autom 30(4):112–122
Kashiwa K, Mitani T, Tezura T, Yoshikawa TH (1995) Development of machine-maintenance training system in virtual environment. Proceedings of the 4th IEEE international workshop on robot and human communication (ROMAN ‘95), Tokyo, Japan, pp. 295–300
Holt P, O’B RJM, Day PN et al (2004) Immersive virtual reality in cable and pipe routing: design metaphors and cognitive ergonomics. J Comput Inf Sci Eng 4:161–170
Johnson TC, Vance JM (2001) The use of the Voxmap pointshell method of collision detection in virtual assembly methods planning. Proceedings of the ASME design engineering technical conference, Pittsburgh, PA, pp. 1169–1176
Wan H, Gao S, Peng Q, Dai G, Zhang F (2004) MIVAS: a multi-modal immersive virtual assembly system. Proceedings of the ASME Design Engineering Technical Conference, Salt Lake City, UT, pp. 113–122
Fernandes KJ, Rajaa VH, Eyreb J (2003) Immersive learning system for manufacturing industries. Comput Ind 51:31–40
Jayaram S, Jayaram U, Wang Y, Tirumali H, Lyons K, Hart P (1999) VADE: a virtual assembly design environment. IEEE Comput Graph Appl 19(6):44–50
Ritchie JM, Dewar RG, Simmons JEL (1999) The generation and practical use of plans for manual assembly using immersive virtual reality. Proc Inst Mech Engr B 213:461–470
Chryssolouris G, Mavrikios D, Fragos D et al (2000) A virtual reality-based experimentation environment for the verification of human-related factors in assembly processes. Robot Comput-Integr Manuf 16:267–276
Shuyou Z, Zhan G, Jianrong T, Zhenyu L (2002) Research of movement navigation based on assembly constraint recognition. Chin J Mech Eng (Engl Ed) 15(3):6–10
Marcelino L, Murray N, Fernando T (2003) A constraint manager to support virtual maintainability. Comput Graph 27:19–26
Abate AF, Guida M, Leoncini P, Nappi M, Ricciardi S (2009) A haptics-based approach to virtual training for aerospace industry. J Vis Lang Comput 20:318–325
Bhatti A, Creighton D, Nahavandi S, Khoo YB, Anticev J, Zhou M (2009) Haptically enabled interactivity and immersive virtual assembly. Cooperative Research Centre for Advanced Automotive Technology, Melbourne, pp 1–10
Seth A, Su HJ, Vance JM (2006) SHARP: a system for haptic assembly and realistic prototyping. ASME Design Engineering Technical Conferences and Computers and Information in Engineering Conference. Philadelphia, PA, USA, pp. 1045–1053
Vo DM, Judy M. Vance, Mervyn G. Marasinghe (2009) Assessment of haptics-based interaction for assembly tasks in virtual reality. Third Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. Salt Lake City, UT, USA, pp. 494–499
Iwata H, Fuji T (1996) Virtual Perambulator: a novel interface device for locomotion in virtual environment. Proceedings of VRAIS’96, pp. 60–65
Yano H, Noma H, Iwata H (2000) Tsutomu Miyasato: shared walk environment using locomotion interfaces. Proceedings of CSCW 2000:163–170
Iwata H (1999) The Torus Treadmill: realizing locomotion in VEs. IEEE Comput Graph Appl 19(6):30–35
Liu Guohua (2006) Study on human-computer interaction technology for virtual assembly of large-scale complex products. Dissertation, Harbin Institute of Technology, China
Borst CW, Indugula AP (2006) A spring model for whole-hand virtual grasping. Presence Teleoperators Virtual Environ 15(1):47–61
Yingxue Y, Pingjun X, Jiangsheng L, Jianguang L (2006) A pragmatic system to support interactive assembly planning and training in immersive virtual environment (I-VAPTS). Int J Adv Manuf Technol 30(9):959–967
Author information
Authors and Affiliations
Corresponding author
Additional information
Dr. Pingjun Xia is a research fellow at UISPA, IDMEC-Polo FEUP in Portugal. His research interests include virtual reality and haptics in industrial and medical environments.
The main contribution
There are two shortcomings for nowadays virtual assembly training systems. One is that the operators cannot move around the virtual environment in a natural way as people in real world, they are constrained in a fixed position or can only move in a limited space. The other is that most of the virtual assembly training systems are based on geometry constraint modeling only, which lack haptics feedback. This paper aims at solving these two problems.
The novel
The novel of this paper is mainly in experimental techniques. A new type haptics-based virtual environment system for assembly training of complex products is described to overcome the previous two shortcomings. A new low-cost motion simulator is designed and integrated with the virtual environment to realize free walking by human. An automatic data integration interface is developed to transfer geometry, topology, assembly, and physics information from a computer-aided design system to virtual reality application, and a hierarchical constraint-based data model is rebuilt to construct the virtual assembly environment. Physics-based modeling and haptics feedback are undertaken to simulate the realistic assembly operations.
Industrial applications
This system can be used for assembly and maintenance planning and training of complex products. The product designers and assembly engineers can use this system to plan assembly sequence and path, simulate assembly or disassembly operation, and get the realistic operation skills for actual production.
Rights and permissions
About this article
Cite this article
Xia, P., Lopes, A.M., Restivo, M.T. et al. A new type haptics-based virtual environment system for assembly training of complex products. Int J Adv Manuf Technol 58, 379–396 (2012). https://doi.org/10.1007/s00170-011-3381-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00170-011-3381-8