Abstract
With the development of the virtual reality technology, users can perform interactive assembly tasks by direct manipulation in virtual environment. However, most of the current studies mainly focus on the function of virtual assembly system without fully considering the interaction efficiency and user experience. As a result, users usually feel depressed in performing complex assembly tasks. A novel framework for interactive assembly task simulation is proposed to address this problem in this paper. The framework is implemented from three aspects: (1) the interaction information related to the assembly operations is integrated into virtual environment; (2) the user’s intentions are captured according to the gestures and movements of users and the integrated interaction information of components assembled; and (3) the interaction behaviors of components intelligently and automatically are simulated in accordance with the user’s intentions. According to the analysis of the assembly process, dynamic and static interaction behaviors are designed. The object’s dynamic behavior containing a series of standard actions is used to assist users in performing interaction tasks. The user completes an assembly task by establishing the connection relationship between objects, which can be implemented based on the object’s static interaction behavior. A virtual assembly task is constructed to evaluate the performance of the method, and the results of usability test confirm that the method proposed in this paper can improve the efficiency of human-computer interaction and user experience in a virtual assembly environment.
Article PDF
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
References
Leu MC, Maraghy HA, Nee AYC, Ong SK, Lanzetta M, Putz M, Zhu WJ, Bernard A (2013) CAD model based virtual assembly simulation, planning and training. CIRP Ann Manuf Technol 2:799–822. doi:10.1016/j.cirp.2013.05.005
Wang QH, Li JR, Wu BL (2010) Live parametric design modifications in CAD-linked virtual environment. Int J Adv Manuf Technol 50:859–869. doi:10.1007/s00170-010-2575-9
Wang QH, Li JR, Gong HQ (2006) A CAD-linked virtual assembly environment. Int J Prod Res 44:467–486. doi:10.1080/00207540500319294
Chandrasegaran SK, Ramani K, Sriram RD, Horváth I, Bernard A, Harik RF, Gao W (2013) The evolution, challenges, and future of knowledge representation in product design systems. Comput Aided Des 45:204–228. doi:10.1016/j.cad.2012.08.006
Xia P, Lopes AM, Restivo MT, Yao Y (2012) A new type haptics-based virtual environment system for assembly training of complex products. Int J Adv Manuf Technol 58:379–396. doi:10.1007/s00170-011-3381-8
Li DX, Wang CG, Bi ZM, Yu JP (2012) AutoAssem: an automated assembly planning system for complex products. IEEE Trans Ind Inf 8(3):669–678. doi:10.1109/TII.2012.2188901
Yang Q, Wu DL, Zhu HM, Bao JS, Wei ZH (2013) Assembly operation process planning by mapping a virtual assembly simulation to real operation. Comput Ind 64:869–879. doi:10.1016/j.compind.2013.06.001
Jayaram S, Jayaram U, Wang Y, Tirumali H, Lyons K, Hart P (1999) VADE: a virtual assembly design environment. IEEE Comput Graph Appl 19:44–50. doi:10.1109/38.799739
Jayaram S, Vance J, Gadh R, Jayaram U, Srinivasan H (2001) Assessment of VR technology and its applications to engineering problems. J Comput Inf Sci Eng 1(1):72–83. doi:10.1115/1.1353846
Tan JR, Liu ZY, Zhang SY (2001) Intelligent assembly modeling based on semantics knowledge in virtual environment. Computer Supported Cooperative Work in Design, The Sixth International Conference: 568-571. doi:10.1109/CSCWD.2001.942326
Liu ZY, Tan JR (2007) Constrained behavior manipulation for interactive assembly in a virtual environment. Int J Adv Manuf Technol 32:797–810. doi:10.1007/s00170-005-0382-5
de Sa G, Zachmann G (1999) Virtual reality as a tool for verification of assembly and maintenance processes. Comput Graph 23:389–403. doi:10.1016/S0097-8493(99)00047-3
Chryssolouris G, Mavrikios D, Fragos D (2000) A virtual reality-based experimentation environment for the verification of human-related factor in assembly processes. Robot Comput Integr Manuf 16:267–276. doi:10.1016/S0736-5845(00)00013-2
Mingxian F, Fernando T, Dew PM (1993) Direct 3D manipulation techniques for interactive constraint-based solid modelling. European Association for Computer Graphics 14th Annual Conference and Exhibition. EUROGRAPHICS ’93. Comput Graphics Forum 12(3):237–248. doi:10.1111/1467-8659.1230237
Marcelino L, Murray N, Fernando T (2003) A constraint manager to support virtual maintainability. Comput Graph 27(1):19–26. doi:10.1016/S0097-8493(02)00228-5
Xu ZJ, Zhang J, Li Y (2013) Product modeling framework based on interaction feature pair. Comput Aided Des 4:1591–1603. doi:10.1016/j.cad.2013.08.002
Kallmann M, Thalmann D (2002) Modeling behaviors of interactive objects for real-time virtual environments. J Vis Lang Comput 13(2):177–195. doi:10.1006/jvlc.2001.0229
Stanney K (1995) Realizing the full potential of virtual reality: human factors issues that could stand in the way. Virtual Reality Annual International Symposium, Proceedings. 28-34. doi:10.1109/VRAIS.1995.512476
Thomas CG (1993) Design, implementation and evaluation of an adaptive user interface. Knowl-Based Syst 6(4):230–238. doi:10.1016/0950-7051(93)90014-K
Maria R, George D, Nicolas T, Alex R, Emmanuel G (2004) A user-centered approach on combining realism and interactivity in virtual environments. Proceedings of the 2004 Virtual Reality (VR’04): 251–252. doi:10.1109/VR.2004.1310094
Wikipedia. the free encyclopedia. http://en.wikipedia.org/wiki/Interaction. Accessed 14 April 2015
Han XX, Wan HG (2010) A framework for virtual hand haptic interaction. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Transactions on Edutainment IV, Springer Berlin Heidelber, p 229–240
Xiong W, Wang QH, Zhang CZ (2011) A hybrid interaction method with virtual hand. Adv Mater Res 311–313:1539–1545. doi:10.4028/www.scientific.net/AMR
Cutkosky MR (1989) On grasp choice, grasp models, and the design of hands for manufacturing tasks. IEEE Trans Rob Autom 5(3):269–279
Lu G, Shark LK, Hall G, Zeshan U (2012) Immersive manipulation of virtual objects through glove-based hand gesture interaction. Virtual Reality 16(3):243–252. doi:10.1007/s10055-011-0195-9
Shneiderman B (2003) Why not make interfaces better than 3D reality. IEEE Comput Graph Appl 23(6):12–15. doi:10.1109/MCG.2003.1242376
Joseph FHJ, Bill B, Barry B, Rolph EA (2006) Multivariate data analysis, 6th edn. Prentice Hall, NJ
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Xiong, W., Wang, QH., Huang, ZD. et al. A framework for interactive assembly task simulationin virtual environment. Int J Adv Manuf Technol 85, 955–969 (2016). https://doi.org/10.1007/s00170-015-7976-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00170-015-7976-3