Abstract
The concept of using robots for reducing human effort is now a buzzword since the last decade. Now, with the advancement of the current technologies the robots could be remotely controlled with much greater ease and precision than before in domains, where we could have never even thought of their applications. The paper describes a new user friendly interface which allows the control of the robot manipulator (hand) in the most effective and simplest manner possible. By making use of 360° camera the vision is created which is displayed on the user’s mobile phone (which is placed inside a VR-goggles) and viewed as a virtual reality environment by the user. The user and the robot manipulator are situated far apart and the user will feel like as if the robotic arms are his own arms. Moreover, the user can control the robotic arm placed remotely in any high risk area with or without any internet connectivity. This methodology is very useful for controlling the robotic arm for dealing with radioactive and hazardous materials. Therefore, the user doesn’t have to be in the place of risk and he/she is still able to operate in the most convenient manner. In this paper, a detailed description of the control of the open-source 3D printed robotic hand/forearm from InMoov is discussed. Basically, the InMoov hand/forearm is modified into a useable all-purpose dexterous hand with the application of Virtual Reality to enhance user ease. There are two modes in which the system could be used. First is the hand mimicking mode, in which the user’s hand movements are being replicated onto the robotic hand/forearm, and the second mode is the voice recognition mode in which simple voice commands from the user are processed and are used to control the robotic arm. Voice recognition enables hands free usage of the robotic hand for people with disability. The system makes use of ROS (Robot Operating System) as its baseline program management system. The development is done by making use of ROS catkin workspace on Raspberry Pi 3 with Ubuntu Mate with the implementation of the necessary packages and nodes for every functionality.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Ding, X.: Humanoid Robot Technology. Science Press (2011)
Ogawara, K., Takamatsu, J., Kimura, H., et al.: Generation of a task model by integrating multiple observations of human demonstrations along time series. J. Inf. Process. Soc. Jpn. Comput. Vis. Image Media 43,117–126 (2002)
Calinon, S.: Robot Programming by Demonstration. Springer, Berlin Heidelberg (2008)
Natonek, E., Flückiger, L., Zimmerman, T., Baur, C.: Virtual reality: an intuitive approach to robotics. In: SPIE Telemanipulator and Telepresence Technologies, vol. 2351, pp. 260–269, Boston, Oct–Nov 1994
Piguet, L., Fong, T., Hine, B., Hontalas, P., Nygren, E.: VEVI: a virtual reality tool for robotic planetary explorations. Virtual Reality World, vol. pp. 263–274, Stuttgart, Germany, February 1995
Hine, B., Hontalas, P., Fong, T., Piguet, L., Nygren, E., Kline, A.:VEVI: a virtual environment teleoperation interface for planetary explorations. In: SAE 25th International Conference on Environmental Systems, San Diego, CA, July 1995
Acknowledgements
The authors would like to thank Makerspace, New York University to provide support and resources to carry out our research and experiments.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Suresh, A., Gaba, D., Bhambri, S., Laha, D. (2019). Intelligent Multi-fingered Dexterous Hand Using Virtual Reality (VR) and Robot Operating System (ROS). In: Kim, JH., et al. Robot Intelligence Technology and Applications 5. RiTA 2017. Advances in Intelligent Systems and Computing, vol 751. Springer, Cham. https://doi.org/10.1007/978-3-319-78452-6_37
Download citation
DOI: https://doi.org/10.1007/978-3-319-78452-6_37
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-78451-9
Online ISBN: 978-3-319-78452-6
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)