Abstract
This paper proposes head motion – based robot’s controlling system using virtual reality glasses that was implemented using various up-to date software and hardware solutions. System is consisted of robotic platform with DC motors controlled by micro controller with Wi-fi network interface. The second micro controller is used as access point and host of MJPG stereo vision camera stream. Virtual reality glasses are used to control motor by analyzing user’s head motion and to display stereo image from camera mounted in the front of the chassis. This article also introduces a user - centered head rotation system similar to yaw – pitch – roll that can be used to intuitively design functions of user interface. All source codes that were made for system implementation can be downloaded and tested.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Borowska-Terka, A., Strumiłło, P.: Algorithms for head movements’ recognition in an electronic human computer interface. Przegląd Elektrotechniczny 93(8), 131–134 (2017)
Brütsch, K., Koenig, A., Zimmerli, L., Mérillat-Koeneke, S., Riener, R., Jäncke, L., van Hedel, H.J., Meyer-Heim, A.: Virtual reality for enhancement of robot-assisted gait training in children with neurological gait disorders. J. Rehabil. Med. 43(6), 493–499 (2011)
Dornberger, R., Korkut, S., Lutz, J., Berga, J., Jäger, J.: Prototype-based research on immersive virtual reality and on self-replicating robots. In: Business Information Systems and Technology 4.0 Studies in Systems, Decision and Control, pp. 257–274 (2018). https://doi.org/10.1007/978-3-319-74322-6_17
Engel, J., Stückler, J., Cremers, D.: Large-scale direct slam with stereo cameras. In: 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 1935–1942, September 2015. https://doi.org/10.1109/IROS.2015.7353631
Grygiel, R., Bieda, R., Wojciechowski, K.: Angles from gyroscope to complementary filter in IMU. Przegląd Elektrotechniczny 90(9), 217–224 (2014)
Hachaj, T.: GitHub repository of the project (2019). https://github.com/browarsoftware/rpm_rotation_calculation. Accessed 22 Mar 2019
Kato, Y.: A remote navigation system for a simple tele-presence robot with virtual reality. In: 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 4524–4529, September 2015. https://doi.org/10.1109/IROS.2015.7354020
Kurup, P., Liu, K.: Telepresence robot with autonomous navigation and virtual reality: demo abstract. In: SenSys (2016)
Lin, L., Shi, Y., Tan, A., Bogari, M., Zhu, M., Xin, Y., Xu, H., Zhang, Y., Xie, L., Chai, G.: Mandibular angle split osteotomy based on a novel augmented reality navigation using specialized robot-assisted arms - a feasibility study. J. Cranio-Maxillofac. Surg. 44(2), 215–223 (2016). https://doi.org/10.1016/j.jcms.2015.10.024. http://www.sciencedirect.com/science/article/pii/S1010518215003674
Monferrer, A., Bonyuet, D.: Cooperative robot teleoperation through virtual reality interfaces. In: Proceedings Sixth International Conference on Information Visualisation, pp. 243–248, July 2002. https://doi.org/10.1109/IV.2002.1028783
Mur-Artal, R., Tardüs, J.D.: ORB-SLAM2: an open-source SLAM system for monocular, stereo, and RGB-D cameras. IEEE Trans. Robot. 33(5), 1255–1262 (2017). https://doi.org/10.1109/TRO.2017.2705103
Nguyen, L., Bualat, M., Edwards, L., Flueckiger, L., Neveu, C., Schwehr, K., Wagner, M., Zbinden, E.: Virtual reality interfaces for visualization and control of remote vehicles. Auton. Robots 11(1), 59–68 (2001). https://doi.org/10.1023/a:1011208212722
Regenbrecht, J., Tavakkoli, A., Loffredo, D.: A robust and intuitive 3D interface for teleoperation of autonomous robotic agents through immersive virtual reality environments. In: 2017 IEEE Symposium on 3D User Interfaces (3DUI), pp. 199–200, March 2017. https://doi.org/10.1109/3DUI.2017.7893340
Usenko, V., Engel, J., Stückler, J., Cremers, D.: Direct visual-inertial odometry with stereo cameras. In: 2016 IEEE International Conference on Robotics and Automation (ICRA), p. 1885 (2016). https://doi.org/10.1109/ICRA.2016.7487335
Wang, R., Schworer, M., Cremers, D.: Stereo DSO: large-scale direct sparse visual odometry with stereo cameras. In: IEEE International Conference on Computer Vision (ICCV), October 2017
Zinchenko, K., Komarov, O., Song, K.: Virtual reality control of a robotic camera holder for minimally invasive surgery. In: 2017 11th Asian Control Conference (ASCC), pp. 970–975, December 2017. https://doi.org/10.1109/ASCC.2017.8287302
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Hachaj, T. (2020). Head Motion – Based Robot’s Controlling System Using Virtual Reality Glasses. In: Choraś, M., Choraś, R. (eds) Image Processing and Communications. IP&C 2019. Advances in Intelligent Systems and Computing, vol 1062. Springer, Cham. https://doi.org/10.1007/978-3-030-31254-1_2
Download citation
DOI: https://doi.org/10.1007/978-3-030-31254-1_2
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-31253-4
Online ISBN: 978-3-030-31254-1
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)