Abstract
Realizing the autonomous following function of the unmanned ground vehicle is critical for its applications in the industrial, medical, and home service fields. This paper proposes a visual autonomous following unmanned ground vehicle system for indoor environments based on the ROS platform, which combines autonomous navigation and visual following technology, senses unknown environment with RGBD camera and LIDAR, detects tracking targets with the YOLOv5 algorithm, meanwhile integrates the KCF algorithm and pedestrian re-identification technology for target tracking. The unmanned vehicle system can detect user-specific gestures to start and stop, and during the tracking process, the transfer of different states is realized by a state machine, then the motion control and dynamic obstacle avoidance are implemented using simultaneous localization and mapping (SLAM) algorithm. Finally, the above process is validated using a real unmanned vehicle in the indoor environment, and the results show that the autonomous following UGV system can effectively avoid obstacles and track the target to the specified location, which verifies the availability and reliability of the system.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Islam, M.J., Hong, J., Sattar, J.: Person-following by autonomous robots: a categorical overview. Int. J. Robot. Res. 38(14), 1581–1618 (2019)
Chen, B.X., Sahdev, R., Tsotsos, J.K.: Integrating stereo vision with a CNN tracker for a person-following robot. In: Liu, M., Chen, H., Vincze, M. (eds.) ICVS 2017. LNCS, vol. 10528, pp. 300–313. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-68345-4_27
Cao, M., Wang, J., Ming, L.: Multi-templates based robust tracking for robot person-following tasks. Appl. Sci. 11(18), 8698 (2021)
Algabri, R., Choi, M.T.: Robust person following under severe indoor illumination changes for mobile robots: online color-based identification update. In: 2021 21st International Conference on Control, Automation and Systems (ICCAS), pp. 1000–1005. IEEE (2021)
Eisenbach, M., Vorndran, A., Sorge, S., Gross, H.M.: User recognition for guiding and following people with a mobile robot in a clinical environment. In: 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 3600–3607. IEEE (2015)
Chung, W., Kim, H., Yoo, Y., Moon, C.B., Park, J.: The detection and following of human legs through inductive approaches for a mobile robot with a single laser range finder. IEEE Trans. Industr. Electron. 59(8), 3156–3166 (2011)
Bae, K., Son, Y., Song, Y.E., Jung, H.: Component-wise error correction method for UWB-based localization in target-following mobile robot. Sensors 22(3), 1180 (2022)
Burke, M.G., Brink, W.: Estimating target orientation with a single camera for use in a human-following robot (2010)
Rui, Z., Zhaokui, W., Yulin, Z.: A person-following nanosatellite for in-cabin astronaut assistance: system design and deep-learning-based astronaut visual tracking implementation. Acta Astronaut. 162, 121–134 (2019)
Xue, H., Liu, Y., Cai, D., He, X.: Tracking people in RGBD videos using deep learning and motion clues. Neurocomputing 204, 70–76 (2016)
Babaee, M., Athar, A., Rigoll, G.: Multiple people tracking using hierarchical deep tracklet re-identification. arXiv preprint arXiv:1811.04091 (2018)
Algabri, R., Choi, M.T.: Target recovery for robust deep learning-based person following in mobile robots: online trajectory prediction. Appl. Sci. 11(9), 4165 (2021)
Khalfaoui, A., Badri, A., Mourabit, I.E.: Comparative study of yolov3 and yolov5’s performances for real-time person detection. In: 2022 2nd International Conference on Innovative Research in Applied Science, Engineering and Technology (IRASET), pp. 1–5. IEEE (2022)
Agrawal, K., Lal, R.: Person following mobile robot using multiplexed detection and tracking. In: Kalamkar, V.R., Monkova, K. (eds.) Advances in Mechanical Engineering. LNME, pp. 815–822. Springer, Singapore (2021). https://doi.org/10.1007/978-981-15-3639-7_98
Acknowledgements
This work was supported by National Key R &D Program of China (2019YFB1705002, 2017YFB0304100), National Natural Science Foundation of China (51634002), LiaoNing Revitalization Talents Program (XLYC2002041).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 Beijing HIWING Sci. and Tech. Info Inst
About this paper
Cite this paper
Zhao, J., Luo, X., Zhang, H., Wang, X., Wang, W. (2023). Vision Based Target Following UGV System Using YOLOv5 and ROS Platform. In: Fu, W., Gu, M., Niu, Y. (eds) Proceedings of 2022 International Conference on Autonomous Unmanned Systems (ICAUS 2022). ICAUS 2022. Lecture Notes in Electrical Engineering, vol 1010. Springer, Singapore. https://doi.org/10.1007/978-981-99-0479-2_27
Download citation
DOI: https://doi.org/10.1007/978-981-99-0479-2_27
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-99-0478-5
Online ISBN: 978-981-99-0479-2
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)