Skip to main content

Research on Robot Human-Robot Hand-Over System Based on YOLOv5

  • Conference paper
  • First Online:
Advanced Manufacturing and Automation XII (IWAMA 2022)

Part of the book series: Lecture Notes in Electrical Engineering ((LNEE,volume 994))

Included in the following conference series:

  • 1071 Accesses

Abstract

Human-robot hand-over tasks are widely used in various scenarios and have become a research hotspot for researchers. In order to make the robot and the user perform efficient, smooth and safe delivery in the unstructured scene, this paper designs and builds a human-robot hand-over system in unstructured scenarios. First, use the Kinect camera to obtain the color and depth information in the scene, and then send the image to the trained YOLOv5 rotating target network to obtain the position and oritention of the object in the human hand, and then realize the position tracking of the object in the human hand through the proposed servo control strategy. Finally, the compliant hand-over between the human hand and the robot is achieved by impedance control in the interaction stage. Based on this system, experiments are carried out on the built human-robot hand-over platform. The experimental results show that the human-robot hand-over system proposed in this paper can deliver efficiently, safely and compliantly in unstructured scenarios.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 259.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 329.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 329.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Tasioulas, J.: First steps towards an ethics of robots and artificial intelligence. J. Pract. Ethics 7(1) (2019)

    Google Scholar 

  2. Rozo, L., Calinon, S., Caldwell, D.G., Jimenez, P., Torras, C.: Learning physical collaborative robot behaviors from human demonstrations. IEEE Trans. Robot. 32(3), 513–527 (2016)

    Article  Google Scholar 

  3. Wang, L., et al.: Symbiotic human-robot collaborative assembly. CIRP Ann. 68(2), 701–726 (2019)

    Article  Google Scholar 

  4. Chen, L.: Human-robot interaction through action learning from demonstration. Master’s thesis, Guangdong University of Technology (2018)

    Google Scholar 

  5. Gao, Z.: Robot path planning based on demonstration. Master’s thesis, Shandong University (2020)

    Google Scholar 

  6. Wang, X.: A human-to-robot object handover system based on human behavior patterns. Master’s thesis, Dalian University of Technology (2020)

    Google Scholar 

  7. Forman, G., Scholz, M.: Apples-to-apples in cross-validation studies: pitfalls in classifier performance measurement. ACM SIGKDD Explor. Newsl. 12(1), 49–57 (2010)

    Article  Google Scholar 

  8. Sokolova, M., Japkowicz, N., Szpakowicz, S.: Beyond accuracy, F-score and ROC: a family of discriminant measures for performance evaluation. In: Sattar, A., Kang, Bh. (eds.) AI 2006. LNCS (LNAI), vol. 4304, pp. 1015–1021. Springer, Heidelberg (2006). https://doi.org/10.1007/11941439_114

    Chapter  Google Scholar 

  9. Huang, L.,Wang, B., Ni, S.,Yang, J., Ni, T.: Robotic compliant control based on force sensor gravity compensation. Trans. Chin. Soc. Agric. Eng. (03), 386–393 (2020)

    Google Scholar 

Download references

Acknowledgment

This research was supported by the Key Research and Development Projects in Jilin Provincial Department of science and technology “Large Workpiece Compliant Assembly Docking Robot with Autonomous Positioning and Navigation” (Grant No. 20200401130GX).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Lingtao Huang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Zhang, H., Han, X., Ni, T., Huang, L., Liang, H. (2023). Research on Robot Human-Robot Hand-Over System Based on YOLOv5. In: Wang, Y., Yu, T., Wang, K. (eds) Advanced Manufacturing and Automation XII. IWAMA 2022. Lecture Notes in Electrical Engineering, vol 994. Springer, Singapore. https://doi.org/10.1007/978-981-19-9338-1_37

Download citation

Publish with us

Policies and ethics