Skip to main content

Digital Assembly Assistance System in Industry 4.0 Era: A Case Study with Projected Augmented Reality

  • Conference paper
  • First Online:
Advanced Manufacturing and Automation X (IWAMA 2020)

Part of the book series: Lecture Notes in Electrical Engineering ((LNEE,volume 737))

Included in the following conference series:

Abstract

Automation has increased more and more in manufacturing companies over the last decades. However, manual labor is still used in a variety of complex tasks and is currently irreplaceable, especially in assembly operations. Assisting and supporting the human worker during potentially complex assembly tasks is very relevant. Clear and easy-to-read assembly instructions, error-proofing methods, and an intuitive user interface for the worker have the potential to not only reduce the cognitive workload of the operator but also increase the productivity, improve the quality, reduce defects, and consequently reduce costs. Industry 4.0 technologies, in particular Augmented Reality and motion recognition sensors, can help companies in reaching these goals. However, there are currently only a few works that show how to implement these technologies with real case studies, especially with the Projected Augmented Reality (PAR). This is the reason why, in this paper an example of prototype of a smart workstation equipped with a Kinect-projector assistance system for manual assembly is presented.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Battaïa, O., Otto, A., Sgarbossa, F., Pesch, E.: Future trends in management and operation of assembly systems: from customized assembly systems to cyber-physical systems. Omega (U. K.) 78, 1–4 (2018)

    Article  Google Scholar 

  2. Hu, S.J., Ko, J., Weyand, L., Elmaraghy, H.A., Lien, T.K., Koren, Y., et al.: Assembly system design and operations for product variety. CIRP Ann. – Manuf. Technol. 60(2), 715–733 (2011)

    Article  Google Scholar 

  3. Zhong, Y.-G., Ai, B.: A modified ant colony optimization algorithm for multi-objective assembly line balancing. Soft Comput. 21(22), 6881–6894 (2017)

    Google Scholar 

  4. Akpinar, S., Elmi, A., Bektaş, T.: Combinatorial Benders cuts for assembly line balancing problems with setups. Eur. J. Oper. Res. 259(2), 527–537 (2017)

    Article  MathSciNet  Google Scholar 

  5. Michalos, G., Makris, S., Spiliotopoulos, J., Misios, I., Tsarouchi, P., Chryssolouris, G.: ROBO-PARTNER: seamless human-robot cooperation for intelligent, flexible and safe operations in the assembly factories of the future. Procedia CIRP [Internet] 23(C), 71–76 (2014). http://dx.doi.org/10.1016/j.procir.2014.10.079

  6. Battini, D., Calzavara, M., Otto, A., Sgarbossa, F.: Preventing ergonomic risks with integrated planning on assembly line balancing and parts feeding. Int. J. Prod. Res. [Internet] 55(24), 7452–7472. (2017). https://doi.org/10.1080/00207543.2017.1363427

  7. Joundi, J., Conradie, P., van Den Bergh, J., Saldien, J.: Understanding and exploring operator needs in mixed model assembly. CEUR Workshop Proc. 2503, 130–138 (2019)

    Google Scholar 

  8. Ong, S.K., Yuan, M.L., Nee, A.Y.C.: Augmented reality applications in manufacturing: a survey. Int. J. Prod. Res. 46(10), 2707–2742 (2008)

    Article  Google Scholar 

  9. Hou, L., Wang, X., Bernold, L., Love, P.E.D.: Using animated augmented reality to cognitively guide assembly. J. Comput. Civ. Eng. 27(5), 439–451 (2013)

    Article  Google Scholar 

  10. Watson, G., Curran, R., Butterfield, J., Craig, C.: The effect of using animated work instructions over text and static graphics when performing a small scale engineering assembly. In: Collaborative Product and Service Life Cycle Management for a Sustainable World – Proceedings of the 15th ISPE International Conferences Concurr Engineering CE 2008, vol. 44, no. 0, pp. 541–550 (2008)

    Google Scholar 

  11. Van Krevelen, D.W.F., Poelman, R.: A survey of augmented reality technologies, applications and limitations. Int. J. Virtual Real. 9(2), 1–20 (2010)

    Article  Google Scholar 

  12. Bagamaspad, A.M., Caingles, J.I., Koa, K.A., Simeon, J.L., Ruiz, C.: A mobile augmented reality-based assembly guidance application for LEGO. In: MCCSIS 2018 - Multi Conference on Computer Science and Information Systems. Proceedings of the International Conferences Interfaces Human Computer Interacting 2018, Game Entertainment Technology 2018 Computer Graph Visual Comparative 2018, pp. 237–244, July 2018

    Google Scholar 

  13. Servan, J., Mas, F., Menéndez, J.L., Ríos, J.: Assembly work instruction deployment using augmented reality. Key Eng. Mater. 502(February), 25–30 (2012)

    Article  Google Scholar 

  14. Syberfeldt, A., Danielsson, O., Holm, M., Wang, L.: Visual assembling guidance using augmented reality. Procedia Manuf. [Internet] 1, 98–109 (2015). http://dx.doi.org/10.1016/j.promfg.2015.09.068

  15. Värno, K., Mahmood, K., Otto, T., Kuts, V.: Development of a smart workstation by using ar technology. Ann. DAAAM Proc. Int. DAAAM Symp. 30(1), 1061–1067 (2019)

    Article  Google Scholar 

  16. Konig, M., Stadlmaier, M., Rusch, T., Sochor, R., Merkel, L., Braunreuther, S., et al.: MA2RA - manual assembly augmented reality assistant. In: IEEE International Conference on Industrial Engineering and Engineering Management, pp. 501–505 (2019)

    Google Scholar 

  17. Hou, L., Wang, X., Truijens, M.: Using augmented reality to facilitate piping assembly: an experiment-based evaluation. J. Comput. Civ. Eng. 29(1), 1–12 (2015)

    Article  Google Scholar 

  18. Wang, X., Ong, S.K., Nee, A.Y.C.: Multi-modal augmented-reality assembly guidance based on bare-hand interface. Adv. Eng. Inform. [Internet] 30(3), 406–421 (2016). http://dx.doi.org/10.1016/j.aei.2016.05.004

  19. Mourtzis, D., Zogopoulos, V., Xanthi, F.: Augmented reality application to support the assembly of highly customized products and to adapt to production re-scheduling. Int. J. Adv. Manuf. Technol. 105(9), 3899–3910 (2019)

    Article  Google Scholar 

  20. Radkowski, R., Herrema, J., Oliver, J.: Augmented reality-based manual assembly support with visual features for different degrees of difficulty. Int. J. Hum. Comput. Interact. [Internet] 31(5), 337–349 (2015). http://dx.doi.org/10.1080/10447318.2014.994194

  21. Lai, Z.H., Tao, W., Leu, M.C., Yin, Z.: Smart augmented reality instructional system for mechanical assembly towards worker-centered intelligent manufacturing. J. Manuf. Syst. [Internet] 55(July 2019), 69–81 (2020). https://doi.org/10.1016/j.jmsy.2020.02.010

  22. Alves, J., Marques, B., Oliveira, M., Araújo, T., Dias, P., Santos, B.S.: Comparing spatial and mobile augmented reality for guiding assembling procedures with task validation. In: 19th IEEE International Conference on Autonomous Robot Systems and Competitions ICARSC 2019 (2019)

    Google Scholar 

  23. Vanneste, P., Huang, Y., Park, J.Y., Cornillie, F., Decloedt, B., Van den Noortgate, W.: Cognitive support for assembly operations by means of augmented reality: an exploratory study. Int. J. Hum. Comput. Stud. [Internet] 143(October 2019), 102480 (2020). https://doi.org/10.1016/j.ijhcs.2020.102480

  24. Büttner, S., Sand, O., Röcker, C.: Extending the design space in industrial manufacturing through mobile projection. In: Mobile HCI 2015 - Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct, pp. 1130–1133 (2015)

    Google Scholar 

  25. Korn, O., Schmidt, A., Hörz, T.: Augmented manufacturing: a study with impaired persons on assistive systems using in-situ projection. In: ACM International Conference Proceeding Ser (2013)

    Google Scholar 

  26. Funk, M., Bächler, A., Bächler, L., Korn, O., Krieger, C., Heidenreich, T., et al.: Comparing projected in-situ feedback at the manual assembly workplace with impaired workers. In: Proceedings of the 8th ACM International Conference on PErvasive Technologies Related to Assistive Environments PETRA (2015)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Marco Simonetto .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Simonetto, M., Peron, M., Fragapane, G., Sgarbossa, F. (2021). Digital Assembly Assistance System in Industry 4.0 Era: A Case Study with Projected Augmented Reality. In: Wang, Y., Martinsen, K., Yu, T., Wang, K. (eds) Advanced Manufacturing and Automation X. IWAMA 2020. Lecture Notes in Electrical Engineering, vol 737. Springer, Singapore. https://doi.org/10.1007/978-981-33-6318-2_80

Download citation

Publish with us

Policies and ethics