Abstract
Ergonomic risk assessment is traditionally human-assisted and performed filling forms or through on-site inspection by ergonomists. This frequently leads to inaccuracies due to the subjective bias. Also, it is inefficient and costly given the time and technical knowledge required. Computer-based alternatives are slowly emerging, but so far there is few consensus or uniformity between the underlying practices and technologies. A standardization of data collection in video takes through computer vision offers the opportunity to obtain considerable replication levels, which would increase the reliability of the results and the quality of the data available to ergonomists. In this work we propose a workflow that employs two open-source neural networks: STAF for workers’ body joints detection and tracking, and VIBE for 3D movement estimation. Finally, the ergonomic risk is calculated based on REBA, which is one of the most widespread standard in industrial settings. As data collection may be a bottleneck (as usual in deep learning) we propose the use of virtual scenarios generated in Unity3D. This allows to evaluate and quantify several problems associated with actual video takes, including self-occlusions, camera positioning, illumination, noisy backgrounds, and many others. The results are positively conclusive about both the use of this workflow for actual risk assessment, and the feasibility of virtual environments for controlled experimentation.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Ben-Arie, J.: The probabilistic peaking effect of viewed angles and distances with application to 3-D object recognition. IEEE Trans. Pattern Anal. Mach. Intell. 12(8), 760–774 (1990). https://doi.org/10.1109/34.57667
Chiasson, M.è., Imbeau, D., Aubry, K., Delisle, A.: Comparing the results of eight methods used to evaluate risk factors associated with musculoskeletal disorders. Int. J. Ind. Ergon. (2012). https://doi.org/10.1016/j.ergon.2012.07.003
Cohen, A.L., Gjessing, C.C., Fine, L.J.: A Primer Based on Workplace Evaluations of Musculoskeletal Disorders. US Department of Health and Human Services, National Institute for Occupational Safety and Health, DHHS (NIOSH) Publication 110(97–117), 16–30 (1997)
Kocabas, M., Athanasiou, N., Black, M.J.: VIBE: video inference for human body pose and shape estimation. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 5253–5263 (2020). http://arxiv.org/abs/1912.05656
Massiris Fernández, M., Fernández, J.Á., Bajo, J.M., Delrieux, C.A.: Ergonomic risk assessment based on computer vision and machine learning. Comput. Ind. Eng. 149, 106,816 (2020). https://doi.org/10.1016/j.cie.2020.106816
McAtamney, L., Corlett, E.N.: RULA: a survey method for the investigation of work-related upper limb disorders. Appl. Ergon. 24(2), 91–99 (1993)
McAtamney, L., Hignett, S.: Rapid entire body assessment. Appl. Ergon. 31, 201–205 (2000). https://doi.org/10.1201/9780203489925.ch8
Nath, N.D., Akhavian, R., Behzadan, A.H.: Ergonomic analysis of construction worker’s body postures using wearable mobile sensors. Appl. Ergon. 62, 107–117 (2017). https://doi.org/10.1016/j.apergo.2017.02.007
Occhipinti, E., Colombini, D.: Updating reference values and predictive models of the OCRA method in the risk assessment of work-related musculoskeletal disorders of the upper limbs. Ergonomics 50(11), 1727–1739 (2007)
Oy, O.: OWAS (Ovako Working posture Assessment System). Finnish Institute of Occupational Health 1(June), 1–6 (2009). http://www.ttl.fi/en/ergonomics/methods/workload_exposure_methods/table_and_methods/Pages/default.aspx
Plantard, P., Auvinet, E., Le Pierres, A.S., Multon, F.: Pose estimation with a kinect for ergonomic studies: evaluation of the accuracy using a virtual mannequin. Sensors (Switzerland) 15(1), 1785–1803 (2015). https://doi.org/10.3390/s150101785
Plantard, P., Shum, H.P., Le Pierres, A.S., Multon, F.: Validation of an ergonomic assessment method using Kinect data in real workplace conditions. Appl. Ergon. 65, 562–569 (2017). https://doi.org/10.1016/j.apergo.2016.10.015. http://dx.doi.org/10.1016/j.apergo.2016.10.015
Raaj, Y., Idrees, H., Hidalgo, G., Sheikh, Y.: Efficient online multi-person 2D pose tracking with recurrent spatio-temporal affinity fields. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. June, pp. 4615–4623 (2019). https://doi.org/10.1109/CVPR.2019.00475
Roman-Liu, D.: Comparison of concepts in easy-to-use methods for MSD risk assessment. Appl. Ergon. 45(3), 420–427 (2014). https://doi.org/10.1016/j.apergo.2013.05.010. http://dx.doi.org/10.1016/j.apergo.2013.05.010
S.R.T. Argentina: Informe Anual de Accidentabilidad Laboral 2018. Technical report, Superintendencia de Riesgos del Trabajo, Buenos Aires (2018). https://www.srt.gob.ar/estadisticas/anuario/InformeAnualdeAccidentabilidadLaboral-A~no2017.pdf
Steven Moore, J., Garg, A.: The strain index: a proposed method to analyze jobs for risk of distal upper extremity disorders. Am. Ind. Hyg. Assoc. J. 56(5), 443–458 (1995)
Wang, C., Yan, X., Wang, H., Zhang, H., Li, H., Seo, J.: Development of ergonomic posture recognition technique based on 2D ordinary camera for construction hazard prevention through view-invariant features in 2D skeleton motion. Adv. Eng. Inform. (2017). https://doi.org/10.1016/j.aei.2017.11.001
Yan, X., Li, H., Wang, C., Seo, J.O., Zhang, H., Wang, H.: Development of ergonomic posture recognition technique based on 2D ordinary camera for construction hazard prevention through view-invariant features in 2D skeleton motion. Adv. Eng. Inform. 34, 152–163 (2017). https://doi.org/10.1016/j.aei.2017.11.001
Zhang, H., Yan, X., Li, H.: Ergonomic posture recognition using 3D view-invariant features from single ordinary camera. Autom. Constr. 94, 1–10 (2018). https://doi.org/10.1016/j.autcon.2018.05.033
Acknowledgments
The authors wish to express a posthumous tribute recognition to Mayor Miguel Massiris Ávila.
This research was sponsored by the Consejo Nacional de Investigaciones Científicas y Técnicas de Argentina (CONICET), the Junta de Extremadura through the European Regional Development Fund (code GR18135), and the Universidad Nacional del Sur (grant code 24/K083).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Fernández, M.M., Bajo, J., Vargas, S.M., Álvaro Fernández, J., Delrieux, C. (2023). Vision-Based Ergonomic Risk Estimation: Deep-Learning Strategies. In: Balas, V.E., Jain, L.C., Balas, M.M., Baleanu, D. (eds) Soft Computing Applications. SOFA 2020. Advances in Intelligent Systems and Computing, vol 1438. Springer, Cham. https://doi.org/10.1007/978-3-031-23636-5_46
Download citation
DOI: https://doi.org/10.1007/978-3-031-23636-5_46
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-23635-8
Online ISBN: 978-3-031-23636-5
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)