Abstract
In AAL context the increasing demand to new developments in healthcare technologies poses inevitability to the thought of easing the patient monitoring in a non-invasive manner, even with commercial and low cost digital cameras as reliable devices that can be employed to measure vital signs. A widely diffused method for contactless heart rate estimation is remote-photoplethysmography from facial video streams. A critical issue in this research area relates to not having always available frontal images of the subject’s face. A further critical aspect is represented by the distance from the vision sensor and by highly variable lighting conditions of the environment. In the proposed work, heart rate measurement of the observed subject was estimated through the design and implementation of a software algorithmic pipeline able to manage the aforementioned critical issues. The proposed system is able to detect faces “in the wild” without constraints and consequently improving its usability. The methodology includes data processing algorithmic steps which allow an adequate extraction of features from a ROI that includes pixels identified as facial skin and whose shape and size vary with the distance and orientation of the face. The findings of the preliminary experiments inferred promising results on three cohorts of subjects grouped by age, with a slightly higher average error expressed in terms of Root Mean Square Error for the group that includes elderly subjects, confirming that the approach considered is even suitable for contactless HR measurement of older people.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Zhao, F., Li, M., Qian, Y., Tsien, J.Z.: Remote measurements of heart and respiration rates for telemedicine. PLoS ONE 8(10), e71384 (2013)
Wang, W., den Brinker, A.C., Stuijk, S., de Haan, G.: Algorithmic principles of remote PPG. IEEE Trans. Biomed. Eng. 64(7), 1479–1491 (2016)
Rouast, P.V., Adam, M.T.P., Chiong, R., Cornforth, D., Lux, E.: Remote heart rate measurement using low-cost RGB face video: a technical literature review. Front. Comp. Sci. 12(5), 858–872 (2018). https://doi.org/10.1007/s11704-016-6243-6
Allen, J.: Photoplethysmography and its application in clinical physiological measurement. Physiol. Meas. 28(3), R1 (2007)
De Haan, G., Jeanne, V.: Robust pulse rate from chrominance-based rPPG. IEEE Trans. Biomed. Eng. 60(10), 2878–2886 (2013)
Yan, Y., Ma, X., Yao, L., Ouyang, J.: Noncontact measurement of heart rate using facial video illuminated under natural light and signal weighted analysis. Bio-Med. Mater. Eng. 26(s1), S903–S909 (2015)
Fallet, S., Moser, V., Braun, F., Vesin, J.M.: Imaging photoplethysmography: what are the best locations on the face to estimate heart rate? In: 2016 Computing in Cardiology Conference (CinC), pp. 341–344. IEEE (2016)
Cheng, J., Chen, X., Xu, L., Wang, Z.J.: Illumination variation-resistant video-based heart rate measurement using joint blind source separation and ensemble empirical mode decomposition. IEEE J. Biomed. Health Inform. 21(5), 1422–1433 (2016)
Niu, X., Han, H., Shan, S., Chen, X.: SynRhythm: learning a deep heart rate estimator from general to specific. In: 2018 24th International Conference on Pattern Recognition (ICPR), pp. 3580–3585. IEEE (2018)
Chen, W., McDuff, D.: DeepPhys: video-based physiological measurement using convolutional attention networks. In: Ferrari, V., Hebert, M., Sminchisescu, C., Weiss, Y. (eds.) ECCV 2018. LNCS, vol. 11206, pp. 356–373. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-01216-8_22
Yu, Z., Li, X., Zhao, G.: Remote photoplethysmograph signal measurement from facial videos using spatio-temporal networks. In: Proceedings of the BMVC, pp. 1–12 (2019)
Viola, P., Jones, M.J.: Robust real-time face detection. Int. J. Comput. Vision 57(2), 137–154 (2004)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
Beucher, S., Meyer, F.: The morphological approach to segmentation: the watershed transformation. Math. Morphol. Image Process. 34, 433–481 (1993)
Hyvarinen, A.: Fast and robust fixed-point algorithms for independent component analysis. IEEE Trans. Neural Netw. 10(3), 626–634 (1999)
Acknowledgment
This work has been carried out within the project PON Si-Robotics funded by MIUR-Italian Ministry for University and Research.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Caroppo, A., Leone, A., Manni, A., Siciliano, P. (2022). Vision-Based Heart Rate Monitoring in the Smart Living Domains. In: Bettelli, A., Monteriù, A., Gamberini, L. (eds) Ambient Assisted Living. ForItAAL 2020. Lecture Notes in Electrical Engineering, vol 884. Springer, Cham. https://doi.org/10.1007/978-3-031-08838-4_15
Download citation
DOI: https://doi.org/10.1007/978-3-031-08838-4_15
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-08837-7
Online ISBN: 978-3-031-08838-4
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)