Abstract
Stress is identified as one of the most common human responses to physical, mental or emotional pressure. Long-term stress can cause cardiovascular diseases, depression, anxiety and even death. Stress can be recognized by observing physiological activity data and social media posts of individuals. This explorative study is performed to find the effect of fusion of physiological measurement with social media textual posts for classifying stress. The proposed model implements Heart Rate Variability (HRV) datasets as physiological stress datasets and social media post dataset as textual dataset. At first the datasets were individually implemented with different machine learning models to find the best fit model. It is shown that Random Forest showed the best classification result with an accuracy of 99.85% for the HRV data and the Logistic Regression model performed best for the social media data with an accuracy of 96.4%. The two models are combined using fuzzy fusion technique with an accuracy of 98%. To our knowledge, the fuzzy fusion technique for combining physiological and textual data is a novel approach for stress detection with significant applicability.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Schneiderman, N., Ironson, G., Siegel, S.D.: Stress and health: psychological, behavioral, and biological determinants. Annu. Rev. Clin. Psychol. 1, 607–628 (2005)
Palmer, S., Dryden, W., Hickey, L.: Counselling for stress problems. J. Psychosom. Res. 5(40), 553 (1996)
Aimie-Salleh, N., Malarvili, M.B., Whittaker, A.C.: Fusion of heart rate variability and salivary cortisol for stress response identification based on adverse childhood experience. Med. Biol. Eng. Comput. 57(6), 1229–1245 (2019)
Indikawati, F.I., Winiarti, S.: Stress Detection from Multimodal Wearable Sensor Data, vol. 771, p. 012028. IOP Publishing (2020)
Bobade, P., Vani, M.: Stress detection with machine learning and deep learning using multimodal physiological data. In: 2020 Second International Conference on Inventive Research in Computing Applications (ICIRCA), pp. 51–57 (2020)
Radhika, K., Oruganti, V.R.M.: Deep multimodal fusion for subject-independent stress detection. In: 2021 11th International Conference on Cloud Computing, Data Science Engineering (Confluence), pp. 105–109 (2021)
Mohan, P.M., Nagarajan, V., Das, S.R.: Stress measurement from wearable photoplethysmographic sensor using heart rate variability data. In: 2016 International Conference on Communication and Signal Processing (ICCSP), pp. 1141–1144 (2016)
Cheng, L.C., Tsai, S.L.: Deep learning for automated sentiment analysis of social media. In: Proceedings of the 2019 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, ASONAM ’19, pp. 1001–1004. Association for Computing Machinery. New York, NY, USA (2019)
Vashishtha, S., Susan, S.: Fuzzy rule based unsupervised sentiment analysis from social media posts. Expert Syst. Appl. 138, 112834 (2019)
Shaffer, F., Ginsberg, J.P.: An overview of heart rate variability metrics and norms. Front. Public Health 5, 258 (2017)
Srivastava, D., Bhambhu, L.: Data classification using support vector machine. J. Theor. Appl. Inf. Technol. 12, 1–7 (2010)
Li, B., Yu, S., Lu, Q.: An improved k-nearest neighbor algorithm for text categorization (2003)
Ali, J., Khan, R., Ahmad, N., Maqsood, I.: Random forests and decision trees. Int. J. Comput. Sci. Issues(IJCSI) 9 (2012)
Peng, J., Lee, K., Ingersoll, G.: An introduction to logistic regression analysis and reporting. J. Educ. Res. 96, 3–14 (2002)
Rish, I.: An empirical study of the naïve Bayes classifier. In: IJCAI 2001 Work Empir Methods Artif Intell, Vol. 3 (2001)
Abbas, M., Ali, K., Memon, S., Jamali, A., Memon, S., Ahmed, A.: Multinomial naive Bayes classification model for sentiment analysis (2019)
Crammer, K., Dekel, O., Keshet, J., Shalev-Shwartz, S., Singer, Y.: Online passive-aggressive algorithms. J. Mach. Learn. Res. 7, 551–585 (2006)
Chengsheng, T., Huacheng, L., Bing, X.: AdaBoost typical Algorithm and its application research. In: MATEC Web of Conferences , vol. 139, p. 00222 (2017)
Nazzal, J., El-Emary, I., Najim, S.: Multilayer Perceptron Neural Network (MLPs) for analyzing the properties of Jordan Oil Shale. World Appl. Sci. J. 5 (2008)
Raol, J.R.: Multi-Sensor Data Fusion with MATLAB. CRC Press, Boca Raton (2009)
Liu, K.: Dual-sensor approaches for real-time robust hand gesture recognition. PhD thesis (2015)
Schmidt, P., Reiss, A., Duerichen, R., Marberger, C., Van Laerhoven, K.: Introducing WESAD, a multimodal dataset for wearable stress and affect detection. In: Proceedings of the 20th ACM International Conference on Multimodal Interaction, ICMI ’18, pp. 400–408. Association for Computing Machinery. New York, NY, USA (2018)
Koldijk, S., Sappelli, M., Verberne, S., Neerincx, M.A., Kraaij, W.: The SWELL knowledge work dataset for stress and user modeling research. In: Proceedings of the 16th International Conference on Multimodal Interaction, ICMI ’14, pp. 291–298. Association for Computing Machinery. New York, NY, USA (2014)
Go, A., Bhayani, R., Huang, L.: Twitter sentiment classification using distant supervision. Processing 150 (2009)
Turcan, E., McKeown, K.: Dreaddit: a reddit dataset for stress analysis in social media, 107p (2019)
Dasarathy, B.V.: Decision fusion. IEEE Computer Society Press, Los Alamitos, Calif (1994). OCLC, p. 28332530
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Raisa, J.F., Jahan, S., Kaiser, M.S. (2022). A Cyber-Physical Fusion System for Stress Detection Using Multimodal and Social Media Data. In: Hossain, S., Hossain, M.S., Kaiser, M.S., Majumder, S.P., Ray, K. (eds) Proceedings of International Conference on Fourth Industrial Revolution and Beyond 2021 . Lecture Notes in Networks and Systems, vol 437. Springer, Singapore. https://doi.org/10.1007/978-981-19-2445-3_43
Download citation
DOI: https://doi.org/10.1007/978-981-19-2445-3_43
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-19-2444-6
Online ISBN: 978-981-19-2445-3
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)