Abstract
Evaluation of stress is mainly based on standardized scales [1]. However, fill out questionnaires can be incompatible with several situations (e.g. during chirurgical intervention) [2] and offers only subjective and punctual data. Physiological measures, which provided real-time and objective data [3], can be used to cope with these constrains. To be effective, physiological data need to be related to human feeling. One solution is to build an automatic recognition system of stress based on supervised machine learning. Thereby, to acquire physiological data, we built stressful situation in laboratory. From physiological data (respiratory, cardiac and electrodermal measurement) of 24 participants, we built a model that recognizes stress with an accuracy of 70 %.
You have full access to this open access chapter, Download conference paper PDF
Similar content being viewed by others
Keywords
1 Introduction
Stress is a serious concern facing our world today. We need to develop a better and objective understanding of this concept, through the use of non-intrusive means for stress recognition, and without troubling natural human behavior. The human body undergoes several physiological changes when exposed to acute stressors. More precisely, electrodermal activities, heart rate activities, and respiration activities data are commonly used to measure short-term emotional and cognitive stress. The goal of the current study is to build an automatic recognition system of stress from physiological measures based on supervised machine learning. For this, annotated data are required [8]. For the same reason that scales are not always adapted to evaluate stress, construct an annotated database in real situation can be very complex. One solution is to build stressful situations in laboratory and collect data. We selected this solution to induce stress and to construct our annotated database. More precisely, we proposed two types of situations (stressful or not stressful) to participants and measured physiological indexes during the experiment.
1.1 Stress Measurements
To recognize stress, it is first necessary to be able to measure it. Currently, evaluation of stress is mainly based on two methods: standardized scales [1] and physiological data [e.g. 4].
Subjective Evaluations. Standardized scales are the most commonly used method to evaluate stress. Scales have several advantages: they are ease to use, free and provide rapid results. However, it can be complex under several circumstances. Thereby, asking individuals to fill scales can be incompatible with several situations (e.g. during chirurgical intervention) [2]. Moreover, per definition, data from scales are subjective and punctually acquired. To cope with these two constrains, physiological measures have been developed.
Physiological Measurements. Physiological measurements, unlike subjective measurements, can provide real-time and objective data [3]. Thereby, many studies have explored the link between physiological responses and stress. Such responses may be modifications and variability of heart rate, modifications of breathing rate, blood pressure and galvanic skin activity [5]. For example, Shi et al. [4] showed a strong correlation between stress levels and electrodermal activity (EDA). Healey et al. [6] showed a correlation between breathing rate and stress levels. Lastly, Sierra De Santos et al. [7] showed the relevance of measuring stress by measurements of electrodermal and heart activity.
2 Method
2.1 Material
In previous research, several paradigms have been used to induce stress: ranging from simple tracking tasks [9] to more complex methods like the Montreal Imaging Stress Task [10]. In our experiment, induction of stress is based on the procedure proposed by Campbell [11] to investigate the effect of time pressure on simple mathematical operations. Thereby, we created stressful situations where individuals had to carry out additions under time pressure. Two conditions were created:
-
Condition 1 – Not stressful situation: participants had to answer following a beep sound occurring 2650 ms after the calculation was presented.
-
Condition 2 – Stressful situation: participants had to answer before a beep sound and the beep occurred 900 ms after the calculation was presented.
For each experimental condition, there were 36 trials (2 conditions: 72 trials per participant). Each trial consisted of a simple mathematical sum, such as “2 + 7” or “5 + 8”.
2.2 Physiological Measurement
The following physiological indexes were measured: cardiac, respiratory and electrodermal responses. Biopac Bionomadix MP150 was used to measure physiological responses. To build our automatic recognition system of stress, we used the following indexes on physiological data: electrodermal activities (EDA), heart rate activities (ECG RR/ECG R Wave) and respiration activities (Respiratory Rate). For each index, we computed the mean and standard deviation by trial.
2.3 Subjective Measurement
After each condition, participants filled out two standardized scales to ensure of the effect of induced stress on subjective feeling. The first questionnaire is the Short Stress State Questionnaire (SSSQ) [12] that evaluates 3 aspects of the feeling of stress (Engagement, Distress and Worry). The second questionnaire is the Raw-TLX (RTLX) [13], a simplified version of the NASA Task Load Index . The RTLX assesses the perceived workload of a task as a simple sum of 6 dimensions (mental demand, physical demand, temporal demand, performance, effort, and frustration). The choice of these 2 questionnaires allows us to assess different aspects of the feeling of stress in our participants.
2.4 Participants
24 participants took part in the study and received in exchange a coupon for €15. All participants signed up with informed consent before beginning the experimental procedure and were informed about the goals of the study, procedures, cautions and ethical issues for the participation in the study.
2.5 Procedure
The following procedure was used during the experiment: before starting calculation, a baseline for physiological measurement is recorded. After, participants start calculation and all pass the 2 conditions (within-subject design). Between each condition, a break is observed to reduce stress level. To avoid order effect, the presentation of condition is counterbalanced and the presentation of the calculations is randomized.
3 Results
3.1 Induction of Stress
To ensure that induction of stress is perceived by participants, we compare the subjective evaluation between the two conditions. Comparisons of models showed significant differences (see Table 1) for all dimensions of RTLX. For SSSQ, only distress is evaluated as significantly different between conditions.
3.2 Machine Learning
Several methods of machine learning have been tested on physiological indexes: all these learnings have been conceived to be person-independent. To train the model and test the performance, the dataset was subset into a training dataset (75 %) and testing dataset (25 %). During the training, cross-validation was used and several algorithms have been tested. The Table 2 presented the comparison of this training. From these results, random forest was selected (accuracy ≈ 73.01 %). Finally, we tested the accuracy of the selected model on testing dataset with an accuracy of 70 %.
4 Discussion and Conclusion
Results indicated that machine learning algorithms offer a good framework to recognize stressful situation from physiological sensors. However, the sample is relatively small. Thus, to ensure of the reliability of our model, we need to conduct new studies on more participants. Moreover, in this study, the generation of stressful situation is only based on time pressure. It can be interesting to induce stress by imposing cognitive tasks on the individuals with the aim of exploring eventual specific physiological patterns.
In the future, this type of recognition system could be used to evaluate stress in real situation. Moreover, we planned to use this system to develop augmented Human-computer interaction (AHCI). For example, we can imagine a medical interface which is automatically adapted to the user’s stress level.
References
Nübling, M., Stößel, U., Hasselhorn, H.-M., Michaelis, M., Hofmann, F.: Measuring psychological stress and strain at work - Evaluation of the COPSOQ questionnaire in Germany. GMS Psycho-Soc. Med. 3 (2006)
Ryu, K., Myung, R.: Evaluation of mental workload with a combined measure based on physiological indices during a dual task of tracking and mental arithmetic. Int. J. Ind. Ergon. 35, 991–1009 (2005)
Rieder, R., Kristensen, C.H., Pinho, M.S.: Identifying relationships between physiological measures and evaluation metrics for 3D interaction techniques. In: Campos, P., Graham, N., Jorge, J., Nunes, N., Palanque, P., Winckler, M. (eds.) INTERACT 2011, Part III. LNCS, vol. 6948, pp. 662–679. Springer, Heidelberg (2011)
Shi, Y., Ruiz, N., Taib, R., Choi, E., Chen, F.: Galvanic Skin Response (GSR) as an index of cognitive load. In: CHI 2007 Extended Abstracts on Human Factors in Computing Systems, pp. 2651–2656. ACM, New York (2007)
Pickering, T.G., Devereux, R.B., James, G.D., Gerin, W., Landsbergis, P., Schnall, P.L., Schwartz, J.E.: Environmental influences on blood pressure and the role of job strain. J. Hypertens. Suppl. Off. J. Int. Soc. Hypertens. 14, S179–S185 (1996)
Healey, J.A., Picard, R.W.: Detecting stress during real-world driving tasks using physiological sensors. IEEE Trans. Intell. Transp. Syst. 6, 156–166 (2005)
de Santos Sierra, A., Avila, C.S., Bailador del Pozo, G., Guerra Casanova, J.: Stress detection by means of stress physiological template. In: 2011 Third World Congress on Nature and Biologically Inspired Computing (NaBIC), pp. 131–136 (2011)
Kotsiantis, S.B.: Supervised machine learning: a review of classification techniques. In: Proceedings of the 2007 Conference on Emerging Artificial Intelligence Applications in Computer Engineering: Real Word AI Systems with Applications in eHealth, HCI, Information Retrieval and Pervasive Technologies, pp. 3–24. IOS Press, Amsterdam (2007)
Rubio, S., Diaz, E., Martin, J., Puente, J.M.: Evaluation of subjective mental workload: a comparison of SWAT, NASA-TLX, and workload profile methods. Appl. Psychol. 53, 61–86 (2004)
Dedovic, K., Renwick, R., Mahani, N.K., Engert, V., Lupien, S.J., Pruessner, J.C.: The Montreal imaging stress task: using functional imaging to investigate the effects of perceiving and processing psychosocial stress in the human brain. J. Psychiatry Neurosci. 30, 319–325 (2005)
Campbell, J.I.D., Austin, S.: Effects of response time deadlines on adults’ strategy choices for simple addition. Mem. Cognit. 30, 988–994 (2002)
Helton, W.S., Naswall, K.: Short stress state questionnaire: factor structure and state change assessment. Eur. J. Psychol. Assess. 31, 20–30 (2015)
Hart, S.G., Staveland, L.E.: Development of NASA-TLX (Task Load Index): results of empirical and theoretical research. In: Hancock, P.A., Meshkati, N. (eds.) Human Mental Workload, pp. 139–183. North-Holland, Oxford (1988)
Acknowledgements
We thank all those who participated in any way in this research. This work was carried out within the Institute of Technological Research b<>com and it received support from the French government under the program Future Investments bearing reference ANR-07-A0-AIRT.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Martin, N., Diverrez, JM. (2016). From Physiological Measures to an Automatic Recognition System of Stress. In: Stephanidis, C. (eds) HCI International 2016 – Posters' Extended Abstracts. HCI 2016. Communications in Computer and Information Science, vol 618. Springer, Cham. https://doi.org/10.1007/978-3-319-40542-1_27
Download citation
DOI: https://doi.org/10.1007/978-3-319-40542-1_27
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-40541-4
Online ISBN: 978-3-319-40542-1
eBook Packages: Computer ScienceComputer Science (R0)