Characterization of Anesthetists' Behavior During Simulation Training: Performance Versus Stress Achieving Medical Tasks With or Without Physical Effort
Characterization of Anesthetists' Behavior During Simulation Training: Performance Versus Stress Achieving Medical Tasks With or Without Physical Effort
Characterization of Anesthetists' Behavior During Simulation Training: Performance Versus Stress Achieving Medical Tasks With or Without Physical Effort
Geeraerts
and Laetitia Rouillac
Characterization of anesthetists’ behavior
during simulation training: performance
versus stress achieving medical tasks with
or without physical effort
Article (Published version)
Refereed
Original citation:
Fauquet-Alekhine, Philippe, Geeraerts, Th. and Rouillac, Laetitia (2014) Characterization of
anesthetists’ behavior during simulation training: performance versus stress achieving medical
tasks with or without physical effort. Psychology and Social Behavior Research, 2 (2). pp. 20-28.
DOI: 10.12966/psbr.06.01.2014
Reuse of this item is permitted through licensing under the Creative Commons:
LSE has developed LSE Research Online so that users may access research output of the
School. Copyright © and Moral Rights for the papers on this site are retained by the individual
authors and/or other copyright owners. You may freely distribute the URL
(http://eprints.lse.ac.uk) of the LSE Research Online website.
Sciknow Publications Ltd. PSBR 2014 2(2):20-28
Psychology and Social Behavior Research DOI: 10.12966/psbr.06.01.2014
©Attribution 3.0 Unported (CC BY 3.0)
Abstract - Decades of research about stress have shown that it could be source of performance but also of cognitive deficit. The
studies have led to highlight occupational stress variables that researchers have characterized by physiological measurements,
data treatments and protocols becoming more and more complex with time. If these devices are gaining in precision, they are
now too complex to allow non-specialist users to produce a quick interpretation of results. Yet for vocational training,
specifically on simulators, trainers need to know in real time whether or not what they implement allows the trainees to learn in
good conditions, i.e. by favoring the behavior produced by the positive effect of stress on performance. The present paper
addresses the performance versus occupational stress during training sessions of anesthetists on simulator. We studied the
performance and stress with or without physical effort using a simple protocol based on the use of basic heart parameters in order
to obtain a quasi-instantaneous interpretation of the data. We identified cognitive deficit zone during training according to the
Yerkes & Dodson (1908) relationship between performance and stress. We showed that performance versus stress during
simulation training with or without physical efforts could be successfully analyzed for immediate assessment of stress
influencing performance. Suggestions have been made for improving training sessions and avoid trainees’ behavior induced by
cognitive deficit. Limits of the protocol are exposed.
Keywords - Performance, Stress, Simulation
This questionnaire has been scientifically tested by several specialization, observed on full scale simulator.
(see for example Brunet et al., 2001), including in its French Students were involved in a one day training session in
form (see Jehel et al., 2005 and 2006). It presents the operating theatre, and training was performed the whole week
advantage, compared to the STAI, to include items such as the (5 days). It means one different group of about 6 students was
frustration or guilt not to do more, the shame, the fear for received every day. At the end of the week, 27 French
one’s safety or for others, which are important parameters students were trained, playing different role depending on the
concerning the job. It includes also the subject’s feelings scenario.
concerning physiological parameters (sweating, shaking, Four different scenarii were used per day (less than one
pounding heart). The problem for this questionnaire is that it hour each), and 3 students were training together per scenario,
is linked with the diagnosis of posttraumatic stress disorder each scenario (about 30 min) followed by a debriefing session
(PTSD) which requires that a subject has high levels of (30 to 45 minutes).
distress during or after the traumatic event. We shall see The participants of the simulated situation for a scenario
thereafter that it can be a drawback when the subject is were:
submitted to a too low level of stress. - 3 students playing the role of physician, nurse, and
help,
2.2. Physiological measurements during training - 1 physician trainer, playing the surgeon,
On the contrary of sophisticated metrologies and elaborated - 1 physician trainer piloting the simulator.
software which need, thereafter, a careful data examination to This implied that the number of cases available depended
be sure of the conclusions (Montano et al., 2009; Rohleder et on the students who were involved in the situations and on the
al., 2009; Schubert et al. 2009; Bailon et al., 2010; De role they played. At the end of the week, the sample of
Jonckheere et al., 2010; Jo et al., 2013), we aimed at a simple subjects concerning the actor physicians was (N=18; 50%
solution based on heart rate. male), and the sample of subjects concerning the actor nurses
Heart rate (HR) has been measured using a Polar FS2c was (N=18; 44.4% male).
composed of two parts. The first one is a detector with two Deontology has been presented during each introduction
electrodes to be put on the breath, touching the skin, close to of the Stress-test or training sessions with the subjects. First of
the heart. The second one is a monitor which looks like a all, all subjects were volunteers. It was explained that all data
watch which can be worn on the wrist. The screen shows the would be used for research, anonymously, and that no access
mean value of the measured heart rate. The whole device is to personal data or to the links between data and identity
worn by the subject and at the end of the test, values of the would be given to anyone. A specific form was filled up and
mean heart rate and of the maximum are given. The technical co-signed by the subject and the researcher each time.
specifications are: Concerning physiological parameters, it was only
- accuracy of time measurement: better than 2.0 s / measured for the student playing the physician’s role: heart
24 h rate was recorded by the Polar monitor described above, and
- accuracy of heart rate measurement: 1% or 1bpm, gave mean and max values at the end of the session.
whichever larger During the simulated situation, the other students watched
- measuring range : 15-240 bpm a video projection of the simulation in another room, together
It has been found (Fauquet-Alekhine et al, 2011 & 2012) with the researcher and other physician trainers. In this room,
that, to have pertinent heart parameters concerning stress, we a large size screen and an audio device allowed to watch and
could use a mean value and a maximum value of HR. We thus hear what was going on in the operating theatre.
chose to use the basic parameters which are the mean heart The general pedagogical goal was to put students in a
rate (HRmean) and maximum heart frequency (HRmax) to simulated situation pertinent to their future job where they
characterize the subjects’ state of stress, keeping in mind that need to make diagnosis, take decision and act to deal with the
both parameters increase with stress intensity in the case of critical case.
the short term occupational stress. The scenarii were clinical cases involving only one
In addition, samples of salivary amylase were taken from dysfunction (no cumulative cases).
each subject involved in the anesthetist’s training just before The 4 scenarii were:
and just after being involved in the simulated situation. The - Asphyxia related to post-operative cervical
aim was to analyze the evolution rate (not discussed in this hematoma,
paper). - Local Anesthetics intoxication,
- Peroperative third degree auriculoventricular block,
2.3. Subjects sample, training context and pedagogical - Peroperative respiratory arrest related to injection of
goals myorelaxant drug.
All the presented experiments have been conducted with and For further details about scenario contexts, see Geeraerts
within a hospital university of Paris district. The subjects for et al. (2013).
this application were French students, all residents in
Anesthesiology and Intensive Care in their third year of
Psychology and Social Behavior Research (2014) 20-28 23
2.4. Performance evaluation and link with stress for a short mental occupational stress (Fauquet-Alekhine et al.,
Results presented in a previous work (Fauquet-Alekhine 2011). The determination coefficient of polynomial fitted
et al., 2011 and 2012) demonstrated that a Yerkes & Dodson curve is R2 = 0.69.
curves could be fitted for performance concerned with short Using the concept of Human Functional States (HFS)
mental occupational stress. In this previous work, suggested by Leonova (2009), we divided the bell curve into
experiments were carried out with healthy subjects (N=18; 50% three main Human Functional States (Fauquet-Alekhine,
male), about 25-35 yo., same academic background and the 2012):
same kind of job, taking a Stress-test made up of 12 simple - the left part is linked to a HFS of positive state of
questions. A 100% success could be expected for all of the stress or stable cognitive state, where performance
subjects taking the test but we can see that it was not the case: rises with the stress,
a modal analysis of the performance coefficient Kp (Fig. 1) - the central part reflects a HFS of transience (transient
has shown that there was a range over which values spread. state) for the subject in terms of stress effects, where
The range was yet narrow. performance has raised with stress until a given
threshold beyond which the variation is inverted,
- the right part concerns a HFS of negative state of
stress or potential cognitive deficit state, where stress
tends to put the subject in a cognitive deficit state,
reducing the subject’s capacity to fully use his/her
cognitive resource and making performance
decreasing.
These HFS are drawn on the graph presented in Fig. 3.
the symptoms, perform the etiologic diagnosis, take the 3.3. Performance measurement
symptomatic corrective measures, and take the etiologic To evaluate performance of the students, we used time
corrective measures. The selected times for performance measurements concerning the reach of the final result:
assessment were thus defined: - Time to perform the symptomatic corrective
- Time to perform the symptomatic corrective measures: tsc.
measures: tsc. - Time to perform the etiologic corrective measures:
- Time to perform the etiologic corrective measures: tec.
tec. From these two parameters evaluated on the basis of
The length of time taken to identify of the symptoms or analysis of video records of the sessions, we could build a
perform the etiologic diagnosis were not selected because we performance coefficient Kp. It was based on the following
observed that, in case of low performance, the delay between remarks induced by the basic postulate that performance is
decision and action could be very long. linked with the right result (the problem is correctly solved) in
the minimum of time.
From this postulate, we suggested that a relevant Kp
3. Results decreases if time of observation or action increases: the
3.1. Quantitative data from measurements students are less efficient if they take more time to deal with
the problem.
Two kinds of data were available for actor physicians only:
The formulation is thus:
- Mean and maximum heart rates.
- Kp increase with inverse of time corrections tsc and
- Evolution rate of salivary amylase (not discussed in
tec.
this paper).
From this postulate, we built the coefficient as the sum of
A previous analysis (Geeraerst et al, 2013) showed that
the inverse of tsc and tec:
data had to be considered separately: on one hand, trainees
Kp = 1/tsc + 1/tec
involved in a significant physical effort and on the other hand
The Kp has been tested on simulated data with good
for other trainees. If we considered in the whole set of data all
agreement to expectation. The analysis of Kp with a limit
cases of subjects, the resulting cluster could not be explained
approach confirmed the reliability of the Kp. The modal
in terms of performance versus stress: the data did not show
distribution of Kp for anesthetists’ training sessions is
any specific shape, the bell curve did not appear and no other
presented on Fig. 4 according to the following modes:
specific shape as well.
[-inf; 0,001[, [0,001; 0,0075[, [0,0075; 0,01[, [0,01; 0,015[,
Two subjects did cardiac massage which induces a [0,015; 0,02[, [0,02; 0,025[, [0,025; 0,03 [, [0,03; +inf[
significant physical effort and a disturbance of HR. Others We can see that the range over which values spread is
implicated in the first scenario were confronted with a larger than for the Stress-test (Fig. 2). This is due to the fact
difficult intubation case. This also involved significant that for the Stress-test, subjects were expected to reach a 100%
physical efforts as we have observed in situation. The data score as the questions of the test were easy, while for these
related to these cases were treated separately from the others. training sessions, subjects discover the situation within an
The comparison of the HR values have shown that HR mean initial training and so are not expected to get a result tending
covered the same range of values for both cases (with and to 100% success.
without significant physical effort), and that HR max ampl
covered a narrower range of values in the case of significant
physical effort.
coefficient Ksr gave a distribution of points of Yerkes & deficit zone on a Kp vs Ksr graph of Yerkes & Dodson type
Dodson curve type (Fig.5) and led to the following curve (see Fig. 5 and 6), on the right side of the bell graph,
conclusions: most of the students were actually in the both for work activities with or without significant physical
cognitive deficit state according to the Human Functional efforts.
States (HFS) defined above (Fig. 3). After analyzing the context of training on the basis of
training sessions debriefing with trainees, the conclusions
were that residents needed to be more familiar with the
simulator and with the activity before being involved in this
kind of working situations. Thus the main point of
improvement would be to make them familiarized with the
simulator before the training session itself, with a progressive
approach of the simulator in several steps distributed on
several days, including the familiarization with observers
whilst working on simulator.
Another point of improvement according to the debriefing
interviews was that trainees had to be able to perceive their
knowledge and skills sufficient for the task in the perspective
of increasing self-confidence: this implies to create or manage
differently the previous steps of their training.
Fig. 5. Performance coefficient Kp versus reduced stress
coefficient Ksr for anesthetist residents not submitted to strong 4.2. Influence of experienced simulation
physical efforts. Furthermore, another interesting point appeared. Checking
the cases of students who had already been involved in at least
3.5. The case of anesthetists’ training with physical efforts
one simulation training before taking the present experimental
Considering only the students concerned by occupational session, data showed for both cases (concerned or not by a
stress including a significant physical effort, we plotted the Kp significant physical effort) less stress for these students than
versus Ksr. We obtained the following graph Fig. 6. for the students who discovered the simulator. This confirmed
previous analysis (Geeraerst et al., 2013) which pointed out
that this kind of experience influences stress but not
performance of the trainees. Thus, it demonstrated that a
progressive training would be benefic and that being used
with this stress variable may reduce its influence as a stressful
contributor.
the subjects could produce these special shapes of teams on simulators, then it might contribute to explain the
curves but we could not find any bias. higher values of Kp for the WPE cases than for the NPE cases.
- The WPE and NPE curves went along the same From the physiological standpoint, the relaxing effect of
decreasing values in the HFS of potential cognitive endorphins (released into blood while physical efforts)
deficit which means that in this zone, the relationship modifying HR values has been rejected because this effect
between performance and stress did not depend on occurs several tens of minutes after the beginning of the effort.
the subject’s involvement in a significant physical In our cases, the simulated situations were too short.
effort within this HFS. Another explanation may be suggested regarding
- The extreme value of Kp of the curves were related to performance. As the possible bias due to subjects’ training
different values of Ksr; this corresponds to two experience was eliminated, the higher performance for
different thresholds of optimized stress state. It subjects submitted to a significant physical effort (physical
appeared that for the WPE curve, this threshold stress) might be explained according to the following
occured sooner in terms of stress than for the NPE hypothesis: facing the emergency of an action that will save
curve. It could be seen as a drawback, but at the same the patient (cardiac massage or strong intubation), the subject
time the HFS were larger, offering thus a larger range was forced to make a decision faster that in the other cases.
of values of Ksr for which performance grew up. The subject had less time to think about different questions, to
doubt. The decision was therefore made earlier and increased
0,035
thus the performance coefficient.
0,03
NPE
0,025
0,02
WPE 5. Conclusions
Kp
Benhamou, D. (2013). Physiological and psychological stress induced arterial blood pressure and anxiety-related behavior.
by a simulation course in anaesthesia residents (accepted in Simulation Psychoneuroendocrinology, 27, 549-561.
in Healthcare). Montano, N., Porta, A, Cogliati, Ch., Costantino, G., Tobaldini, E., Rabello
Hancock, P. A., Szalma, J. L., & Weaver, J. L. (2002). The distortion of Casali, K., & Iellamo, F. (2009). Heart rate variability explored in the
perceptual space-time understress. DoD Multidisciplinary Research frequency domain: A tool to investigate the link between heart and
Program: MURI Operator Performance Under Stress(OPUS), White behavior. Neuroscience and Biobehavioral Reviews, 33, 71-80.
Paper. Müller, M., Hänsel,M., Fichtner, A., Hardt, F., Weber, S., Kirschbaum, C.,
Jehel, L., Brunet, A., Paterniti, S., & Guelfi, J. (2005). Validation de la Rüder, S., Walcher, F., Koch, T., & Eich, Ch. (2009). Excellence in
version française de l’inventaire de détresse péritraumatique. Can J performance and stress reduction during two different full scale
Psychiatry, 50(1), 67-71. simulator training courses: A pilot study. Resuscitation. In Press.
Jehel, L., Paterniti, S., Brunet, A., Louville, P., & Guelfi, J. (2006). Palmer, S., Cooper, C., & Thomas, K. (2003). Revised model of
L’intensité de la détresse péritraumatique prédit la survenue des organisational stress for use within stress prevention/management and
symptômes post-traumatiques parmi des victimes d’agressions. wellbeing programmes – brief update. International Journal of Health
L’Encéphale, 1(32), 953-956. Promotion and Education. 41(2), 57-58.
Jo, N. Y., Lee, K. C., & Lee, D. S. (2013). Computer-Mediated Task Pearsall, M. J., Ellis, A. P. J., & Stein, J. H. (2009). Coping with challenge
Performance Under Stress and Non-stress Conditions: Emphasis on and hindrance stressors in teams: Behavioral, cognitive, and affective
Physiological Approaches. Digital Creativity, 32, 15-27. outcomes. Organizational Behavior and Human Decision Processes,
Judge, T. A., Ilies, R., & Zhang, Z. ( 2012). Genetic influences on core 109, 18-28.
self-evaluations, job satisfaction, and work stress: A behavioral Rohleder, N., & Nater, U. (2009). Determinants of salivary a-amylase in
genetics mediated model. Organizational Behavior and Human humans and methodological considerations.
Decision Processes, 117, 208-220. Psychoneuroendocrinology, 34, 469-485.
Karasek R. A., & Theorell R. (1990). Healthy work, Stress, Productivity and Schubert, C., Lambertz, M., Nelesen, R. A., Bardwell, W., Choi, J. B., &
the Reconstruction of Working Life, the Free Press. Basic books: New Dimsdale, J. E. (2009). Effects of stress on heart rate complexity—A
York. comparison between short-term and chronic stress. Biological
Keitel, A., Ringle, M., Schwartges, I., Weik, U., Picker, O., Stockhorst, U., & Psychology, 80, 325-332.
Deinzer, R. (2011). Endocrine and psychological stress responses in a Spielberger, C. D. (1983). Manual for the State-Trait Anxiety Inventory.
simulated emergency situation. Psychoneuroendocrinology, 36, Consulting Psychologist Press Inc., Palo Alto, California.
98-108. Staal, M. (2004). Stress, Cognition, and Human Performance: A Literature
Kilminster, S., & Bridger, R. S. (2007). Modified work and Well-Being Review and Conceptual Framework. NASA report, reference:
Questionnaire for Cohort Study of Stress in the Naval Service: NASA/TM—2004–212824.
Psychometric Validation. Unpublished MoD Report. Steptoe, A. (2000). Stress, social support and cardiovascular activity over the
Leonova, A. B. (2009). The concept of human functional state in Russian working day. International Journal of Psychophysiology, 37, 299-308.
applied psychology. Psychology in Russia: State of the Art, 517-538. Yerkes, R. M., & Dodson, J. D. (1908). The relation of strength of stimulus to
McLean, A. (1974). Concepts of occupational stress, in A. McLean (eds) rapidity of habit-formation. Journal of Comparative Neurology and
Occupational Stress, (pp. 3-14). Springfield, Illinois: Thomas. Psychology, 18, 459-482.
Maslova, L. N. , Bulygina,V. V. , & Markel, A. L. (2002). Chronic stress
during prepubertal development: immediate and long-lasting effects on