We typically slow down after committing an error, an effect termed post-error slowing (PES). Trad... more We typically slow down after committing an error, an effect termed post-error slowing (PES). Traditionally, PES has been calculated by subtracting post-correct from post-error RTs. Dutilh et al. (Journal of Mathematical Psychology, 56(3), 208-216, 2012), however, showed PES values calculated in this way are potentially biased. Therefore, they proposed to compute robust PES scores by subtracting pre-error RTs from post-error RTs. Based on data from a large-scale study using the flanker task, we show that both traditional and robust PES estimates can be biased. The source of the bias are differential imbalances in the percentage of congruent vs. incongruent post-correct, pre-error, and post-error trials. Specifically, we found that post-correct, pre-error, and post-error trials were more likely to be congruent than incongruent, with the size of the imbalance depending on the trial type as well as the length of the response-stimulus interval (RSI). In our study, for trials preceded by ...
Optimal decision-making employs short-term rewards and abstract long-term information based on wh... more Optimal decision-making employs short-term rewards and abstract long-term information based on which of these is deemed relevant. Employing short- vs. long-term information is associated with different learning mechanisms, yet neural evidence showing that these two are dissociable is lacking. Here we demonstrate that long-term, inference-based beliefs are biased by short-term reward experiences and that dissociable brain regions facilitate both types of learning. Long-term inferences are associated with dorsal striatal and frontopolar cortex activity, while short-term rewards engage the ventral striatum. Stronger concurrent representation of reward signals by mediodorsal striatum and frontopolar cortex correlates with less biased, more optimal individual long-term inference. Moreover, dynamic modulation of activity in a cortical cognitive control network and the medial striatum is associated with trial-by-trial control of biases in belief updating. This suggests that counteracting t...
Sexual dimorphisms have been observed in many species, including humans, and extend to the preval... more Sexual dimorphisms have been observed in many species, including humans, and extend to the prevalence and presentation of important mental disorders associated with performance monitoring malfunctions. However, precisely which underlying differences between genders contribute to the alterations observed in psychiatric diseases is unknown. Here, we compare behavioural and neural correlates of cognitive control functions in 438 female and 436 male participants performing a flanker task while EEG was recorded. We found that males showed stronger performance-monitoring-related EEG amplitude modulations which were employed to predict subjects' genders with ~72% accuracy. Females showed more post-error slowing, but both samples did not differ in regard to response-conflict processing and coupling between the error-related negativity (ERN) and consecutive behavioural slowing. Furthermore, we found that the ERN predicted consecutive behavioural slowing within subjects, whereas its overa...
The Journal of neuroscience : the official journal of the Society for Neuroscience, Jan 9, 2015
Variations in the fat mass and obesity-associated (FTO) gene are linked to obesity. However, the ... more Variations in the fat mass and obesity-associated (FTO) gene are linked to obesity. However, the underlying neurobiological mechanisms by which these genetic variants influence obesity, behavior, and brain are unknown. Given that Fto regulates D2/3R signaling in mice, we tested in humans whether variants in FTO would interact with a variant in the ANKK1 gene, which alters D2R signaling and is also associated with obesity. In a behavioral and fMRI study, we demonstrate that gene variants of FTO affect dopamine (D2)-dependent midbrain brain responses to reward learning and behavioral responses associated with learning from negative outcome in humans. Furthermore, dynamic causal modeling confirmed that FTO variants modulate the connectivity in a basic reward circuit of meso-striato-prefrontal regions, suggesting a mechanism by which genetic predisposition alters reward processing not only in obesity, but also in other disorders with altered D2R-dependent impulse control, such as addict...
The Journal of neuroscience : the official journal of the Society for Neuroscience, Jan 27, 2015
Serotonin (5-HT) has been hypothesized to be implicated in performance monitoring by promoting be... more Serotonin (5-HT) has been hypothesized to be implicated in performance monitoring by promoting behavioral inhibition in the face of aversive events. However, it is unclear whether this is restricted to external (punishment) or includes internal (response errors) events. The aim of the current study was to test whether higher 5-HT levels instigate inhibition specifically in the face of errors, measured as post-error slowing (PES), and whether this is represented in electrophysiological correlates of error processing, namely error-related negativity (ERN) and positivity. Therefore, from a large sample of human subjects (n = 878), two extreme groups were formed regarding hypothesized high and low 5-HT transporter (5-HTT) expression based on 5-HTTLPR and two additional single nucleotide polymorphisms (rs25531, rs25532). Seventeen higher (LL) and 15 lower (SS) expressing Caucasian subjects were administered the selective serotonin reuptake inhibitor (SSRI) citalopram (10 mg) intravenousl...
The Journal of neuroscience : the official journal of the Society for Neuroscience, Jan 24, 2014
The firing pattern of midbrain dopamine (DA) neurons is well known to reflect reward prediction e... more The firing pattern of midbrain dopamine (DA) neurons is well known to reflect reward prediction errors (PEs), the difference between obtained and expected rewards. The PE is thought to be a crucial signal for instrumental learning, and interference with DA transmission impairs learning. Phasic increases of DA neuron firing during positive PEs are driven by activation of NMDA receptors, whereas phasic suppression of firing during negative PEs is likely mediated by inputs from the lateral habenula. We aimed to determine the contribution of DA D2-class and NMDA receptors to appetitively and aversively motivated reinforcement learning. Healthy human volunteers were scanned with functional magnetic resonance imaging while they performed an instrumental learning task under the influence of either the DA D2 receptor antagonist amisulpride (400 mg), the NMDA receptor antagonist memantine (20 mg), or placebo. Participants quickly learned to select ("approach") rewarding and to reje...
Humans flexibly weight incoming evidence when updating beliefs and adjusting behavior. In the cur... more Humans flexibly weight incoming evidence when updating beliefs and adjusting behavior. In the current issue of Neuron, McGuire et al. (2014) show how distinct neuronal correlates of main factors underlying this weighting converge on a common mechanism driving belief updates.
Successful goal-directed behavior requires not only correct action selection, planning, and execu... more Successful goal-directed behavior requires not only correct action selection, planning, and execution but also the ability to flexibly adapt behavior when performance problems occur or the environment changes. A prerequisite for determining the necessity, type, and magnitude of adjustments is to continuously monitor the course and outcome of one's actions. Feedback-control loops correcting deviations from intended states constitute a basic functional principle of adaptation at all levels of the nervous system. Here, we review the neurophysiology of evaluating action course and outcome with respect to their valence, i.e., reward and punishment, and initiating short- and long-term adaptations, learning, and decisions. Based on studies in humans and other mammals, we outline the physiological principles of performance monitoring and subsequent cognitive, motivational, autonomic, and behavioral adaptation and link them to the underlying neuroanatomy, neurochemistry, psychological th...
We typically slow down after committing an error, an effect termed post-error slowing (PES). Trad... more We typically slow down after committing an error, an effect termed post-error slowing (PES). Traditionally, PES has been calculated by subtracting post-correct from post-error RTs. Dutilh et al. (Journal of Mathematical Psychology, 56(3), 208-216, 2012), however, showed PES values calculated in this way are potentially biased. Therefore, they proposed to compute robust PES scores by subtracting pre-error RTs from post-error RTs. Based on data from a large-scale study using the flanker task, we show that both traditional and robust PES estimates can be biased. The source of the bias are differential imbalances in the percentage of congruent vs. incongruent post-correct, pre-error, and post-error trials. Specifically, we found that post-correct, pre-error, and post-error trials were more likely to be congruent than incongruent, with the size of the imbalance depending on the trial type as well as the length of the response-stimulus interval (RSI). In our study, for trials preceded by ...
Optimal decision-making employs short-term rewards and abstract long-term information based on wh... more Optimal decision-making employs short-term rewards and abstract long-term information based on which of these is deemed relevant. Employing short- vs. long-term information is associated with different learning mechanisms, yet neural evidence showing that these two are dissociable is lacking. Here we demonstrate that long-term, inference-based beliefs are biased by short-term reward experiences and that dissociable brain regions facilitate both types of learning. Long-term inferences are associated with dorsal striatal and frontopolar cortex activity, while short-term rewards engage the ventral striatum. Stronger concurrent representation of reward signals by mediodorsal striatum and frontopolar cortex correlates with less biased, more optimal individual long-term inference. Moreover, dynamic modulation of activity in a cortical cognitive control network and the medial striatum is associated with trial-by-trial control of biases in belief updating. This suggests that counteracting t...
Sexual dimorphisms have been observed in many species, including humans, and extend to the preval... more Sexual dimorphisms have been observed in many species, including humans, and extend to the prevalence and presentation of important mental disorders associated with performance monitoring malfunctions. However, precisely which underlying differences between genders contribute to the alterations observed in psychiatric diseases is unknown. Here, we compare behavioural and neural correlates of cognitive control functions in 438 female and 436 male participants performing a flanker task while EEG was recorded. We found that males showed stronger performance-monitoring-related EEG amplitude modulations which were employed to predict subjects' genders with ~72% accuracy. Females showed more post-error slowing, but both samples did not differ in regard to response-conflict processing and coupling between the error-related negativity (ERN) and consecutive behavioural slowing. Furthermore, we found that the ERN predicted consecutive behavioural slowing within subjects, whereas its overa...
The Journal of neuroscience : the official journal of the Society for Neuroscience, Jan 9, 2015
Variations in the fat mass and obesity-associated (FTO) gene are linked to obesity. However, the ... more Variations in the fat mass and obesity-associated (FTO) gene are linked to obesity. However, the underlying neurobiological mechanisms by which these genetic variants influence obesity, behavior, and brain are unknown. Given that Fto regulates D2/3R signaling in mice, we tested in humans whether variants in FTO would interact with a variant in the ANKK1 gene, which alters D2R signaling and is also associated with obesity. In a behavioral and fMRI study, we demonstrate that gene variants of FTO affect dopamine (D2)-dependent midbrain brain responses to reward learning and behavioral responses associated with learning from negative outcome in humans. Furthermore, dynamic causal modeling confirmed that FTO variants modulate the connectivity in a basic reward circuit of meso-striato-prefrontal regions, suggesting a mechanism by which genetic predisposition alters reward processing not only in obesity, but also in other disorders with altered D2R-dependent impulse control, such as addict...
The Journal of neuroscience : the official journal of the Society for Neuroscience, Jan 27, 2015
Serotonin (5-HT) has been hypothesized to be implicated in performance monitoring by promoting be... more Serotonin (5-HT) has been hypothesized to be implicated in performance monitoring by promoting behavioral inhibition in the face of aversive events. However, it is unclear whether this is restricted to external (punishment) or includes internal (response errors) events. The aim of the current study was to test whether higher 5-HT levels instigate inhibition specifically in the face of errors, measured as post-error slowing (PES), and whether this is represented in electrophysiological correlates of error processing, namely error-related negativity (ERN) and positivity. Therefore, from a large sample of human subjects (n = 878), two extreme groups were formed regarding hypothesized high and low 5-HT transporter (5-HTT) expression based on 5-HTTLPR and two additional single nucleotide polymorphisms (rs25531, rs25532). Seventeen higher (LL) and 15 lower (SS) expressing Caucasian subjects were administered the selective serotonin reuptake inhibitor (SSRI) citalopram (10 mg) intravenousl...
The Journal of neuroscience : the official journal of the Society for Neuroscience, Jan 24, 2014
The firing pattern of midbrain dopamine (DA) neurons is well known to reflect reward prediction e... more The firing pattern of midbrain dopamine (DA) neurons is well known to reflect reward prediction errors (PEs), the difference between obtained and expected rewards. The PE is thought to be a crucial signal for instrumental learning, and interference with DA transmission impairs learning. Phasic increases of DA neuron firing during positive PEs are driven by activation of NMDA receptors, whereas phasic suppression of firing during negative PEs is likely mediated by inputs from the lateral habenula. We aimed to determine the contribution of DA D2-class and NMDA receptors to appetitively and aversively motivated reinforcement learning. Healthy human volunteers were scanned with functional magnetic resonance imaging while they performed an instrumental learning task under the influence of either the DA D2 receptor antagonist amisulpride (400 mg), the NMDA receptor antagonist memantine (20 mg), or placebo. Participants quickly learned to select ("approach") rewarding and to reje...
Humans flexibly weight incoming evidence when updating beliefs and adjusting behavior. In the cur... more Humans flexibly weight incoming evidence when updating beliefs and adjusting behavior. In the current issue of Neuron, McGuire et al. (2014) show how distinct neuronal correlates of main factors underlying this weighting converge on a common mechanism driving belief updates.
Successful goal-directed behavior requires not only correct action selection, planning, and execu... more Successful goal-directed behavior requires not only correct action selection, planning, and execution but also the ability to flexibly adapt behavior when performance problems occur or the environment changes. A prerequisite for determining the necessity, type, and magnitude of adjustments is to continuously monitor the course and outcome of one's actions. Feedback-control loops correcting deviations from intended states constitute a basic functional principle of adaptation at all levels of the nervous system. Here, we review the neurophysiology of evaluating action course and outcome with respect to their valence, i.e., reward and punishment, and initiating short- and long-term adaptations, learning, and decisions. Based on studies in humans and other mammals, we outline the physiological principles of performance monitoring and subsequent cognitive, motivational, autonomic, and behavioral adaptation and link them to the underlying neuroanatomy, neurochemistry, psychological th...
Uploads
Papers by Markus Ullsperger