Supervisors: Howard Rachlin, Janet Neisewander, and Peter Killeen Address: Department of Psychology Arizona State University P.O. Box 871104 Tempe, AZ 85287-1104
... Nonetheless, whereas Page 14. 6 Perry, Stairs, and Bardo (2008) report that rats raised in is... more ... Nonetheless, whereas Page 14. 6 Perry, Stairs, and Bardo (2008) report that rats raised in isolation are more ... geometrically distributed with mean 1 × 2 s = 2 s. If a response were emitted after 3 successes, IRTs would be Erlang-distributed with mean 3 × 2 s = 6 s. Because ...
Author(s): Daniels, Carter W; Fox, Adam E; Kyonka, Elizabeth G. E.; Sanabria, Federico | Abstract... more Author(s): Daniels, Carter W; Fox, Adam E; Kyonka, Elizabeth G. E.; Sanabria, Federico | Abstract: Models of interval timing typically include a response threshold to account for temporal production. The present study sought to evaluate the dependent concurrent fixed-interval fixed-interval schedule of reinforcement as a tool for selectively isolating the response threshold in rats, pigeons, and humans. In this task, reinforcement is available either at one location after a short delay or at another location at a longer delay. Because the reinforced location is not signaled, subjects normally respond on the first location and, if reinforcement is not delivered, then switch to the second location. The latency to switch between locations served as the primary dependent measure. After training rats, pigeons, and humans with equal reinforcement magnitudes in the short and long delays, the magnitude of reinforcement was increased threefold on the long-delay location. Consistent with mode...
Weber's law--constancy of the coefficient of variation--is an apparently ubiquitous feature ... more Weber's law--constancy of the coefficient of variation--is an apparently ubiquitous feature of time perception, and forms the foundation of several theories of timing. We sought evidence for Weber's law in temporal production and categorization experiments. The production task required pigeons to switch between keys within a specified temporal window. The categorization task required them to classify a stimulus duration as either short or long. Weber fractions did not descend to a horizontal asymptote, but were U-shaped: they decreased as a function of target duration, and increased again at intermediate and long durations. This pattern conforms neither to Weber's law, nor to its generalized form (Getty, D.J., 1975. Discrimination of short temporal intervals: a comparison of two models. Percept. Psychophys. 18, 1-8). A model of counter failure accommodated the U-shaped pattern.
The peak interval (PI) procedure is commonly used to evaluate animals' ability to produce tim... more The peak interval (PI) procedure is commonly used to evaluate animals' ability to produce timed intervals. It consists of presenting fixed interval (FI) schedules in which some of the trials are replaced by extended non-reinforced trials. Responding will often resume (resurge) at the end of the non-reinforced trials unless precautions are taken to prevent it. Response resurgence was replicated in rats and pigeons. Variation of the durations of the FI and the non-reinforced probe trials showed it to be dependent on the time when reinforcement is expected. Timing of both the normal time to reinforcement, and the subsequent time to reinforcement during the probe trials followed Weber's law. A quantitative model of resurgence is described, suggesting how animals respond to the signaling properties of reinforcement omission. Model results were simulated using a stochastic binary counter.
Undermatching and overmatching in concurrent schedules of reinforcement have been traditionally d... more Undermatching and overmatching in concurrent schedules of reinforcement have been traditionally described as changes in the slope of the Generalized Matching Law function. More recently, it has been suggested that deviations from strict matching may be better described as following a policy of mostly fixing on the preferred schedule, and occasionally sampling the alternative schedule. So far, no model of local performance predicts the global outcome of this policy. We describe one such model; it assumes immediate and long-term effects of reinforcement on local performance. The model assumes long-term effects as changes in the internal state of the organism. Formally, the model is analogous to the Axiom of Repeated Choice [Lefebvre, V.A., 2004. Bipolarity, choice, and entro-field. In: Proceedings of the Eighth World Multi-Conference on Systemics, Cybernetics and Informatics, vol. IV, pp. 95-99].
The behavior systems framework suggests that motivated behavior-e.g., seeking food and mates, avo... more The behavior systems framework suggests that motivated behavior-e.g., seeking food and mates, avoiding predators-consists of sequences of actions organized within nested behavioral states. This framework has bridged behavioral ecology and experimental psychology, providing key insights into critical behavioral processes. In particular, the behavior systems framework entails a particular organization of behavior over time. The present paper examines whether such organization emerges from a generic Markov process, where the current behavioral state determines the probability distribution of subsequent behavioral states. This proposition is developed as a systematic examination of increasingly complex Markov models, seeking a computational formulation that balances adherence to the behavior systems approach, parsimony, and conformity to data. As a result of this exercise, a nonstationary partially hidden Markov model is selected as a computational formulation of the predatory subsystem. It is noted that the temporal distribution of discrete responses may further unveil the structure and parameters of the model but, without proper mathematical modeling, these discrete responses may be misleading. Opportunities for further elaboration of the proposed computational formulation are identified, including developments in its architecture, extensions to defensive and reproductive subsystems, and metho-dological refinements.
Prolonged use of nicotine appears to enhance incentive salience, a motivational-cognitive process... more Prolonged use of nicotine appears to enhance incentive salience, a motivational-cognitive process that transforms an otherwise neutral stimulus into a "wanted" stimulus. It has been suggested that nicotinic enhancement of incentive salience contributes to the potential of relapse in individuals with tobacco addiction. However, there are two main limitations of prior research that caution this claim: (a) the use of passive experimentally delivered nicotine and (b) the use of sign-tracking as an index of incentive salience, without acknowledging the competing nature of goal- and sign-tracking responses. To determine whether nicotinic enhancement of incentive salience attributed to non-nicotinic stimuli occurs when rats self-administer nicotine, and whether it is facilitated by a prior history of nicotine self-administration. Twenty-three male rats were trained daily, for 24 days, on a nicotine self-administration (SA) paradigm in the morning, and on a four-conditioned-stimul...
Journal of the experimental analysis of behavior, Jan 24, 2017
Primates take longer to choose between alternatives with smaller differences in value. This effec... more Primates take longer to choose between alternatives with smaller differences in value. This effect-a particular instance of the distance effect in symbolic comparisons-has not been replicated in birds. Instead, birds appear to respond independently to each alternative, such that the latency to choose depends primarily on the alternative of highest value. Three experiments tested for the distance effect in pigeons under conditions not previously considered. Experiment 1 presented pigeons with forced- and binary free-choice trials, where each alternative was one of three possible delays to reinforcement (4, 8, and 16 s). Pigeons were exposed to the choice stimuli for different amounts of time and with different sample response requirements prior to the choice response. Experiment 2 added a fourth (0-s delay) alternative. Experiment 3 substituted the 16-s delay with a second 4-s delay. In all experiments, pigeons systematically chose the shortest delay to reinforcement. Latency to choo...
The effect of lever height on the temporal organization of reinforced lever pressing was examined... more The effect of lever height on the temporal organization of reinforced lever pressing was examined. Lever pressing was reinforced on a variable-interval 30-s schedule in rats, with lever height manipulated across six successive conditions. Parameters of the organization of responses in bouts (bout length distribution, bout-initiation rate, within-bout rate, and sequential dependency) were estimated. These estimates revealed (1) a qualitative change in the distribution of IRTs and their sequential dependency when the lever was too high, (2) a mixture of geometrically-distributed bout lengths at all lever heights, and (3) longer bouts at lower and intermediate lever heights. In accordance with previous data, these findings suggest that lower and intermediate lever heights favored lever pressing with longer bout lengths, faster bout initiation, faster within-bout responding, and more sequentially dependent timing. These results underscore the disociability of motoric capacity in operant performance, and may reflect the influence of the body size on the temporal organization of the operant.
Attention deficit hyperactivity disorder (ADHD) is associated with increased risk of tobacco depe... more Attention deficit hyperactivity disorder (ADHD) is associated with increased risk of tobacco dependence. Nicotine, the main psychoactive component of tobacco, appears to be implicated in ADHD-related tobacco dependence. However, the behavioral responsiveness to nicotine of the prevalent animal model of ADHD, the spontaneously hypertensive rat (SHR), is currently underinvestigated. The present study examined the activational effects of acute and chronic nicotine on the behavior of adult male SHRs, relative to Wistar Kyoto (WKY) controls. Experiment 1 verified baseline strain differences in open-field locomotor activity. Experiment 2 tested for baseline strain differences in rotational behavior using a Rotorat apparatus. Adult SHR and WKY rats were then exposed to a 7-day regimen of 0.6mg/kg/d s.c. nicotine, or saline, prior to each assessment. A separate group of SHRs underwent similar training, but was pre-treated with mecamylamine, a cholinergic antagonist. Nicotine sensitization, ...
Two experiments used a spatial serial conditioning paradigm to assess the effectiveness of spatia... more Two experiments used a spatial serial conditioning paradigm to assess the effectiveness of spatially informative conditioned stimuli in eliciting tracking behavior in pigeons. The experimental paradigm consisted of the simultaneous presentation of 2 key lights (CS2 and CTRL), followed by another key light (CS1), followed by food (the unconditioned stimulus or US). CS2 and CTRL were presented in 2 of 3 possible locations, randomly assigned; CS1 was always presented in the same location as CS2. CS2 was designed to signal the spatial, but not the temporal locus of CS1; CS1 signaled the temporal locus of the US. In experiment 1, differential pecking on CS2 was observed even when CS2 was present throughout the interval between consecutive presentations of CS1, but only in a minority of pigeons; prevalence of differential pecking was enhanced when CS2 duration was halved. A control condition verified that pecking on CS2 was not due to temporal proximity between CS2 and US. Experiment 2 demonstrated the reversibility of spatial conditioning between CS2 and CTRL. Asymptotic performance never involved tracking CTRL more than CS2 for any of 16 pigeons. It is inferred that pigeons learned the spatial association between CS2 and CS1, and that temporal contingency facilitated its expression as tracking behavior.
Journal of the experimental analysis of behavior, 2015
Response bouts are clusters of responses that occur in rapid succession and are punctuated by pau... more Response bouts are clusters of responses that occur in rapid succession and are punctuated by pauses during which the response does not occur. Under variable interval schedules of reinforcement, the number of responses in each bout (the bout length) varies among bouts. This experiment was aimed at determining whether the relative rate of reinforcement influenced the relative frequency of bouts of different lengths. Lever pressing in rats was reinforced under a tandem variable time (VT) 150-s fixed ratio (FR) X, where X could be 1 or 5 and varied randomly after each reinforcer. Two conditions were included: majority FR1 (mFR1) and majority FR5 (mFR5). In mFR1, 75% of reinforcers had a tandem FR requirement of 1 and 25% had a tandem FR requirement of 5; this distribution was reversed in mFR5. The dynamic bi-exponential refractory model of response bouts was fitted to the interresponse times (IRTs) in each condition. Model parameter estimates and IRTs were then used to simulate probabl...
... Nonetheless, whereas Page 14. 6 Perry, Stairs, and Bardo (2008) report that rats raised in is... more ... Nonetheless, whereas Page 14. 6 Perry, Stairs, and Bardo (2008) report that rats raised in isolation are more ... geometrically distributed with mean 1 × 2 s = 2 s. If a response were emitted after 3 successes, IRTs would be Erlang-distributed with mean 3 × 2 s = 6 s. Because ...
Author(s): Daniels, Carter W; Fox, Adam E; Kyonka, Elizabeth G. E.; Sanabria, Federico | Abstract... more Author(s): Daniels, Carter W; Fox, Adam E; Kyonka, Elizabeth G. E.; Sanabria, Federico | Abstract: Models of interval timing typically include a response threshold to account for temporal production. The present study sought to evaluate the dependent concurrent fixed-interval fixed-interval schedule of reinforcement as a tool for selectively isolating the response threshold in rats, pigeons, and humans. In this task, reinforcement is available either at one location after a short delay or at another location at a longer delay. Because the reinforced location is not signaled, subjects normally respond on the first location and, if reinforcement is not delivered, then switch to the second location. The latency to switch between locations served as the primary dependent measure. After training rats, pigeons, and humans with equal reinforcement magnitudes in the short and long delays, the magnitude of reinforcement was increased threefold on the long-delay location. Consistent with mode...
Weber's law--constancy of the coefficient of variation--is an apparently ubiquitous feature ... more Weber's law--constancy of the coefficient of variation--is an apparently ubiquitous feature of time perception, and forms the foundation of several theories of timing. We sought evidence for Weber's law in temporal production and categorization experiments. The production task required pigeons to switch between keys within a specified temporal window. The categorization task required them to classify a stimulus duration as either short or long. Weber fractions did not descend to a horizontal asymptote, but were U-shaped: they decreased as a function of target duration, and increased again at intermediate and long durations. This pattern conforms neither to Weber's law, nor to its generalized form (Getty, D.J., 1975. Discrimination of short temporal intervals: a comparison of two models. Percept. Psychophys. 18, 1-8). A model of counter failure accommodated the U-shaped pattern.
The peak interval (PI) procedure is commonly used to evaluate animals' ability to produce tim... more The peak interval (PI) procedure is commonly used to evaluate animals' ability to produce timed intervals. It consists of presenting fixed interval (FI) schedules in which some of the trials are replaced by extended non-reinforced trials. Responding will often resume (resurge) at the end of the non-reinforced trials unless precautions are taken to prevent it. Response resurgence was replicated in rats and pigeons. Variation of the durations of the FI and the non-reinforced probe trials showed it to be dependent on the time when reinforcement is expected. Timing of both the normal time to reinforcement, and the subsequent time to reinforcement during the probe trials followed Weber's law. A quantitative model of resurgence is described, suggesting how animals respond to the signaling properties of reinforcement omission. Model results were simulated using a stochastic binary counter.
Undermatching and overmatching in concurrent schedules of reinforcement have been traditionally d... more Undermatching and overmatching in concurrent schedules of reinforcement have been traditionally described as changes in the slope of the Generalized Matching Law function. More recently, it has been suggested that deviations from strict matching may be better described as following a policy of mostly fixing on the preferred schedule, and occasionally sampling the alternative schedule. So far, no model of local performance predicts the global outcome of this policy. We describe one such model; it assumes immediate and long-term effects of reinforcement on local performance. The model assumes long-term effects as changes in the internal state of the organism. Formally, the model is analogous to the Axiom of Repeated Choice [Lefebvre, V.A., 2004. Bipolarity, choice, and entro-field. In: Proceedings of the Eighth World Multi-Conference on Systemics, Cybernetics and Informatics, vol. IV, pp. 95-99].
The behavior systems framework suggests that motivated behavior-e.g., seeking food and mates, avo... more The behavior systems framework suggests that motivated behavior-e.g., seeking food and mates, avoiding predators-consists of sequences of actions organized within nested behavioral states. This framework has bridged behavioral ecology and experimental psychology, providing key insights into critical behavioral processes. In particular, the behavior systems framework entails a particular organization of behavior over time. The present paper examines whether such organization emerges from a generic Markov process, where the current behavioral state determines the probability distribution of subsequent behavioral states. This proposition is developed as a systematic examination of increasingly complex Markov models, seeking a computational formulation that balances adherence to the behavior systems approach, parsimony, and conformity to data. As a result of this exercise, a nonstationary partially hidden Markov model is selected as a computational formulation of the predatory subsystem. It is noted that the temporal distribution of discrete responses may further unveil the structure and parameters of the model but, without proper mathematical modeling, these discrete responses may be misleading. Opportunities for further elaboration of the proposed computational formulation are identified, including developments in its architecture, extensions to defensive and reproductive subsystems, and metho-dological refinements.
Prolonged use of nicotine appears to enhance incentive salience, a motivational-cognitive process... more Prolonged use of nicotine appears to enhance incentive salience, a motivational-cognitive process that transforms an otherwise neutral stimulus into a "wanted" stimulus. It has been suggested that nicotinic enhancement of incentive salience contributes to the potential of relapse in individuals with tobacco addiction. However, there are two main limitations of prior research that caution this claim: (a) the use of passive experimentally delivered nicotine and (b) the use of sign-tracking as an index of incentive salience, without acknowledging the competing nature of goal- and sign-tracking responses. To determine whether nicotinic enhancement of incentive salience attributed to non-nicotinic stimuli occurs when rats self-administer nicotine, and whether it is facilitated by a prior history of nicotine self-administration. Twenty-three male rats were trained daily, for 24 days, on a nicotine self-administration (SA) paradigm in the morning, and on a four-conditioned-stimul...
Journal of the experimental analysis of behavior, Jan 24, 2017
Primates take longer to choose between alternatives with smaller differences in value. This effec... more Primates take longer to choose between alternatives with smaller differences in value. This effect-a particular instance of the distance effect in symbolic comparisons-has not been replicated in birds. Instead, birds appear to respond independently to each alternative, such that the latency to choose depends primarily on the alternative of highest value. Three experiments tested for the distance effect in pigeons under conditions not previously considered. Experiment 1 presented pigeons with forced- and binary free-choice trials, where each alternative was one of three possible delays to reinforcement (4, 8, and 16 s). Pigeons were exposed to the choice stimuli for different amounts of time and with different sample response requirements prior to the choice response. Experiment 2 added a fourth (0-s delay) alternative. Experiment 3 substituted the 16-s delay with a second 4-s delay. In all experiments, pigeons systematically chose the shortest delay to reinforcement. Latency to choo...
The effect of lever height on the temporal organization of reinforced lever pressing was examined... more The effect of lever height on the temporal organization of reinforced lever pressing was examined. Lever pressing was reinforced on a variable-interval 30-s schedule in rats, with lever height manipulated across six successive conditions. Parameters of the organization of responses in bouts (bout length distribution, bout-initiation rate, within-bout rate, and sequential dependency) were estimated. These estimates revealed (1) a qualitative change in the distribution of IRTs and their sequential dependency when the lever was too high, (2) a mixture of geometrically-distributed bout lengths at all lever heights, and (3) longer bouts at lower and intermediate lever heights. In accordance with previous data, these findings suggest that lower and intermediate lever heights favored lever pressing with longer bout lengths, faster bout initiation, faster within-bout responding, and more sequentially dependent timing. These results underscore the disociability of motoric capacity in operant performance, and may reflect the influence of the body size on the temporal organization of the operant.
Attention deficit hyperactivity disorder (ADHD) is associated with increased risk of tobacco depe... more Attention deficit hyperactivity disorder (ADHD) is associated with increased risk of tobacco dependence. Nicotine, the main psychoactive component of tobacco, appears to be implicated in ADHD-related tobacco dependence. However, the behavioral responsiveness to nicotine of the prevalent animal model of ADHD, the spontaneously hypertensive rat (SHR), is currently underinvestigated. The present study examined the activational effects of acute and chronic nicotine on the behavior of adult male SHRs, relative to Wistar Kyoto (WKY) controls. Experiment 1 verified baseline strain differences in open-field locomotor activity. Experiment 2 tested for baseline strain differences in rotational behavior using a Rotorat apparatus. Adult SHR and WKY rats were then exposed to a 7-day regimen of 0.6mg/kg/d s.c. nicotine, or saline, prior to each assessment. A separate group of SHRs underwent similar training, but was pre-treated with mecamylamine, a cholinergic antagonist. Nicotine sensitization, ...
Two experiments used a spatial serial conditioning paradigm to assess the effectiveness of spatia... more Two experiments used a spatial serial conditioning paradigm to assess the effectiveness of spatially informative conditioned stimuli in eliciting tracking behavior in pigeons. The experimental paradigm consisted of the simultaneous presentation of 2 key lights (CS2 and CTRL), followed by another key light (CS1), followed by food (the unconditioned stimulus or US). CS2 and CTRL were presented in 2 of 3 possible locations, randomly assigned; CS1 was always presented in the same location as CS2. CS2 was designed to signal the spatial, but not the temporal locus of CS1; CS1 signaled the temporal locus of the US. In experiment 1, differential pecking on CS2 was observed even when CS2 was present throughout the interval between consecutive presentations of CS1, but only in a minority of pigeons; prevalence of differential pecking was enhanced when CS2 duration was halved. A control condition verified that pecking on CS2 was not due to temporal proximity between CS2 and US. Experiment 2 demonstrated the reversibility of spatial conditioning between CS2 and CTRL. Asymptotic performance never involved tracking CTRL more than CS2 for any of 16 pigeons. It is inferred that pigeons learned the spatial association between CS2 and CS1, and that temporal contingency facilitated its expression as tracking behavior.
Journal of the experimental analysis of behavior, 2015
Response bouts are clusters of responses that occur in rapid succession and are punctuated by pau... more Response bouts are clusters of responses that occur in rapid succession and are punctuated by pauses during which the response does not occur. Under variable interval schedules of reinforcement, the number of responses in each bout (the bout length) varies among bouts. This experiment was aimed at determining whether the relative rate of reinforcement influenced the relative frequency of bouts of different lengths. Lever pressing in rats was reinforced under a tandem variable time (VT) 150-s fixed ratio (FR) X, where X could be 1 or 5 and varied randomly after each reinforcer. Two conditions were included: majority FR1 (mFR1) and majority FR5 (mFR5). In mFR1, 75% of reinforcers had a tandem FR requirement of 1 and 25% had a tandem FR requirement of 5; this distribution was reversed in mFR5. The dynamic bi-exponential refractory model of response bouts was fitted to the interresponse times (IRTs) in each condition. Model parameter estimates and IRTs were then used to simulate probabl...
Uploads