While knowing what to expect is important, it is equally important to know when to expect it and to respond accordingly. This is apparent even in simple Pavlovian training situations in which animals learn to respond more strongly closer to reward delivery. Here we report that the nucleus accumbens core, an area well-positioned to represent…

We quantified the effect of first experience on behavior in operant learning and studied its underlying computational principles. To that goal, we analyzed more than 200,000 choices in a repeated-choice experiment. We found that the outcome of the first experience has a substantial and lasting effect on participants' subsequent behavior, which we…

Extinction and recovery of the discriminative stimulus effects of nicotine (0.3 mg/kg) was investigated with a devalued food reinforcer (rats sated). Sixteen rats were trained in a counterbalanced one manipulandum (nose-poke) drug discrimination procedure with the roles of nicotine and saline counterbalanced as S[superscript D] and S[superscript…

Operant extinction contingencies can undermine the discriminative stimulus effects of drugs. Here, nicotine (0.4 mg/kg) and ethanol (0.8 g/kg) first functioned as either an S[superscript D] or S[superscript Delta], in a counterbalanced one-lever go/no-go (across sessions) operant drug discrimination procedure. Pavlovian extinction in the training…

Associative conditioning in "Drosophila melanogaster" has been well documented for several decades. However, most studies report only simple associations of conditioned stimuli (CS, e.g., odor) with unconditioned stimuli (US, e.g., electric shock) to measure learning or establish memory. Here we describe a straightforward second-order conditioning…

Observational learning is an important area in the field of psychology and behavior science more generally. Given this, it is essential that behavior analysts articulate a sound theory of how behavior change occurs through observation. This paper begins with an overview of seminal research in the area of observational learning, followed by a…

Amid the novel terms and original analyses in Skinner's "Verbal Behavior", the importance of his discussion of multiple control is easily missed, but multiple control of verbal responses is the rule rather than the exception. In this paper we summarize and illustrate Skinner's analysis of multiple control and introduce the terms "convergent…

This study sought to further investigate the effects of an observational intervention for two participants on the reinforcing property of pieces of string. Pre-observational intervention data showed that the neutral stimuli (strings) did not function to reinforce two participants' responding to a performance task or learning three new skills that…