The value of an outcome is affected both by the delay until its receipt (delay discounting) and by the likelihood of its receipt (probability discounting). Despite being well-described by the same hyperboloid function, delay and probability discounting involve fundamentally different processes, as revealed, for example, by the differential effects…

Reinforcement learning approaches to cognitive modeling represent task acquisition as learning to choose the sequence of steps that accomplishes the task while maximizing a reward. However, an apparently unrecognized problem for modelers is choosing when, what, and how much to reward; that is, when (the moment: end of trial, subtask, or some other…

In this dissertation research, we argue that spatial alarms and activity-based social networks are two fundamentally new types of information and influence diffusion channels. Such new channels have the potential of enriching our professional experiences and our personal life quality in many unprecedented ways. First, we develop an activity driven…

Multiple cue probability learning studies have typically focused on stationary environments. We present 3 experiments investigating learning in changing environments. A fine-grained analysis of the learning dynamics shows that participants were responsive to both abrupt and gradual changes in cue-outcome relations. We found no evidence that…

The drift-diffusion model (DDM) implements an optimal decision procedure for stationary, 2-alternative forced-choice tasks. The height of a decision threshold applied to accumulating information on each trial determines a speed-accuracy tradeoff (SAT) for the DDM, thereby accounting for a ubiquitous feature of human performance in speeded response…

Reinforcement learning theories postulate that actions are chosen to maximize a long-term sum of positive outcomes based on value functions, which are subjective estimates of future rewards. In simple reinforcement learning algorithms, value functions are updated only by trial-and-error, whereas they are updated according to the decision-maker's…

Initiation of drug use and other risky behavior in preadolescence is associated with poor developmental outcomes. In this research, we examine models that ascribe the trajectory to (a) weak executive cognitive function (ECF), (b) early manifestation of externalizing problems, or (c) heightened levels of trait impulsivity. We test the explanatory…

This study focused on the processes occurring during the waiting period in delay of gratification situations. Sixty-four middle class preschool children chose between waiting for a preferred item and receiving a less desired item immediately. The items were of different classes, i. e., one food and one toy, and subjects waited with one, both, or…

This paper reports on a study conducted to clarify issues involving reward effects in children's probability learning; specifically, the detrimental-effects-of-reward theory, and the utility and expectancy theories. Five event schedules in which the probabilistic versus partial reinforcement dimension was separated from the number of choices in…