Recent work in reinforcement learning has demonstrated a choice preference for an option that has a lower probability of reward (A) when paired with an alternative option that has a higher probability of reward (C), if A has been experienced more frequently than C (the frequency effect). This finding is critical as it is inconsistent with…

Sometimes we should persist to succeed. But other times it might be wiser to give up on the task at hand and focus our energy on something new. Knowing whether a task is worth the effort potentially requires multiple capacities, including sensitivity to one's own likelihood to succeed on the current problem, the associated costs with continuing to…

In everyday life, people encounter smaller rewards with higher probability than larger rewards. Do people expect this reward--probability regularity to hold in experimental settings? To answer this question, we tested whether people's behavior in probability judgment tasks is affected by the correlation between reward size and reward…

Attention allocation determines the information that is encoded into memory. Can participants learn to optimally allocate attention based on what types of information are most likely to change? The current study examined whether participants could incidentally learn that changes to either high spatial frequency (HSF) or low spatial frequency (LSF)…

Children have a powerful ability to track probabilistic information, but there are also situations in which young learners simply follow what another person says or does at the cost of obtaining rewards. This latter phenomenon, sometimes termed bias to trust in testimony, has primarily been studied in children preschool-age and younger, presumably…

Individuals track probabilities, such as associations between events in their environments, but less is known about the degree to which experience--within a learning session and over development--influences people's use of incoming probabilistic information to guide behavior in real time. In two experiments, children (4-11 years) and adults…

Learning to choose adaptively when faced with uncertain and variable outcomes is a central challenge for decision makers. This study examines repeated choice in dynamic probability learning tasks in which outcome probabilities changed either as a function of the choices participants made or independently of those choices. This presence/absence of…

Background: Like adults, children need to allocate study time and endeavour optimally in order to enhance learning effectiveness. Aims: The aim of this study was to investigate the development of shifting from habitual to agenda-based processes on study decisions. Sample: The participants were 309 children in the second, fourth, and sixth grades.…

People discount the value of delayed and uncertain outcomes, and how steeply individuals discount is thought to reflect how impulsive they are. From this perspective, steep discounting of delayed outcomes (which fails to maximize long-term welfare) and shallow discounting of probabilistic outcomes (which fails to adequately take risk into account)…

The value of an outcome is affected both by the delay until its receipt (delay discounting) and by the likelihood of its receipt (probability discounting). Despite being well-described by the same hyperboloid function, delay and probability discounting involve fundamentally different processes, as revealed, for example, by the differential effects…

Reinforcement learning approaches to cognitive modeling represent task acquisition as learning to choose the sequence of steps that accomplishes the task while maximizing a reward. However, an apparently unrecognized problem for modelers is choosing when, what, and how much to reward; that is, when (the moment: end of trial, subtask, or some other…

The purpose of this review is to introduce the reader to the concepts of delay and probability discounting as well as the major empirical findings to emerge from research with humans on these concepts. First, we review a seminal discounting study by Rachlin, Raineri, and Cross (1991) as well as an influential extension of this study by Madden,…

In this dissertation research, we argue that spatial alarms and activity-based social networks are two fundamentally new types of information and influence diffusion channels. Such new channels have the potential of enriching our professional experiences and our personal life quality in many unprecedented ways. First, we develop an activity driven…

The present study with college students examined the effect of amount on the discounting of probabilistic monetary rewards. A hyperboloid function accurately described the discounting of hypothetical rewards ranging in amount from $20 to $10,000,000. The degree of discounting increased continuously with amount of probabilistic reward. This effect…

Intrinsic persistent spiking mechanisms in medial entorhinal cortex (mEC) neurons may play a role in active maintenance of working memory. However, electrophysiological studies of rat mEC units have primarily focused on spatial modulation. We sought evidence of differential spike rates in the mEC in rats trained on a T-maze, cued spatial delayed…