This paper presents the concepts and observations in the author's keynote address at the May 2019 "Opportunity versus Challenge: Exploring Usage of Log-File and Process Data in International Large-Scale Assessments" conference in Dublin, Ireland. This paper recaps briefly some key points that emerged at the December 2018 ETS symposium on…

Construct validity and building validity arguments are some of the main challenges facing the language assessment community. The notion of construct validity and validity arguments arose from research in psychological assessment and developed into the gold standard of validation/validity research in language assessment. At a theoretical level,…

This paper updates a review of dynamic assessment in education by the first author, published in this journal in 2003. It notes that the original review failed to examine the important conceptual distinction between dynamic testing (DT) and dynamic assessment (DA). While both approaches seek to link assessment and intervention, the former is of…

School systems across the country are transitioning from paper-based testing (PBT) to computer-based testing (CBT). As this technological shift occurs, more research is necessary to understand the practical and performance implications of administering CBTs. Currently, there is a paucity of research using CBTs to examine working memory (WM)…

The present work proposes an integrative model of creativity that includes personality traits and cognitive processes. This model hypothesizes that three high-order personality factors predict two main process factors, which in turn predict intensity and achievement of creative activities. The personality factors are: "Plasticity" (high…

Tacit knowledge, that is knowledge not expressible in words, may play a role in learning science, yet it is difficult to study directly. Intuition and insight, two processes that link the tacit and the explicit, are proposed as a route to investigating tacit knowledge. Intuitions are defined as tacit hunches or feelings that influence thought with…

As a result of the upcoming Federal reauthorization of the Individuals With Disabilities Education Improvement Act (IDEA), practitioners and researchers have begun vigorously debating what constitutes evidence-based assessment for the identification of specific learning disability (SLD). This debate has resulted in strong support for a method that…

Effects of culture-specific experience on musical rhythm perception are evident by 12 months of age, but the role of culture-general rhythm processing constraints during early infancy has not been explored. Using a habituation procedure with 5- and 7-month-old infants, we investigated effects of temporal interval ratio complexity on discrimination…

In quantity discrimination tasks, adults, infants and animals have been sometimes observed to process number only after all continuous variables, such as area or density, have been controlled for. This has been taken as evidence that processing number may be more cognitively demanding than processing continuous variables. We tested this hypothesis…

Rule finding is an important aspect of human reasoning and flexibility. Previous studies associated rule finding "failure" with past experience with the test stimuli and stable personality traits. We additionally show that rule finding performance is severely impaired by a mindset associated with applying an instructed rule. The mindset was…

Conceptual metaphor theory suggests that knowledge is structured around metaphorical mappings derived from physical experience. Segregated processing of object properties in sensory cortex allows testing of the hypothesis that metaphor processing recruits activity in domain-specific sensory cortex. Using functional magnetic resonance imaging…

The current study explored the elaborative retrieval hypothesis as an explanation for the testing effect: the tendency for a memory test to enhance retention more than restudying. In particular, the retrieval process during testing may activate elaborative information related to the target response, thereby increasing the chances that activation…

We analyze the hypothesis that some individuals on the autism spectrum may use visual mental representations and processes to perform certain tasks that typically developing individuals perform verbally. We present a framework for interpreting empirical evidence related to this "Thinking in Pictures" hypothesis and then provide…

While there is ample evidence that children treat words as mutually exclusive, the cognitive basis of this bias is widely debated. We focus on the distinction between pragmatic and lexical constraints accounts. High-functioning children with autism spectrum disorders (ASD) offer a unique perspective on this debate, as they acquire substantial…

Many universities rely on data gathered from tests that are low stakes for examinees but high stakes for the various programs being assessed. Given the lack of consequences associated with many collegiate assessments, the construct-irrelevant variance introduced by unmotivated students is potentially a serious threat to the validity of the…