The pervasive nature of media multitasking in the last fifteen years has sparked extensive research, revealing a nuanced but predominantly negative association with executive function. Given the cognitive demands and technological landscape of the modern battlefield, there is a critical interest in understanding how these findings may or may not…

This position paper introduces the idea of cognicy, the foundational ability to think and understand in a process that decouples cognitive processes from their tangible outcomes. Generative artificial intelligence (AI) can produce output often nearly indistinguishable from a human product, which presents a problem for educational assessment.…

The release of ChatGPT and other Artificial Intelligence (AI) tools has raised significant and challenging questions around the ethics of artificial intelligence in higher education. The initial concerns regarding AI in higher education centered on academic integrity, and the literature reflects this initial response. However, the multifaceted…

This paper presents the concepts and observations in the author's keynote address at the May 2019 "Opportunity versus Challenge: Exploring Usage of Log-File and Process Data in International Large-Scale Assessments" conference in Dublin, Ireland. This paper recaps briefly some key points that emerged at the December 2018 ETS symposium on…

Accomplishing a communication task in the real world requires the ability not only to do the task per se but also to manage aspects of the context in which it occurs. For this reason, simulations of target language use contexts have been incorporated into the design of communicative language tests as a way of enhancing the authenticity of…

This study uses narrative analysis to track undergraduates' proof schemes throughout a transition proofs course at a research 1 university in the Midwest, with a focus on student example use and how it influences their schemes. Assessment data and cognitive interviews were conducted at four points throughout the semester in order to track the…

Pilot training and certification have largely remained the same since the Practical Test Standards (PTS) were issued more than twenty years ago by the Federal Aviation Administration (FAA). Within the last several years, the general aviation training sector has acquired the capability to collect and analyze digital data from certain training…

Gender gaps in mathematics achievement persist in many contexts and when visible, these gaps are paradoxical. Low-stakes measures of mathematics achievement such as grades and study behaviors favor girls, while gaps tend to reverse on assessments/ competitions. We explore whether different impacts of raising performance stakes could be one…

Gender gaps in mathematics achievement persist in many contexts and when visible, these gaps are paradoxical. Low-stakes measures of mathematics achievement such as grades and study behaviors favor girls, while gaps tend to reverse on assessments/competitions. We explore whether different impacts of raising performance stakes could be one…

Background and Aims: In educational measurement, performance assessments occupy a niche for offering a true-to-life format that affords the measurement of high-level cognitive competencies and the evidence to draw inferences about intellectual capital. However, true-to-life formats also introduce myriad complexities and can skew if not outright…

Executive function (EF) is a term used to describe the processes responsible for purposeful, goal-directed behavior and has been described as the "air traffic controller" or "CEO" of the brain. EFs are an important factor in overall quality of life, including school and job success. EFs are measured predominately through two…

Standardised educational assessments are now widespread, yet their development has given comparatively more consideration to what to assess than how to optimally assess students' competencies. Existing evidence from behavioural studies with children and neuroscience studies with adults suggest that the method of assessment may affect neural…

Visual expertise in medicine has been a subject of research since many decades. Interestingly, it has been investigated from two little related fields, namely the field that focused mainly on the visual search aspects whilst ignoring higher-level cognitive processes involved in medical expertise, and the field that mainly focused on these…

In contemporary knowledge societies, performance indicators are an indispensable element of sustainable quality management and enhancement through monitoring and evaluating quality performance of higher education institutions. It is argued that learning and teaching quality in higher education should be approached in a holistic way, namely across…

In Content and Language Integrated Learning (CLIL) programmes, students learn content knowledge and a second/foreign language (L2) simultaneously. It follows that both content and language are assessed, although research on how to do so remains scarce. This study explores the interplay between cognitive and linguistic demands of CLIL assessments.…