The Hearts and Flowers (H&F) task is a computerized executive functioning (EF) assessment that has been used to measure EF from early childhood to adulthood. It provides data on accuracy and reaction time (RT) across three different task blocks (hearts, flowers, and mixed). However, there is a lack of consensus in the field on how to score the…

The purpose of this study was to compare the classification accuracy of data produced by the previous year's end-of-year New York state assessment, a computer-adaptive diagnostic assessment ("i-Ready"), and the gating combination of both assessments to predict the rate of students passing the following year's end-of-year state assessment…

Drawing from the developmental and cognitive mathematics literature, the purpose of this study was to investigate the reliability, validity, and diagnostic utility of a widely-researched number line task in kindergarten. Specifically, the Number Line Assessment 0-100 (NLA 0-100) as compared to an established kindergarten screening measure was…

Educators use universal screening to identify students who may be at risk for not meeting proficiency on the state assessment. Given the potential high-stakes of state tests, using accurate screeners is critical. Independent research is emerging on screeners such as the Measures of Academic Progress (MAP), a computer adaptive test, and the…

To evaluate if takeoff speed can be predicted using peak-speed from a linear position transducer (LPT), 21 rowing athletes performed hexagonal-bar jumps in line with the National Team testing protocol. Predictive validity was assessed by comparing peak-speed from a LPT to the criterion measure takeoff speed collected from force plates. The…

Self-report inventories are commonly administered to measure social-emotional learning competencies related to college and career readiness. Inattentive responding can negatively impact the validity of interpreting individual results and the accuracy of construct validity evidence. This study applied nine methods of detecting insufficient effort…

Although researchers have investigated technical adequacy and usability of written-expression curriculum-based measures (WE-CBM), the economic implications of different scoring approaches have largely been ignored. The absence of such knowledge can undermine the effective allocation of resources and lead to the adoption of suboptimal measures for…

This article reviews the evidence on the extent to which experts' perceptions of item difficulties, captured using comparative judgement, can predict empirical item difficulties. This evidence is drawn from existing published studies on this topic and also from statistical analysis of data held by Cambridge Assessment. Having reviewed the…

For many practical purposes, it is often assumed that the quality of a marker is directly related to their seniority. At its extreme, the assumption is that the most senior marker (the Principal Examiner) is always right even in cases where large numbers of junior markers have a collectively different opinion regarding the mark that should be…

Multiple popular math curriculum-based measures have recently been revised in ways that may improve their utility for universal screening. However, the applied use of these tools has yet to be evaluated independently. We conducted a retrospective analysis of the diagnostic accuracy of prior year statewide test results and aimswebPlus math…

Acid-base chemistry is a key reaction motif taught in postsecondary organic chemistry courses. More specifically, concepts from the Lewis acid-base model are broadly applicable to understanding mechanistic ideas such as electron density, nucleophilicity, and electrophilicity; thus, the Lewis model is fundamental to explaining an array of reaction…

In the present study, we investigated whether police officers' performance in searching for unfamiliar faces in a video-based real-world task is predicted by laboratory-based face processing tests that are typically used to assess individual differences in face processing abilities. Specifically, perceptual performance in the field was…

In higher education, predictive analytics can provide actionable insights to diverse stakeholders such as administrators, instructors, and students. Separate feature sets are typically used for different prediction tasks, e.g., student activity logs for predicting in-course performance and registrar data for predicting long-term college success.…

This study addresses the role of domain-general mechanisms in second-language learning and knowledge using an individual differences approach. We examine the predictive validity of implicit-statistical learning aptitude for implicit second-language knowledge. Participants (n = 131) completed a battery of four aptitude measures and nine grammar…

Universal screening has emerged as one strategy within schools for identifying students who demonstrate social emotional and behavioral (SEB) concerns to provide appropriate support. However, research has demonstrated little evidence of equity around diagnostic accuracy; that is, how students might be differentially identified as at-risk for SEB…