The online placement test for the Community English Language Program (CLP) at Teachers College, Columbia University has been administered in a computer lab since 2015. While most of the components of this placement exam system are online, including registration, exam delivery, scoring, and score reporting, the COVID-19 pandemic elevated the need…

This report provides a snapshot of how accommodated tests for students with disabilities, accessibility, alternate assessments, and other related issues were addressed in states' test security policies for 2020-21. Strong test security policies and procedures are needed to help ensure the integrity and validity of state assessments, yet some test…

Developmental science demonstrates that younger children (ages 4 to 8) are capable of making meaning of their contexts and the self. Yet, younger children's meaning making is largely absent from intervention and implementation research on early childhood policies. This absence is notable given the rise in investment in early childhood policies and…

An e-assessment strategy, consisting of multiple choice questions (MCQ) within a Moodle learning management system (LMS) was implemented in a higher education institution to assist teachers with the assessment process. Considering that the new procedure induced major changes to the existing assessment, affecting students, teachers and staff, this…

Automated essay scoring engines (AESEs) are becoming increasingly popular as an efficient method for performance assessments in writing, including many language assessments that are used worldwide. Before they can be used operationally, AESEs must be "trained" using machine-learning techniques that incorporate human ratings. However, the…

Purpose: Fabricated data jeopardize the reliability of large-scale population surveys and reduce the comparability of such efforts by destroying the linkage between data and measurement constructs. Such data result in the loss of comparability across participating countries and, in the case of cyclical surveys, between past and present surveys.…

2017 marked a century since the development and administration of the first large-scale group administered standardized test. Since that time, both the importance of testing and the technology of testing have advanced significantly. This paper traces the technological advances that have led to the large-scale administration of educational tests in…

Adults find negative sentences difficult to process, but an informative context can facilitate processing substantially, suggesting that much of this difficulty may come from the pragmatics of negation. Are children sensitive to the pragmatics of negation as well? Although children perform poorly on many tests of negation comprehension, we argue…

This article deals with a theory-based investigation of the diagnostic problem-solving process in professional contexts. To begin with, a theory of the diagnostic problem-solving process was developed drawing on findings from different professional contexts. The theory distinguishes between four sub-processes of the diagnostic problem-solving…

A multistage adaptive testing (MST) design was implemented for the Programme for the International Assessment of Adult Competencies (PIAAC) starting in 2012 for about 40 countries and has been implemented for the 2018 cycle of the Programme for International Student Assessment (PISA) for more than 80 countries. Using examples from PISA and PIAAC,…

This study compares cost, completion times, and percent completion of electronic tablet (n = 244) to paper-based (n = 398) questionnaires administered to participants of scenic raft trips on the Snake River, Grand Teton National Park. We hypothesized e-tablet questionnaires would (1) cost less (2) be completed faster and (3) be completely filled…

Prior research has established that students often underprepare for midterm examinations yet remain overconfident in their proficiency. Research concerning the testing effect has demonstrated that utilizing testing as a study strategy leads to higher performance and more accurate confidence compared to more common study strategies such as…

Over the past several years, content experts, psychometricians, and researchers have been hard at work developing, refining, and studying the digital SAT. The work is grounded in foundational best practices and advances in measurement and assessment design, with fairness for students informing all of the work done. This paper shares learnings from…

Perspective-taking plays an important role in daily life, allowing consideration of other people's perspectives and viewpoints. This study used a large sample of 265 community-based participants (aged 20-86 years) to examine changes in perspective-taking abilities--a component of "Theory of Mind"--across adulthood, and how these changes…

The study investigates the relationship between lexical encoding and production in order to establish whether learners are able to produce a difficult contrast in words that they merged in their mental lexicon. Forty American English learners of Russian were tested on their production and lexical encoding of familiar and highly-frequent words with…