Purpose: Fabricated data jeopardize the reliability of large-scale population surveys and reduce the comparability of such efforts by destroying the linkage between data and measurement constructs. Such data result in the loss of comparability across participating countries and, in the case of cyclical surveys, between past and present surveys.…

2017 marked a century since the development and administration of the first large-scale group administered standardized test. Since that time, both the importance of testing and the technology of testing have advanced significantly. This paper traces the technological advances that have led to the large-scale administration of educational tests in…

Adults find negative sentences difficult to process, but an informative context can facilitate processing substantially, suggesting that much of this difficulty may come from the pragmatics of negation. Are children sensitive to the pragmatics of negation as well? Although children perform poorly on many tests of negation comprehension, we argue…

This article deals with a theory-based investigation of the diagnostic problem-solving process in professional contexts. To begin with, a theory of the diagnostic problem-solving process was developed drawing on findings from different professional contexts. The theory distinguishes between four sub-processes of the diagnostic problem-solving…

A multistage adaptive testing (MST) design was implemented for the Programme for the International Assessment of Adult Competencies (PIAAC) starting in 2012 for about 40 countries and has been implemented for the 2018 cycle of the Programme for International Student Assessment (PISA) for more than 80 countries. Using examples from PISA and PIAAC,…

This study compares cost, completion times, and percent completion of electronic tablet (n = 244) to paper-based (n = 398) questionnaires administered to participants of scenic raft trips on the Snake River, Grand Teton National Park. We hypothesized e-tablet questionnaires would (1) cost less (2) be completed faster and (3) be completely filled…

Prior research has established that students often underprepare for midterm examinations yet remain overconfident in their proficiency. Research concerning the testing effect has demonstrated that utilizing testing as a study strategy leads to higher performance and more accurate confidence compared to more common study strategies such as…

Over the past several years, content experts, psychometricians, and researchers have been hard at work developing, refining, and studying the digital SAT. The work is grounded in foundational best practices and advances in measurement and assessment design, with fairness for students informing all of the work done. This paper shares learnings from…

Perspective-taking plays an important role in daily life, allowing consideration of other people's perspectives and viewpoints. This study used a large sample of 265 community-based participants (aged 20-86 years) to examine changes in perspective-taking abilities--a component of "Theory of Mind"--across adulthood, and how these changes…

The study investigates the relationship between lexical encoding and production in order to establish whether learners are able to produce a difficult contrast in words that they merged in their mental lexicon. Forty American English learners of Russian were tested on their production and lexical encoding of familiar and highly-frequent words with…

Much has been done on assessment literacy (AL) components and job demand-resources (JD-R). However, an interdisciplinary look at AL components as the predictors of JD-R and its possible consequences for the engagement and burnout of teachers' assessment performance has been neglected. To fill this gap, the present study explored this issue in the…

In 2020, because of the COVID-19 pandemic the higher education sector, in the United Kingdom and internationally, transitioned to online assessment, at a speed and scale which might have been unimaginable under normal circumstances. The priority in the sector was to ensure that fundamental principles of assessment, including integrity, were…

Purpose: The purpose of the study is to examine whether the remote teaching experience of instructors in higher education during the COVID-19 pandemic has improved after one year. Design/methodology/approach: The study involved 75 instructors teaching at an institution of higher education in Israel, who answered twice (once in 2020 and again in…

This paper describes details of the evaluation experiments for questions created by an automatic question generation system. Given a target word and one of its word senses, the system generates a multiple-choice English vocabulary question asking for the closest in meaning to the target word in the reading passage. Two kinds of evaluation were…

Solving unfamiliar problems on one's own is important, but in today's increasingly interconnected world, people are often required to collaborate in order to achieve their goals. Teamwork has numerous benefits, from a diverse range of opinions to synergies among team members, and assigning tasks to those who are best suited to them. Collaboration…