It is important to define what an error in a question paper is so that there is a common understanding and to avoid people's own conceptions impacting upon the way in which they write or check question papers. We carried out an interview study to investigate our colleagues' definitions of error. We found that there is no single accepted definition…

As low-stakes testing contexts increase, low test-taking effort may serve as a serious validity threat. One common solution to this problem is to identify noneffortful responses and treat them as missing during parameter estimation via the effort-moderated item response theory (EM-IRT) model. Although this model has been shown to outperform…

In this article, we develop the revised and short versions of the pseudoscientific belief scale through two empirical studies (N = 4154). This revision is motivated by the excessive length of the scale, as well as by consistent observations of poor item loadings across several studies. Exploratory factor analysis in Study 1 revealed 11 dispensable…

Background: In academic contexts, teachers' judgements are central to instruction and have many consequences for students' self-perceptions. Understanding the cognitive biases that may exist in teachers' judgements is thus of central importance. Aims: This paper presents two studies in which we aimed to investigate the presence of a halo effect in…

In this article, it is shown how item text can be represented by (a) 113 features quantifying the text's linguistic characteristics, (b) 16 measures of the extent to which an information-retrieval-based automatic question-answering system finds an item challenging, and (c) through dense word representations (word embeddings). Using a random…

According to the literature, the use of the Berkeley Puppet Interview (BPI) to measure Big Five personality traits in children provides reliable and valid scores. However, the implementation of the BPI could be costly, especially when working with large sample sizes. Big Five self-reports were collected from 1118 Mexican children aged 7-8 years…

The COVID-19 outbreak has an impact on the provision of education. One of them is the process of online assessment or examination. Difficulties occur during online exams; weak supervision can increase cheating behavior among students. Generally, teachers or lecturers think about how to prevent this behavior. However, what if they are allowed to…

Fluency tasks are among the most common item formats for the assessment of certain cognitive abilities, such as verbal fluency or divergent thinking. A typical approach to the psychometric modeling of such tasks (e.g., "Intelligence," 2016, 57, 25) is the Rasch Poisson Counts Model (RPCM; "Probabilistic models for some intelligence…

We tested the utility of two standardized measures of receptive skills in American Sign Language (ASL) in hearing adults who are novice signers: the ASL Comprehension Test (ASL-CT; Hauser, P. C., Paludneviciene, R., Riddle, W., Kurz, K. B., Emmorey, K., & Contreras, J. (2016). American Sign Language Comprehension Test: A tool for sign language…

This paper describes the development, validation, and key findings of the Canadian Ocean Literacy Survey. Led by the Canadian Ocean Literacy Coalition (COLC) and its research partners, this survey was developed as part of a Canada-wide, mixed methods research initiative examining how ocean literacy is understood and practised across different…

PISA is an influential international study of the achievement of 15-year-olds. It has a high profile across the devolved nations of the UK, with the results having a substantial impact upon education policy. Yet many of the technical details underpinning PISA remain poorly understood--particularly amongst non-specialists--including important…

Recent worldwide epidemiological surveys of autism conducted in 37 countries are reviewed; the median prevalence of autism is 0.97% in 26 high-income countries. Methodological advances and remaining challenges in designing and executing surveys are discussed, including the effects on prevalence of variable case definitions and nosography, of…

We investigate encoder-decoder GRU networks with attention mechanism for solving a diverse array of elementary math problems with mathematical symbolic structures. We quantitatively measure performances of recurrent models on a given question type using a test set of unseen problems with a binary scoring and partial credit system. From our…

In the current article, we describe the development and validation of the Mistake Rumination Scale as a supplement to existing trait and cognitive measures of perfectionism. The Mistake Rumination Scale is a seven-item inventory that taps the tendency to ruminate about a past personal mistake. Psychometric analyses confirmed that the Mistake…

The National Assessment Governing Board (the Board) contracted with Pearson to design and implement a review of the achievement level descriptions (ALDs) for National Assessment of Educational Progress (NAEP) Grade 8 assessments in Science, U.S. History, and Civics. This document describes the procedural and technical aspects and outcomes of the…