Achievement tests are commonly used in education to evaluate students' academic performance and proficiency in specific subject areas. However, there is a major problem that threatens the validity of achievement test scores which is test-taking disengagement. Respondents provide answers that are inconsistent with their true ability level and can…

Many low-stakes assessments, such as international large-scale surveys, are administered during time-limited testing sessions and some test-takers are not able to endorse the last items of the test, resulting in not-reached (NR) items. However, because the test has no consequence for the respondents, these NR items can also stem from quitting the…

Process data are becoming more and more popular in education research. In the field of computer-based assessments of collaborative problem solving (ColPS), process data have been used to identify students' test-taking strategies while working on the assessment, and such data can be used to complement data collected on accuracy and overall…

Objective: To examine the manifestation of cognitive control deficit of children with different levels of hyperactivity, an "at risk" dimension for ADHD. Method: A group of children with high hyperactivity (N = 40) and another group of children with low levels of hyperactivity (N = 38) performed a modified stop-signal anticipation task,…

Background: Examinees may not make enough effort when responding to test items if the assessment has no consequence for them. These disengaged responses can be problematic in low-stakes, large-scale assessments because they can bias item parameter estimates. However, the amount of bias, and whether this bias is similar across administrations, is…

As researchers in the social sciences, we are often interested in studying not directly observable constructs through assessments and questionnaires. But even in a well-designed and well-implemented study, rapid-guessing behavior may occur. Under rapid-guessing behavior, a task is skimmed shortly but not read and engaged with in-depth. Hence, a…

Despite being a popular topic in language testing, cognitive load has not received enough attention in vocabulary test items. The purpose of the current study was to scrutinize the cognitive load and vocabulary test items' differences, examinees' reaction times, and perceived difficulty. To this end, 150 students were selected using…

Changepoints are abrupt variations in a sequence of data in statistical inference. In educational and psychological assessments, it is pivotal to properly differentiate examinees' aberrant behaviors from solution behavior to ensure test reliability and validity. In this paper, we propose a sequential Bayesian changepoint detection algorithm to…

Understanding language requires the ability to compose the meanings of words into phrase and sentence meanings. Formal theories in semantics have framed the hypothesis that all instances of meaning composition, irrespective of the syntactic and semantic properties of the expressions involved, boil down to a unique formal operation, that is, the…

Conflict adaptation is key in how children self-regulate and assert cognitive control in a given situation compared with a previous experience. In the current study, we analyzed event-related potentials (ERPs) to identify age-related differences in conflict adaptation. Participants of different ages (5-year-old children, 10-year-old children, and…

Previous studies suggest that individuals with Williams syndrome (WS), a rare genetically based neurodevelopmental disorder, show specific weaknesses in visual attention and response inhibition within the visuospatial domain. Here we examine the extent to which impairments in attentional control extend to the visuomotor domain using a…