With the exponential increase of digital assessment, different types of data in addition to item responses become available in the measurement process. One of the salient features in digital assessment is that process data can be easily collected. This non-conventional structured or unstructured data source may bring new perspectives to better…

In real-world settings, vision language models (VLMs) should robustly handle naturalistic, noisy visual content as well as domain-specific language and concepts. For example, K-12 educators using digital learning platforms may need to examine and provide feedback across many images of students' math work. To assess the potential of VLMs to support…

This study is a conceptual replication of Ellis' 'Measuring implicit and explicit knowledge of a second language: A psychometric study', published in "Studies in Second Language Acquisition" (2005), aiming to establish the importance of including belief statements (hypothesized to increase processing demands) in the design of Elicited…

Early literacy assessment has become commonplace in the preschool years, with phonological awareness constituting one component of emergent literacy targeted by such practices. This within-subjects experimental study examines the role of word familiarity on 93 dual language preschoolers' performance on phoneme-level awareness tasks in…

This study reports on developing and validating the School Alienation in Online Schooling Scale (SAOSS). School alienation in online schooling is conceptualized as opposed to school belonging and the main reason for minimal participation, reduced educational benefits, and school dropout in school aged-children, especially during the online…

Score equity assessment (SEA) refers to an examination of population invariance of equating across two or more subpopulations of test examinees. Previous SEA studies have shown that score equity may be present for examinees scoring at particular test score ranges but absent for examinees scoring at other score ranges. No studies to date have…

Language assessment is increasingly computermediated. This development presents opportunities with new task formats and equally a need for renewed scrutiny of established conventions. Recent recommendations to increase integrated skills assessment in lecture comprehension tests is premised on empirical research that demonstrates enhanced construct…

Socially regulated learning (SoRL) is a critical mechanism for enhancing the effectiveness of collaborative learning outcomes. Measurement of university students' engagement in SoRL is essential for refining the strategies aimed at improving its efficacy. Nonetheless, the measurement of university students' levels of engagement in SoRL remains…

Background: Critical thinking is essential in modern education, and artificial intelligence (AI) offers new possibilities for enhancing it. However, the lack of validated tools to assess teachers' AI-integrated pedagogical skills remains a challenge. Objectives: The current study aimed to develop and validate the Artificial Intelligence-Critical…

The OECD's Survey on Social and Emotional Skills (SSES) 2023 represents the largest global initiative to gather comparable data on the development of social and emotional skills among 10- and 15-year-old students. In the 2023 cycle of SSES, 16 sites implemented an assessment of students' social and emotional skills and collected contextual…

Understanding particle motion in force fields (PMFF), which encompasses the nature of forces and the relationship between force and motion, is fundamental to mastering mechanics and electromagnetism. Effectively solving PMFF-related problems requires advanced reasoning skills and the ability to apply knowledge across diverse contexts. Despite…

Students are often encouraged to learn 'deeply' by abstracting generalizable principles from course content rather than memorizing details. So widespread is this perspective that Likert-style inventories are now routinely administered to students to quantify how much a given course or curriculum evokes deep learning. The predictive validity of…

This study verified validity and reliability of the School Function Assessment (SFA) using Rasch analysis in South Korean school-based occupational therapy sites serving children with intellectual disabilities and others. Participants were 103 elementary school children (grades 1 through 6) with disabilities. Rasch analysis revealed several…

Multiple choice results are inherently probabilistic outcomes, as correct responses reflect a combination of knowledge and guessing, while incorrect responses additionally reflect blunder, a confidently committed mistake. To objectively resolve knowledge from responses in an MC test structure, we evaluated probabilistic models that explicitly…

Although research on sensitive topics has produced a large body of knowledge on how to improve the quality of self-reported data, little is known regarding the sensitivity of offending questions, and much less is known regarding how topic sensitivity is affected by recall periods. In this study, we developed a multi-dimensional assessment of item…