Long-running surveys need a systematic way to reflect social change and to keep items relevant to respondents, especially when they ask about controversial subjects, or they threaten the items' validity. We propose a protocol for updating measures that preserves content and construct validity. First, substantive experts articulate the current and…

Background: For peer assessment, reliability (i.e., consistency in ratings across peers) and validity (i.e., consistency of peer ratings with instructors or experts) are frequently examined in the research literature to address a central concern of instructors and students. Although the average levels are generally promising, both reliability and…

Background: The ARMIDILO-S is advocated as a promising tool for assessing dynamic risk factors in sex offenders with intellectual disabilities (SOIDs). However, research remains scarce. The present study aimed to further validate this instrument in SOIDs. Method: The study prospectively followed 38 SOIDs for up to one year to test the accuracy of…

While increasing productivity and economic growth, the application of artificial intelligence (AI) may ultimately require millions of people around the world to change careers or improve their skills. These disruptive effects contribute to the general public anxiety toward AI development. Despite the rising levels of AI anxiety (AIA) in recent…

The purpose of the study was to construct a Leadership Mindset Scale (LMS) and to assess its reliability and construct validity. Participants were 100 employees in a variety of leadership and non-leadership positions at various organizations in three states. An item and factor analysis on the 13 LMS items led to a scale with 11 items (Cronbach…

The aim of this study was to validate a teacher rating scale (TRS-EN) for assessing early numeracy skills and for identifying mathematically low-performing 3- and 4-year-old children. Fifty-six preschool teachers assessed children's (3-year-olds = 127; 4-year-olds = 145) numerical relational, counting, and basic arithmetic skills. Construct…

A prior study developed the Computational Thinking Scale (CTS) for assessing individuals' computational thinking dispositions in five dimensions: decomposition, abstraction, algorithmic thinking, evaluation, and generalization. This study proposed the Developmental Model of Computational Thinking through validating the structural relationships…

Studies on Global Englishes (GE)-related pedagogical and curricular innovations emphasize the importance of exposing students to the diversity of English and its users. However, they do not provide direct evidence of changes in students' attitudes. The reliability and validity of existing quantitative instruments for measuring students' attitudes…

Can non-clinicians spot preschoolers likely to have autism spectrum disorder by observing their everyday peer interaction? We set out to develop a screening tool that capitalizes on peer interaction as a naturalistic "stress test" to identify children more likely than their peers to have autism spectrum disorder. A total of 304 3- to…

Research Findings: This study provides psychometric validation of the Classroom Engagement Scale (CES), a 14-item, teacher-report, formative assessment of behavioral engagement. It is currently used for all kindergarten children in a large, urban school district where it is embedded in the report card. Multi-level factor analysis revealed two…

Falls are a significant medical and economical concern worldwide. Younger individuals with visual impairment (VI) may be more susceptible to falling and fall-related injuries when compared to peers without a VI. Self-perceived balance confidence is a psychological construct that may predict and/or mediate fall- or other health-related outcomes in…

Sight translation has been widely used in aptitude testing to screen prospective trainee interpreters at leading interpreter training schools, including ESIT, ISIT, and EMCI. However, it has also been criticised for its lack of validity and reliability. No empirical study has thus far been conducted to explore its power to predict interpreting…

Control of variables strategy (CVS) is a core scientific reasoning skill related to domain-general experimentation for evaluating an experimental system and deducing valid conclusions. This study aims to develop, validate, and explore latent factors predicting item difficulty in the test, measuring CVS in physics for high school students. The…

The national social, emotional, and behavioral (SEB) screening in South Korean schools focuses on identifying and intervening with students at risk for SEB concerns, with little attention paid to students' SEB strength. This study aimed to examine (a) the technical adequacy of the Social Emotional Health Survey--Primary (SEHS-P), Youth…

Many states now mandate early screening for dyslexia, but vary in how they address these mandates. There is confusion about the nature of screening versus diagnostic assessments, risk versus diagnosis, concurrent versus predictive validity, and inattention to indices of classification accuracy as the basis for determining risk. To help define what…