Background/purpose: Generative artificial intelligence (GenAI) is often promoted as a transformative tool for assessment, yet evidence of its validity compared to human raters remains limited. This study examined whether an AI-based rater could be used interchangeably with trained faculty in scoring complex coursework. Materials/methods:…

In this secondary analysis of a previously conducted systematic review, we analyze social validity assessments in intervention research for transition-age autistic youth. Social validity is concerned with the acceptability of the intervention goals, the acceptability and feasibility of the intervention procedures, and the perceived importance of…

Metacognitive awareness is essential in regulating second language (L2) listening and has been predominantly assessed by a multidimensional instrument named the Metacognitive Awareness Listening Questionnaire (MALQ). Since previous studies have yielded inconclusive evidence concerning the generalization of MALQ, it is important to examine the…

The ever-changing advances in technology require digital literacy skills for success in the workplace. To determine the critical digital literacy skills needed in the workplace today, the development of a reliable, valid instrument occurred using the nine steps of scale development by DeVellis and Thorpe (2021). Based on the SkillRise (2020a)…

While multimodality and multiliteracies has been a concept for 25 years (Kalantzis & Cope, 2023; The New London Group, 1996), research on and application of the concept within text complexity measures has been limited. Attempts to assess multiliteracies and multimodality (Jacobs, 2013; Schmerbeck & Lucht, 2017; Wyatt-Smith & Kimber,…

The purpose of this instructional piece was to provide a nontechnical synthesis of common internal consistency reliability estimates used in professional counseling and in related fields. The article begins with an overview of coefficients alpha, omega, omega hierarchical, and H, with guidelines for their selection. Next, I provide recommendations…

Accurate, reliable, and scalable measurement of classroom quality represent a critical tool for ensuring that young children benefit from early learning programs. The Early Childhood Classroom Observation (ECCO) study was designed to better understand how video recordings can support high-quality measurement of pre-kindergarten (pre-K) classrooms,…

Despite the evolution of the grit conceptualization over the years, the psychometric validity of scales and construct structure remain unclear. Consequently, this study aims to provide new evidence that broadens the current understanding of the grit's dimensional nature in the Spanish population by examining the psychometric properties of the…

This study describes the development of the science, technology, engineering, and mathematics (STEM) Scale, intended to assess parental attitudes toward school programs designed to deliver STEM, and evaluates its psychometric properties. The study group included 400 parents of students (138 males and 262 females) enrolled in STEM programs…

This is the second article in a series of three in this special issue on establishing a boundary object to foster network health and development. The first article laid out the theoretical rationale for an Improvement Network Health and Development Framework. This article details the efforts to develop a set of practical measures tied to this…

The aim of this study is to investigate the test-retest reliability of the Closed Kinetic Chain Upper Extremity Stability Test (CKCUEST) and modified-CKCUEST in children aged 7-10 years and to compare the two test versions within the same group. The study was completed with fifty-three children. Average, normalized, and power scores were obtained…

Objective: To measure the interrater reliability of assessing the frequency of vegetable intake using mobile photos and descriptions. Design: Repeated measures design. Setting: A Midwestern university. Participants: Undergraduate students (N = 165). Measurable Outcome/Analysis: Number of times each of these vegetable subgroups were consumed daily:…

This study adapts the "Scales for Identifying Gifted Students (SIGS-2)" into Turkish for use from preschool onward, specifically during the candidate nomination stage. Conducted with 974 parents (675 mothers, 299 fathers) of children aged 5-10, it employs Confirmatory Factor Analysis (CFA) to evaluate the scale's structure and…

The study aimed to analyze, synthesize, and investigate the measurement properties of clinical tests that assess foot posture in children and adolescents. The study included research published in scientific journals that analyzed the measurement properties of clinical tests, focusing on the validity, reliability, responsiveness, or specificity of…

Learning behavior refers to students' preparedness to embrace various learning forms and techniques, encompassing skills, activities, creativity, and motivation. Positive learning behavior improves efficiency, discipline, and academic skills, while negative learning behavior results in a diminished grasp of the essence of learning and cultivates…