In this study, the performance of the Lambda Coefficient of Rater-Mediated Agreement was evaluated with other chance-corrected agreement coefficients. Lambda is grounded in rater-mediated assessment theory and was developed as an alternative to Kappa (Cohen, 1960) and other chance-corrected agreement coefficients. Lambda has two variations, a…

In England, some secondary-level qualifications comprise non-exam assessments which need to undergo moderation before grading. Currently, moderation is conducted at centre (school) level. This raises challenges for maintaining the standard across centres. Recent technological advances enable novel moderation methods that are no longer bound by…

Friendship quality is closely associated with mental health of children and adolescents, making its assessment crucially important for monitoring healthy development. While the Network Relationship Inventory-Social Provisions Version (NRI-SPV) is a well-established instrument to assess quality of interpersonal relationships, its psychometric…

Social work education programs in the U.S. are accredited by the Council on Social Work Education. Amendments made to the 2022 competencies reflect antiracism language, which requires assessment opportunities in the classroom moving forward. An assessment tool that assesses efficacy across the four domains, specifically related to antiracism, is…

Purpose: Studies have shown that higher education institutions (HEIs) need to achieve deep organizational learning to develop and implement long-term strategies for responding to the climate crisis. This study aims to analyze the sustainability efforts of HEIs, in particular those who use the sustainability tracking, assessment and rating system…

Background and Context: As computer science (CS) education expands and the need for well-prepared CS teachers grows, understanding what motivates teachers to teach CS can help address challenges to recruiting, preparing, and retaining teachers. Objective: The goal of this work was to develop and validate a scale that measures teachers' motivation…

The Region 5 Comprehensive Center (R5CC) developed the Education Agency State of Readiness Assessment Tool to assess the readiness of State education agencies (SEA) to take on capacity-building projects. The indicators are adapted from the NECTAC Technical Assistance Model for Long-Term Systems Change and are based on years of developing and…

The main objective of this study is to revise and validate the assessment of self-presentation skills of middle school students. The assessment is based on existing self-assessment scales and adaptively modified for a more accurate assessment of middle school students' self-presentation skills. Considering the characteristics of middle school…

Rater comments tend to be qualitatively analyzed to indicate raters' application of rating scales. This study applied natural language processing (NLP) techniques to quantify meaningful, behavioral information from a corpus of rater comments and triangulated that information with a many-facet Rasch measurement (MFRM) analysis of rater scores. The…

The purpose of this study was to adapt the Expectancy Value Scale, Students' Motivation for Homework Scale, Homework Interest Scale, Homework Affective Attitude Scale, Math Homework Purposes Scale into Turkish and to develop the Homework Self Efficacy Scale. 1555 middle school students of 5th and 8th grades participated in the study. The students…

Measuring lexical diversity in texts that have different lengths is problematic because length has a significant effect on the number of types a text contains, thus hampering any comparison. Treffers-Daller et al. (2018) recommended a simple solution, namely counting the number of types in a section of a given length that was extracted from the…

Child observation is a critical component of quality pedagogy in early childhood education and care (ECEC). The ORICL (Observe, Reflect, Improve Children's Learning) tool was co-designed by ECEC researchers, policymakers, leaders, and practitioners to support this work. Educators rate the experiences of individual children, and responses of…

This study explores lower secondary school teachers' arguments and perceptions for using a 26-point grading scale (26-PGS), and gender differences in assessment practice. An explanatory sequential design was conducted. First, teachers (n = 6) assessment of students' text (n = 182) was analysed. In the subsequent phase, an open-ended questionnaire…

The present systematic review examines Glenn Fulcher's contributions, works, philosophy, and research in language testing and assessment. The data includes his published articles, book chapters, books and interviews (except the one in this special issue) relevant to language testing and assessment from 1987 to March 2022. This study is conducted…

School- and college-based vocational and technical qualifications (VTQs) in England are required to award successful candidates a grade rather than simple pass or fail. Ensuring the reliability and validity of these grades is considered vital, particularly in light of the high-stakes purposes for which school assessment results in England are…