In recent years, the application of explainability techniques to automated essay scoring and automated short-answer grading (ASAG) models, particularly those based on transformer architectures, has gained significant attention. However, the reliability and consistency of these techniques remain underexplored. This study systematically investigates…

Comparative Judgement (CJ) is an evaluation method, typically conducted online, whereby a rank order is constructed, and scores calculated, from judges' pairwise comparisons of performances. CJ has been researched in various educational contexts, though only rarely in English as a Foreign Language (EFL) writing settings, and is generally agreed to…

This article presents a novel experimental methodology in which groups of students were offered the option to choose between two equivalent scoring rules to assess a multiple-choice test. The effect of choosing the scoring rule on marks is tested. Two major contributions arise from this research. First, it contributes to the literature on the…

In language performance tests, raters are important as their scoring decisions determine which aspects of performance the scores represent; however, raters are considered as one of the potential sources contributing to unwanted variability in scores (Davis, 2012). Although a great number of studies have been conducted to unpack how rater…

The quality of sign language interpreting (SLI) is a gripping construct among practitioners, educators and researchers, calling for reliable and valid assessment. There has been a diverse array of methods in the extant literature to measure SLI quality, ranging from traditional error analysis to recent rubric scoring. In this study, we want to…

The Internet and the software stores for mobile devices come with a huge number of digital tools for any task, and those intended for digital formative assessment (DFA) have burgeoned exponentially in the last decade. These tools vary in terms of their functionality, pedagogical quality, cost, operating systems and so forth. Teachers and learners…

The purpose of the "Drivers Best Practices Assessment" ("DBPA") is to assist organizations in assessing their current supports and resources for quality use of selected programs or practices. Specifically, organizations can use it to: (1) Identify strengths and opportunities for improvement in their current supports and…

Increasingly content area projects and programs at the K-12 level, such as in mathematics, involve a programmatic component or project emphasis on developing "teacher leadership". However, there is no consistent definition or framework for this construct and even fewer validated tools for measuring it. This paper describes our efforts in…

Rhode Island is committed to ensuring that all educators receive fair, accurate, and meaningful educator evaluations that provide information that can help all teachers improve and refine their practice. Currently, districts in Rhode Island may submit a district-designed model for approval that complies with the Educator Evaluation System…

Assessing complex constructs such as those discussed under the umbrella of 21st century constructs highlights the need for a principled assessment design and validation approach. In our discussion, we made a case for three considerations: (a) taking construct complexity into account across various stages of assessment development such as the…

Rhode Island educators believe that implementing a fair, accurate, and meaningful educator evaluation and support system will help improve teaching and learning. The primary purpose of the Rhode Island Model Teacher Evaluation and Support System (Rhode Island Model) is to help all teachers improve. Through the Model, the goal is to help create a…

In this article, the authors provide an overview of behavior screening tools available, including free and commercially available options. Next, the authors offer step-by-step procedures for (a) selecting, (b) scheduling, (c) preparing, (d) administering, and (e) scoring and interpreting behaviors screening tools. The authors conclude with…

The purpose of this Guidebook is to describe the process and basic requirements for the student learning measures that are used as part of the building administrator evaluation and support process. For aspects of the process that have room for flexibility and school/district-level discretion, the different options have been clearly separated and…

The purpose of this Guidebook is to describe the process and basic requirements for the student learning measures that are used as part of the support professional evaluation and support process. For aspects of the process that have room for flexibility and school/district-level discretion, the different options have been clearly separated and…

Rhode Island is committed to ensuring that all educators receive fair, accurate, and meaningful educator evaluations that provide information that can help all teachers improve and refine their practice. This commitment is an outgrowth of the state's recognition of the influence teachers have on student growth and achievement. Currently, districts…