Evidence of the internal consistency of standard-setting judgments is a critical part of the validity argument for tests used to make classification decisions. The bookmark standard-setting procedure is a popular approach to establishing performance standards, but there is relatively little research that reflects on the internal consistency of the…

One commonly used compromise standard-setting method is the Beuk (1984) method. A key assumption of the Beuk method is that the emphasis given to the pass rate and the percent correct ratings should be proportional to the extent that the panelists agree on their ratings. However, whether the slope of Beuk line reflects the emphasis that panelists…

When teachers give a group grade for discussions, students focus on collaboration--not "airtime." Alexis Wiggins, teacher and author of "The Best Class You Never Taught" (ASCD, 2017), describes how--and why--a group grade works so well for class conversations (a bonus rubric is included).

This study describes the initial psychometric evaluation of an Understanding Procedures observation rubric. The instrument is intended to provide feedback to teachers working in mathematics intervention settings. The rubric translates the research base from mathematics education and special education into practice in the form of specific items and…

This article compares cut scores from two variations of the Hofstee and Beuk methods, which determine cut scores by resolving inconsistencies in panelists' judgments about cut scores and pass rates, with the Angoff method. The first variation uses responses to the Hofstee and Beuk percentage correct and pass rate questions to calculate cut scores.…

This study describes the initial psychometric evaluation of the Understanding Procedures observation rubric for use as an instrument for feedback to teachers working in mathematics intervention settings. The rubric translates the research base from mathematics education and special education into practice in the form of specific items and…

The advent of generative artificial intelligence (AI) offers transformative potential in the field of education. The study explores three main areas: (1) How did ChatGPT answer questions related to science education? (2) What are some ways educators could utilise ChatGPT in their science pedagogy? and (3) How has ChatGPT been utilised in this…

This study evaluates various scoring methods including number-correct scoring, IRT theta scoring, and hybrid scoring in terms of scale-score stability over time. A simulation study was conducted to examine the relative performance of five scoring methods in terms of preserving the first two moments of scale scores for a population in a chain of…

Purpose: Teaching effectiveness is essential to student learning, engagement and success. This study aims to identify the perceived teaching effectiveness attributes from the student's perspective through a pilot study. Design/methodology/approach: A comprehensive literature review identified 6 demographic and 25 teaching effectiveness…

This research investigates the effectiveness of utilizing analytic rubrics in peer-assessment (PA) and self-assessment (SA) methodologies to enhance the proficiency of English as a Foreign Language (EFL) students' essay writing skills in the Vietnamese context. It further contributes to the existing body of literature regarding formative…

International assessments inform education policy debates, yet little is known about their floor effects: To what extent do they fail to differentiate between the lowest performers, and what are the implications of this? TIMSS, SACMEQ, and LLECE data are analyzed to answer this question. In TIMSS, floor effects have been reduced through the…

With the increasing bandwidth, videos have been gradually used as submissions for online peer assessment activities. However, their transient nature imposes a high cognitive load on students, particularly lowability students. Therefore, reviewers' ability is a key factor that may affect the reviewing process and performance in an online video peer…

The collaborative nature of introductory college science labs means that labs can play a major role in boosting students' interest in experimental science when they work together in small groups. However, collaboration in lab courses is not always positive for all students. We report on a study that documented how women in mixed-gender groups in a…

In this study, it was aimed to develop a rubric to determine the travel writing levels of secondary school 7th grade students and to determine the students' travel writing skill levels. The descriptive scanning design of the quantitative model was adopted. It was decided to develop an analytical rubric because it serves to measure the sub-skills…

Rater training is necessary to accurately evaluate fundamental motor skills among children with developmental disabilities (DD). The purpose of this pilot study was to examine the impact of an online rater training program for novice raters on scoring accuracy of the run and two-hand strike skills on the Test of Gross Motor Development-Third…