Providing evidence that can inform awarding is an important application of Comparative Judgement (CJ) methods in high-stakes qualifications. The process of marking scripts is not changed, but CJ methods can assist in the maintenance of standards from one series to another by informing decisions about where to place grade boundaries or cut scores.…

Establishing a cut score is a crucial aspect of the test development process since the selected cut score has the potential to impact students' performance outcomes and shape instructional strategies within the classroom. Therefore, it is vital for those involved in test development to set a cut score that is both fair and justifiable. This cut…

Despite the increasing demand for diagnostic information, observed subscores have been often reported to lack adequate psychometric qualities such as reliability, distinctiveness, and validity. Therefore, several statistical techniques based on CTT and IRT frameworks have been proposed to improve the quality of subscores. More recently, DCM has…

For years Georgia's HOPE Scholarship program provided full tuition scholarships to high-achieving students. State budgetary shortfalls reduced its generosity in 2011. Under the new rules, only students meeting more rigorous merit-based criteria would retain the original scholarship covering full tuition, now called the Zell Miller Scholarship,…

This article provides an overview of the Hofstee standard-setting method and illustrates several situations where the Hofstee method will produce undefined cut scores. The situations where the cut scores will be undefined involve cases where the line segment derived from the Hofstee ratings does not intersect the score distribution curve based on…

This paper presents evidence confirming the validity of the RD design in the Reading Recovery study by examining the ability of the RD design to replicate the 1st grade results observed in the original i3 RCT focused on short-term impacts. Over 1,800 schools participated in the RD study over all four cohort years. The RD design used cutoff-based…

This study examines separate and concurrent approaches to combine the detection of item parameter drift (IPD) and the estimation of scale transformation coefficients in the context of the common item nonequivalent groups design with the three-parameter item response theory equating. The study uses real and synthetic data sets to compare the two…

The aim of the current study is to analyse the 2014 Post UTME scores of candidates in the university of Ibadan towards the establishment of cut off using two methods of standard settings. Prospective candidates who seek admission to higher institution are often denied admission through the Post UTME exercise. There is no single recommended…

Purpose: This study aimed to compare the cut scores obtained by the Extended Angoff and Contrasting Groups methods for an achievement test consisting of constructed-response items. Research Methods: This study was based on survey research design. In the collection of data, the study group of the research consisted of eight mathematics teachers for…

This study aims to determine the changes in the cognitive structures of the 35 participants after ecology-based nature education in Bursa Uludag and its vicinity. This study used a single group pretest-posttest experimental mode where the data was collected by a word association test. It included the key concepts of nature, national parks,…

While previous research on student success has focused on disciplinary academic classes and programs with varying results regarding the predictive validity of English proficiency tests, namely the International English Language Testing System (IELTS), none have studied student success within the non-program-specific context of an English for…

Purpose: In African American English and Southern White English, we examined whether children with specific language impairment (SLI) overtly mark tense and agreement structures at lower percentages than typically developing (TD) controls, while also examining the effects of dialect, structure, and scoring approach. Method: One hundred six…

Purpose: Rapid maximum performance repetition tasks have increasingly demonstrated their utility as clinimetric markers supporting diagnosis and monitoring of bulbar disease in amyotrophic lateral sclerosis (ALS). A recently developed protocol uses novel real-word repetitions instead of traditional nonword/syllable sequences in hopes of improving…

Objective: To examine the effects of the indicated level of the prevention program "Zenétudes": making a healthy transition to college on anxious and depressive symptoms. Participants: 65 college students participated in the study, from September 2014 to August 2016. From that initial sample, 53 students (ages 16-34) were included in…

Treatment effect estimates from a "regression discontinuity design" (RDD) have high internal validity. However, the arguments that support the design apply to a subpopulation that is narrower and usually different from the population of substantive interest in evaluation research. The disconnect between RDD population and the…