Comparative Judgement (CJ) is traditionally and primarily used to compare written texts. In this study we explored whether we could extend its use to comparing audio files. We used GCSE Music portfolios which contained a mix of audio recordings, musical scores and text documents. Fifteen judges completed two exercises: one comparing musical…

Comparative Judgement (CJ) is an increasingly widely investigated method in assessment for creating a scale, for example of the quality of essays. One area that has attracted attention in CJ studies is the optimisation of the selection of pairs of objects for judgement. One approach is known as adaptive comparative judgement (ACJ). It has been…

Gymnastics judges and former gymnasts have been shown to be quite accurate in detecting errors and accurately judging performance. Purpose: The purpose of the current study was to examine if this superior judging performance is reflected in judges' gaze behavior. Method: Thirty-five judges were asked to judge 21 gymnasts who performed a skill on…

In the context of examinations, the phrase "maintaining standards" usually refers to any activity designed to ensure that it is no easier (or harder) to achieve a given grade in one year than in another. Specifically, it tends to mean activities associated with setting examination grade boundaries. Benton et al (2020) describes a method…

The authors are investigating potential applications of adaptive comparative judgment (ACJ) across numerous environments and learning scenarios within the Purdue Polytechnic Institute as part of Purdue's efforts to transform the undergraduate learning experience. Six courses or program areas were selected for the study, involving a wide variation…

The ability of change of direction quickly, in other words agility, and short distance sprinting speed are two of the most important performance components for football referees. The tests used by FIFA and UEFA such as Cooper Test, Yo-Yo Intermittent Test, 40 × 75 m tests do not include testing the agility skills of the referees. However,…

Nowadays, more and more people report about their memories in cross-cultural contexts. In international criminal settings and asylum procedures, object recognition tests can provide valuable information, for example, about weapons used during a crime or landmarks from the claimed region of origin. This study was the first to compare object…

The aim of this study was to compare the results of many-facet Rasch analyses based on crossed and judge pair designs. The study was conducted with 168 eighth grade students and five judges. The study data were collected using an achievement test with open-ended questions and a holistic rubric that was used to rate the responses. In the data…

Gucciardi et al. (2009) suggest that mental toughness is more a function of environment than domains, and as such, mental toughness is potentially important in any environment that requires performance setting, challenges, and adversities. Due to vital importance of mental toughness in sports and particularly in soccer, this paper focused on the…

The purpose of this study was to compare selected motor fitness profile of football referees in Cross River and Akwa Ibom States. Motor fitness profiles compared were running speed and agility of the referees. Standardized equipment and procedures were employed in the tests. To achieve the objectives of the study, two research hypotheses were…

Much is known about sport officials' decisions (e.g., anticipation, visual search, and prior experience). Comprehension of the entire decision process, however, requires an ecologically valid examination. To address this, we implemented a 2-part study using an expertise paradigm with ice hockey referees. Purpose: Study 1 explored the…

One of the best-known methods for setting a benchmark standard on a test is that of Angoff and its modifications. When scored dichotomously, judges estimate the probability that a benchmark student has of answering each item correctly. As in most methods of standard setting, it is assumed implicitly that the unit of the latent scale of the…

The study investigated the effects of scoring by section, use of independent scorers and conventional patterns on scorer reliability in Biology essay tests. It was revealed from literature review that conventional pattern of scoring all items at a time in essay tests had been criticized for not being reliable. The study was true experimental study…

A measure of "clusterability" serves as the basis of a new methodology designed to preserve cluster structure in a reduced dimensional space. Similar to principal component analysis, which finds the direction of maximal variance in multivariate space, principal cluster axes find the direction of maximum clusterability in multivariate space.…

Practical abilities are important for students from majors including Computer Science and Engineering, and Electrical Engineering. Along with the popularity of ACM International Collegiate Programming Contest (ACM/ICPC) and other programming contests, online judge (OJ) websites achieve rapid development, thus providing a new kind of programming…