While significant attention has been given to test equating to ensure score comparability, limited research has explored equating methods for rater-mediated assessments, where human raters inherently introduce error. If not properly addressed, these errors can undermine score interchangeability and test validity. This study proposes an equating…

The current study investigated whether the difficulty in finding group differences in prosody between speakers with autism spectrum disorder (ASD) and neurotypical (NT) speakers might be explained by identifying different acoustic profiles of speakers which, while still perceived as atypical, might be characterized by different acoustic qualities.…

This research aimed to develop formative assessment rubrics for enhancing students' performance on Thai percussion instruments using the Many-Facet Rasch Measurement Partial Credit model (MFRM-PCM). Samples were high-school students playing four types of Thai instruments and the raters who were qualified and properly trained. The research…

In the context of the COVID-19 restrictions and the pivot to online teaching and learning, teacher educators were forced to consider new spaces for School Placement and the assessment of these new sites of practice. This paper explores the process of the redesigning of the assessment of school placement components from the perspective of ten…

Mobile technologies, including apps, have become increasingly popular, and are being used to support daily activities among a variety of individuals. While the use of mobile technologies will not eliminate barriers often faced by individuals with disabilities, these systems have the potential to help minimize some of these barriers. As the…

This chapter reports on a study investigating non-expert raters' scoring behavior and cognitive processes involved in evaluating speech acts and pragmatic routines in L2 Chinese. Pragmatic production data were collected from 51 American learners of Chinese, who completed a 12-item oral Discourse Completion Test (DCT). The learners were divided…

This study examines the feasibility and potential advantages of using large language models, in particular GPT-4o, to perform partial credit grading of large numbers of student written responses to introductory level physics problems. Students were instructed to write down verbal explanations of their reasoning process when solving one conceptual…

Social justice evaluation approaches advance antioppressive and culturally responsive methods to mitigate societal inequalities. However, social justice efforts will fall short if they focus solely on one side of inequality: oppression. Accordingly, this article argues that the other side of inequality--privilege--needs to be scrutinized. This…

Since its inception in 1993, Ofsted has been charged with maintaining standards in schools in England. But how has this worked out? A former inspector gives his account of the journey from the inside. His point of view can be summarised from a conversation he had with a senior Ofsted inspector on his first Inspection: 'You're still on their side.…

RobotReviewer is a tool for automatically assessing the risk of bias in randomized controlled trials, but there is limited evidence of its reliability. We evaluated the agreement between RobotReviewer and humans regarding the risk of bias assessment based on 1955 randomized controlled trials. The risk of bias in these trials was assessed via two…

Systematic reviews are vital for guiding practice, research and policy, although they are often slow and labour-intensive. Large language models (LLMs) could speed up and automate systematic reviews, but their performance in such tasks has yet to be comprehensively evaluated against humans, and no study has tested Generative Pre-Trained…

This study examined the perspectives of accreditation liaison officers, institutional accreditor peer-reviewers, and chief library officer perspectives on the role that the academic librarian, academic library, and information literacy should play in institutional accreditation. The study was framed using a conceptual model based on New…

Ethics review processes are frequently perceived as extending from codes and protocols rooted in biomedical disciplines. As a result, many researchers in the humanities and social sciences (HASS) find these processes to be misaligned, if not outrightly obstructive to their research. This leads some scholars to advocate against HASS participation…

Engaging students in creating learning resources has demonstrated pedagogical benefits. However, to effectively utilize a repository of student-generated content (SGC), a selection process is needed to separate high- from low-quality resources as some of the resources created by students can be ineffective, inappropriate, or incorrect. A common…

One-quarter of households in the state of Missouri are connected to an onsite sewage treatment system. These systems are necessary due to the risks human effluent poses to public health and our states' aquifers and waterways. For these systems to function correctly, a thorough and accurate evaluation of the soils and landforms onsite must be…