Human ratings are ubiquitous in creativity research. Yet, the process of rating responses to creativity tasks -- typically several hundred or thousands of responses, per rater -- is often time-consuming and expensive. Planned missing data designs, where raters only rate a subset of the total number of responses, have been recently proposed as one…

With the generative artificial intelligence (AI) tool's remarkable capabilities in understanding and generating meaningful content, intriguing questions have been raised about its potential as an automated essay scoring (AES) system. One such tool is ChatGPT, which is capable of scoring any written work based on predefined criteria. However,…

Higher education accreditation has spread internationally as a vehicle for quality assurance and improvement but is strongly influenced by accreditation practices in the United States. The organisational structure and processes of seven United States health professions accreditors were analysed to identify common characteristics that reflect…

Evaluation scholars have committed decades of work to the development of evaluator competencies. The 2018 American Evaluation Association (AEA) Evaluator Competencies may be useful for evaluators to identify their strengths and weaknesses to improve their practice; however, a few empirically validated self-assessment tools based on the…

Great opportunities for language testing practitioners are enabled through language program administration. Local language tests lend themselves to multiple purposes--for placement and diagnosis, as a means of tracking progress, and as a contribution to program evaluation and revision. Administrative choices, especially those involving a test, are…

The mentoring and evaluating process enhances quality of teachers' serving in early childhood programs. The Early Educator Support (EES) Program is a new model of mentoring and coaching that aims to lend support to PreK teachers' working in nonpublic school settings. In this qualitative study, we examined the lived experiences of 12 mentors and…

The merit of narrative film methods to support participatory approaches and professional development has been increasingly demonstrated by research in several fields and education. However, the use of digital storytelling and other film methods in evaluation remains largely unchartered territory. This article provides a case study of a digital…

State and local education agencies across the country are prioritizing the goal of diversifying the teacher workforce. To further understand the challenges of diversifying the teacher pipeline, I investigate race and gender dynamics between teachers and school-based administrators, who are key decision makers in hiring, evaluating, and retaining…

Editors of academic journals play a key part in the production of knowledge and the continuation of scholarly conversations about practical and intellectual issues of the day. While peer review, an essential part of journal processes, has received considerable attention in the scholarly and the popular press, much of it critical, the role of the…

Achieving a PhD degree is viewed by academic institutions as a major landmark of success and achievement. It gives recognition to researchers and provides entry into academia. A PhD degree is not awarded lightly and doctoral candidates undergo a rigorous examination process. This study seeks to gain a better understanding of the way in which…

While significant attention has been given to test equating to ensure score comparability, limited research has explored equating methods for rater-mediated assessments, where human raters inherently introduce error. If not properly addressed, these errors can undermine score interchangeability and test validity. This study proposes an equating…

The current study investigated whether the difficulty in finding group differences in prosody between speakers with autism spectrum disorder (ASD) and neurotypical (NT) speakers might be explained by identifying different acoustic profiles of speakers which, while still perceived as atypical, might be characterized by different acoustic qualities.…

This research aimed to develop formative assessment rubrics for enhancing students' performance on Thai percussion instruments using the Many-Facet Rasch Measurement Partial Credit model (MFRM-PCM). Samples were high-school students playing four types of Thai instruments and the raters who were qualified and properly trained. The research…

In the context of the COVID-19 restrictions and the pivot to online teaching and learning, teacher educators were forced to consider new spaces for School Placement and the assessment of these new sites of practice. This paper explores the process of the redesigning of the assessment of school placement components from the perspective of ten…

Mobile technologies, including apps, have become increasingly popular, and are being used to support daily activities among a variety of individuals. While the use of mobile technologies will not eliminate barriers often faced by individuals with disabilities, these systems have the potential to help minimize some of these barriers. As the…