Rater cognition or "think-aloud" studies have historically been used to enhance rater accuracy and consistency in writing and language assessments. As assessments are developed for new, complex constructs from the "Next Generation Science Standards (NGSS)," the present study illustrates the utility of extending…

Quality of life is widely acknowledged as one of the most important outcomes in autism research, but few measures of this construct have been validated for use in autistic people. The goal of the current study was to examine the psychometric properties of the Patient-Reported Outcomes Measurement Information System Global--10, an established…

Evaluating written texts is believed to be a time-consuming process that can lack consistency and objectivity. Automated essay scoring (AES) can provide solutions to some of the limitations of human scoring. This research aimed to evaluate the performance of one AES system, Grammarly, in comparison to human raters. Both approaches' performances…

The Research Excellence Framework is a high-stakes exercise used by the UK government to allocate billions of pounds of quality-related research (QR) funding and used by the media to rank universities and their departments in national league tables. The 2008, 2014 and 2021 assessments were zero-sum games in terms of league table position because…

The purpose of this study was to, first, examine the potential of lesson plans (LPs) of preservice science teachers (PSTs, N = 631) as a source for gathering rich data on their pedagogical content knowledge (PCK) and, second, qualitatively describe PSTs' reasons for the level of data richness in their LPs on PCK. PSTs' handwritten LPs were…

Classroom language assessment aims to gather various types of information related to student language learning and use and use it to inform a range of formative-summative decisions, including how to provide feedback to help students improve their learning efficacy, what teaching adjustments are needed, and whether students have demonstrated their…

Online assessment is a new introduction in many developing countries during the COVID-19 pandemic, including Malaysia, Lithuania, and Spain. The current study conducted a phenomenology study to probe insights about fairness in online assessment. The interview data were interpreted from the perspective of social psychology theory that emphasizes…

This qualitative study explored whether novice principals believed their principal development program had adequately prepared them for high-performance ratings on the principal evaluation rubric. Over the past two decades, legislation has stressed that student achievement is an essential component of leadership effectiveness (Pannell &…

Curriculum mapping can be used to visualize, align, and assess the ability of online degree program graduates to meet stated learning outcomes (Rawle et al., 2017). Though consensus has yet to be established on standardized outcomes for curriculum in some disciplines (e.g., criminal justice), educators remain in charge of preparing current and…

As student creativity is increasingly emphasized in English as a Foreign Language education, it is necessary to consider instructional techniques to encourage it. This study examines the effectiveness of two instructional techniques on creative writing performance of English as a Foreign Language students in a South Korean university. These…

Purpose: Technology, including educational applications (apps), is commonly used in schools by teachers and speech-language pathologists. Nonetheless, very little research has examined the efficacy of these apps for student learning or how to choose appropriate apps for instruction. Several previous rubrics to evaluate the instructional quality of…

In the face of a critical dietitian shortage, a decline in students, and a selective student placement process, this mixed-methods study examined the admissions practices of U.S.-based Registered Dietitian Nutritionist (RDN) dietetic internship program directors. It revealed a complex scenario where student interest meets stringent qualifications,…

This study examines the proficiency of Chat GPT, an AI language model, in answering questions on the Situational Judgement Test (SJT), a widely used assessment tool for evaluating the fundamental competencies of medical graduates in the UK. A total of 252 SJT questions from the "Oxford Assess and Progress: Situational Judgement" Test…

Grades matter to students, and grading methods have documented impacts on student outcomes. While many strategies exist to study variance and reliability in research settings, unique challenges exist when it comes to applying these techniques in practical settings of post-secondary coursework. In our course setting, teaching assistants (TA's)…

Argumentation, a key scientific practice presented in the "Framework for K-12 Science Education," requires students to construct and critique arguments, but timely evaluation of arguments in large-scale classrooms is challenging. Recent work has shown the potential of automated scoring systems for open response assessments, leveraging…