Employing G-theory and rater interviews, the study investigated how a high-stakes writing assessment procedure (i.e., a single-task, single-rater, and holistic scoring procedure) impacted the variability and reliability of its scores within the Turkish higher education context. Thirty-two essays written on two different writing tasks (i.e.,…

Handwriting is a useful skill through education, yet handwriting difficulties are common in students with Specific Learning Difficulties (SpLD), including Developmental Coordination Disorder. There are few practical tools to assess legibility, among these the Handwriting Legibility Scale (HLS) shows good reliability and validity for 9- to…

The article introduces triangulation to converge evidence from corpus and experimental data, by means of two case studies in second language (L2) learners of Greek. The first case study investigates the acquisition of gender agreement, while the second probes the development of relative clauses. In both studies, findings from the corpus are tested…

The objective of the research is to explore the consistency of specialized nursing competency models of nursing students. The participants in this research are 165 Year 4 nursing students at Boromarajonani College of Nursing, Chakriraj, Thailand. The data was collected using a questionnaire consisting of 45 questions, answered with the use of a…

Large language models (LLMs), such as ChatGPT, are becoming increasingly prominent. Their use is becoming more and more popular to assist with simple tasks, such as summarizing documents, translating languages, rephrasing sentences, or answering questions. Reports like McKinsey's (Chui, & Yee, 2023) estimate that by implementing LLMs,…

For this paper, we developed and validated the "Orientation to School Renewal" instrument, a 21-item instrument, based on seven factors, which allows schools to measure their school renewal efforts. The research is based on Goodlad's notion of school renewal. Through an extensive literature review and our work over an eight-year period…

Nurse educators at the undergraduate level spend significant time developing and revising exam questions. Following the exam administration, course faculty have the opportunity to complete an item analysis and question revision to improve reliability and validity. A challenge faculty face is tracking these exam changes when teaching as part of a…

Data comparison problems are used in teaching and science education research that focuses on students' ability to compare datasets and their conceptual understanding of measurement uncertainties. However, the evaluation of students' decisions in these problems can pose a problem: e.g., students making a correct decision for the wrong reasons.…

The Brief Resilience Scale (BRS) measures a relatively positive adaptation despite adversity. This research aims to translate and validate the BRS into Vietnamese. Exploratory factor analysis, confirmatory factor analysis, measurement invariance analysis across gender, and test-retest reliability were examined consecutively in Study 1 (n = 304),…

Various factors such as regulatory body mandates, graduate employability challenges, decreasing student engagement and increasing academic misconduct in higher education have motivated universities to explore alternative approaches to teach and assess. Accordingly, the oral assessment has taken precedence in many contexts as a popular form of…

This article examines the risk of crossover contamination in individual-level randomization, a common concern in experimental research, in the context of a large-enrollment college course. While individual-level randomization is more efficient for assessing program effectiveness, it also increases the potential for control group students to cross…

Although there are claims that ChatGPT, an AI-based language model, is capable of assessing the writing of L2 learners accurately and consistently in the classroom, a number of recent studies have shown discrepancies between AI and human raters. Furthermore, there is a lack of studies investigating the intrareliability of ChatGPT scores.…

The Guidelines for Assessment and Instruction in Statistics Education (GAISE) College Report advocates for use of real data with context and purpose. This work contributes to the growing literature on assessing statistical literacy by investigating the influence of context as it relates to assessment performance among post-secondary introductory…

Teachers' knowledge and skills about data-based instruction (DBI) can influence their self-efficacy and their implementation of DBI with fidelity, ultimately playing a crucial role in improving student outcomes. The purpose of this brief report is to provide evidence for the technical adequacy of a measure of DBI knowledge and skills in writing by…

Rivet Education developed a Professional Learning Partner Guide (PLPG), a searchable database of learning providers with expertise in the adoption and implementation of High-Quality Instructional Materials (HQIM), in response to the lack of resources and guidance available to support districts with evaluation of professional learning (PL)…