Fidelity is defined as doing what is intended. The purpose of measuring fidelity is to assist with supporting implementation. Collecting fidelity data provides an opportunity to problem-solve throughout the process versus waiting for outcome data. More often than not, purchased programs and curriculum materials are missing a research-validated…

This project discusses the creation and implementation of labor logs in multimodal curricula in two levels of writing courses and how these labor logs support students' development of meta-awareness through reflection-in-action (Yancey, 1998). Labor logs create a space for students to focus on in the moment recognition, or monitoring, of what…

Idiomatic expressions (IEs) play an essential role in natural language. In this paper, we study the task of idiomatic sentence paraphrasing (ISP), which aims to paraphrase a sentence with an IE by replacing the IE with its literal paraphrase. The lack of large scale corpora with idiomatic-literal parallel sentences is a primary challenge for this…

Multistage adaptive testing (MST) has become popular in the testing industry because the research has shown that it combines the advantages of both linear tests and item-level computer adaptive testing (CAT). The previous research efforts primarily focused on MST design issues such as panel design, module length, test length, distribution of test…

This article builds upon a proiminent definition of construct validity that focuses on variation in attributes causing variation in measurement outcomes. This article synthesizes the defintion and uses Rasch measurement modeling to explicate a modified conceptualization of construct validity for assessments of developmental attributes. If…

The pedagogical development (PD) for educators in higher engineering education is indispensable to the promotion of educational changes and high-quality teaching and learning necessary to train twenty-first century engineering talents. With the expansion of various PD activities in engineering education in recent decades, there is a growing need…

Feedback provided by peer reviewers plays a pivotal role in any journal peer-review model. Peer-review feedback helps authors reconsider their manuscripts in a new light and improve their work before it is published. While there is a wealth of knowledge and empirical evidence focusing on effective feedback practices in educational settings, there…

With the popularity of online one-to-one tutoring, there are emerging concerns about the quality and effectiveness of this kind of tutoring. Although there are some evaluation methods available, they are heavily relied on manual coding by experts, which is too costly. Therefore, using machine learning to predict instruction quality automatically…

When analyzing instructional quality in mathematics, observational measures can consider domain-specific instructional approaches (e.g., effective teaching of mathematics) and content-focused practices (e.g., effective teaching of a specific mathematical topic). In this study, we analyze lesson videos from secondary algebra classrooms using two…

The use of digital media among student community has increased their level of distraction during classroom teaching. Capturing their attention in classrooms, has become a cumbersome task for teaching faculty. Therefore, most of the academic institutions have resorted to the use of activity-based learning for science and engineering students that…

This preliminary study explores how GPT-4 Vision (GPT-4V) technology can be integrated into teacher analytics through observational assessment, aiming to improve reflective teaching practice. Our study develops a Video-based Automatic Assessment System (VidAAS) powered by GPT-4V. This approach uses Generative Artificial Intelligence (GenAI) to…

Purpose: To gain a better understanding of the assessment practices currently implemented by Quebec physical education teachers regarding reporting and grading. Method: Exploratory mixed-methods study using semistructured interviews (n = 13), interviews to the double (n = 12), and a questionnaire (n = 164) with elementary and high school physical…

How do we make judgements about the quality of online courses? Checklists and rubrics are commonplace in higher education for establishing and measuring design features of online courses. They are created and used by institutions, academics and educational designers to standardise measures for quality online course design. Despite an intensifying…

Since its arrival in late 2022, ChatGPT has occupied the minds of academics, administrators and students. Reactions to the emergence of Large Language Models (LLMs) have varied but significant anxieties about their impact on assessment have arisen. To address these concerns, this article serves three purposes; firstly, it seeks to gauge the…

Graduate higher education coverage has expanded worldwide due to globalisation, the demand for more specialised human resources and online education, exacerbated by the COVID-19 pandemic. This article validates an evaluation model of academic service quality in graduate studies that integrates HiEduQual instruments with the Kano method for…