In recent years, there has been increasing interest in the role of emotional and motivational intelligence in educational settings. Studies have shown that these factors can significantly impact students' academic performance. However, little attention has been given to the influence of emotional and motivational intelligence on writing…

This paper investigates crosslingual content scoring, a scenario where scoring models trained on learner data in one language are applied to data in a different language. We analyze data in five different languages (Chinese, English, French, German and Spanish) collected for three prompts of the established English ASAP content scoring dataset. We…

The insertion of Machine Learning (ML) in everyday life demonstrates the importance of popularizing an understanding of ML already in school. Accompanying this trend arises the need to assess the students' learning. Yet, so far, few assessments have been proposed, most lacking an evaluation. Therefore, we evaluate the reliability and validity of…

The biggest difference in statistical training from previous decades is the increased use of software. However, little research examines how software impacts learning statistics. Assessing the value of software to statistical learning demands appropriate, valid, and reliable measures. The present study expands the arsenal of tools by reporting on…

Rubrics, which are designed to inform learners about assessment criteria and quality levels concerning a task assignment, are a widely used means to support learners in self-assessing their task performance. Usually, rubrics enhance task performance. Surprisingly, however, relatively little is known about the underlying mechanisms via which…

As the engineering and manufacturing sectors transform their processes into those of a digital enterprise, future designers and engineers must be trained to guarantee the quality of the digital models that are created and consumed throughout the product's lifecycle. Formative training approaches, particularly those based on online rubrics, have…

As large-scale, sophisticated open and distance learning environments expand in higher education globally, so does the need to support learning at scale in real time. Valid, reliable rubrics of critical discourse are an essential foundation for developing artificial intelligence tools that automatically analyse learning in educator-student…

This document describes a set of best practices for developing, implementing, and maintaining the critical process of scoring constructed-response tasks. These practices address both the use of human raters and automated scoring systems as part of the scoring process and cover the scoring of written, spoken, performance, or multimodal responses.…

This study examines a Technology, Pedagogy, Content Knowledge (TPACK) training framework for pre- and in-service mathematics teachers that enables them to experience inquiry-based learning as learners in a dynamic geometry environment that serves as a mathematics laboratory. We investigate the effect of this experience on the teachers' TPACK,…

Some previous researchers attempted to bridge the gap between two bodies of research: the role of metacognitive knowledge in second language (L2) writing and L2 collaborative writing (CW). Although recent studies unveiled the positive impacts of learners' metacognitive knowledge on L2 collaborative writing, there is not yet consensus regarding the…

This content analysis examined the evaluative components of elementary, high-stakes, state standardized writing sample rubrics. We explored the ten most populated states in the United States, and thus most influential states, to yield salient trends in writing evaluation for early grades. Using Spandel's analytical traits as our conceptual…

Many quality assurance frameworks are in need of modification and evaluation before they can support the alignment of inclusive course design and pedagogies in institutions of higher education (IHEs). This study aimed to add inclusive practices in an open-source rubric, OpenSUNY Course Quality Review (OSCQR) rubric. Guided by the Universal Design…

Automated speaking assessment (ASA) of second language proficiency benefits both learners and educators. However, developing these systems for less commonly taught languages like Finnish and Finland Swedish is hindered by the need for large datasets with equal representation of all proficiency levels. Traditional machine learning algorithms used…

This study, conducted at a fully online Spanish higher education institution, documents the validation of a bespoke quality assessment tool designed to measure the susceptibility of formative assignments to AI academic misconduct. The research explored the impact of Generative AI (GenAI) technologies in the Humanities. The framework study…

There has been a growing research interest in the identification and management of disengaged test taking, which poses a validity threat that is particularly prevalent with low-stakes tests. This study investigated effort-moderated (E-M) scoring, in which item responses classified as rapid guesses are identified and excluded from scoring. Using…