Automated Essay Scoring (AES) is a well-studied problem in Natural Language Processing applied in education. Solutions vary from handcrafted linguistic features to large Transformer-based models, implying a significant effort in feature extraction and model implementation. We introduce a novel Automated Machine Learning (AutoML) pipeline…

This study analyzed Bahraini primary school science textbooks and workbooks from grades 1 to 6 in terms of their coverage of the five essential features of scientific inquiry. These features include the following: feature 1, engaging learners in scientifically oriented questions; feature 2, making learners give priority to evidence in responding…

The PISA assessment 2022 of creative thinking was a moonshot effort that introduced significant advancements over existing creativity tests, including a broad range of domains (written, visual, social, and scientific), implementation in many languages, and sophisticated scoring methods. PISA 2022 demonstrated the general feasibility of assessing…

The main research question of this research study is how to design a valid and reliable holistic rubric to be used as a criterion for the comparison of the STEAM model by analyzing different countries' science curricula. Considering this question, STEAM model rubrics was created by examining the ways of shaping science education policies. The…

Scientific creativity plays an essential role in science education as an advanced cognitive ability that inspires students to solve scientific problems inventively. The cultivation of scientific creativity relies heavily on effective assessment. Typically, human raters manually score scientific creativity using the Consensual Assessment Technique…

This study aimed to investigate the impact of using scoring rubrics on assessing the performance of students in achievement. The study followed an experimental approach, and the sample consisted of 187 male and female students enrolled in the Calculus course. They were divided into three groups: the first experimental group, whose performance was…

In recent years, the application of explainability techniques to automated essay scoring and automated short-answer grading (ASAG) models, particularly those based on transformer architectures, has gained significant attention. However, the reliability and consistency of these techniques remain underexplored. This study systematically investigates…

The development of explanations for scientific phenomena is crucial in science assessment. However, the scoring of students' written explanations is a challenging and resource-intensive process. Large language models (LLMs) have demonstrated the potential to address these challenges, particularly when the explanations are written in English, an…

Traditionally, researchers employ human raters for scoring responses to creative thinking tasks. Apart from the associated costs this approach entails two potential risks. First, human raters can be subjective in their scoring behavior (inter-rater-variance). Second, individual raters are prone to inconsistent scoring patterns…

Researchers have called for undergraduate courses to update teaching frameworks based on the Modern Synthesis with insights from molecular biology, by stressing the molecular underpinnings of variation and adaptation. To support this goal, we developed a modified version of the widely used Assessing Conceptual Reasoning of Natural Selection…

Online calibration is a key technology for item calibration in computerized adaptive testing (CAT) and has been widely used in various forms of CAT, including unidimensional CAT, multidimensional CAT (MCAT), CAT with polytomously scored items, and cognitive diagnostic CAT. However, as multidimensional and polytomous assessment data become more…

Background: Verbal fluency tests (VFT) are highly sensitive to cognitive deficits. Usually, the score on VFT is based on the number of correct words produced, yet it alone gives little information regarding underlying test performance. The implementation of different strategies (cluster and switching) to perform efficiently during the tasks…

This study explores the effects of feedback type, feedback occasion, and year level on student self-assessments in higher education. In total, 126 university students participated in this randomized experiment under three experimental conditions (i.e., rubric feedback, instructor's written feedback, and rubric feedback plus instructor's written…

The main purpose of speaking education is to enable individuals to express their thoughts accurately and effectively in every environment they communicate. This is possible with the teaching plan and measurement tools for different speech types. This research focuses on students' persuasive speaking skills. In this study, we aimed to develop a…

This study aimed to develop an automated computer scoring system (ACSS) incorporating a Korean spell checker to assess students' constructed responses and to check the efficacy of this system. To accomplish this, we examined the performance of automatic spelling correction in reporting and correcting spelling errors, the interaction of gender and…