Background: Complex skills, like analytical thinking, are essential in preparing students for future professions. Serious games hold potential to stimulate the online acquisition of such professional skills in an active and experiential way. Objective: Rubrics are proven assessment and evaluation instruments, but were never directly integrated…

The study aimed to explore the perception of pre-service teachers regarding the use of the red pen for corrections. A non-random sample of twelve (12) respondents, consisting of three experienced tutors from the Mathematics, Science, and English Departments, along with nine pre-service teachers, were interviewed. The data was analysed…

When analyzing treatment effects on test scores, researchers face many choices and competing guidance for scoring tests and modeling results. This study examines the impact of scoring choices through simulation and an empirical application. Results show that estimates from multiple methods applied to the same data will vary because two-step models…

The purpose of this mixed methods study was to determine how communication evaluation by clinical faculty compared in a clinical setting versus a simulation setting for Bachelor of Science in Nursing (BSN) students. Fifty (50) BSN students from three different schools of nursing were scored using the Interprofessional Situation, Background,…

The purpose of this qualitative content analysis study is to investigate the themes and potential gaps in quality assurance rubrics and scorecards used to evaluate online courses in higher education. For the utility of this study, the themes and potential gaps in quality assurance rubrics and scorecards is generally defined as the recurring…

Automated Essay Scoring (AES) is a well-studied problem in Natural Language Processing applied in education. Solutions vary from handcrafted linguistic features to large Transformer-based models, implying a significant effort in feature extraction and model implementation. We introduce a novel Automated Machine Learning (AutoML) pipeline…

Automated Essay Scoring (AES) is a well-studied problem in Natural Language Processing applied in education. Solutions vary from handcrafted linguistic features to large Transformer-based models, implying a significant effort in feature extraction and model implementation. We introduce a novel Automated Machine Learning (AutoML) pipeline…

This study analyzed Bahraini primary school science textbooks and workbooks from grades 1 to 6 in terms of their coverage of the five essential features of scientific inquiry. These features include the following: feature 1, engaging learners in scientifically oriented questions; feature 2, making learners give priority to evidence in responding…

The PISA assessment 2022 of creative thinking was a moonshot effort that introduced significant advancements over existing creativity tests, including a broad range of domains (written, visual, social, and scientific), implementation in many languages, and sophisticated scoring methods. PISA 2022 demonstrated the general feasibility of assessing…

The main research question of this research study is how to design a valid and reliable holistic rubric to be used as a criterion for the comparison of the STEAM model by analyzing different countries' science curricula. Considering this question, STEAM model rubrics was created by examining the ways of shaping science education policies. The…

Scientific creativity plays an essential role in science education as an advanced cognitive ability that inspires students to solve scientific problems inventively. The cultivation of scientific creativity relies heavily on effective assessment. Typically, human raters manually score scientific creativity using the Consensual Assessment Technique…

This study aimed to investigate the impact of using scoring rubrics on assessing the performance of students in achievement. The study followed an experimental approach, and the sample consisted of 187 male and female students enrolled in the Calculus course. They were divided into three groups: the first experimental group, whose performance was…

In recent years, the application of explainability techniques to automated essay scoring and automated short-answer grading (ASAG) models, particularly those based on transformer architectures, has gained significant attention. However, the reliability and consistency of these techniques remain underexplored. This study systematically investigates…

The development of explanations for scientific phenomena is crucial in science assessment. However, the scoring of students' written explanations is a challenging and resource-intensive process. Large language models (LLMs) have demonstrated the potential to address these challenges, particularly when the explanations are written in English, an…

Student responses on the PISA 2022 creative thinking test are a rich source of data. The CT Rescoring Project applied new scoring methods to PISA 2022 creative thinking data in 14 countries and economies to identify the most creative responses in the sample and shed new light on key questions about creativity and creative thinking. This report…