The main goal of this study was to validate the strategy for the assessment of the cognitive complexity of chemical kinetics exam items. The strategy included three steps: 1) assessment of the difficulty of concepts, 2) assessment of distractor value, and 3) assessment of concepts' interactivity. One of the tasks was to determine whether there…

Two-tiered assessment structures with paired content and confidence items are frequently used within chemistry assessments to stimulate and measure students' metacognition. The confidence judgment is designed to promote students' reflection on their application of content knowledge and can be characterized as calibrated or miscalibrated based on…

Digital automated assessment is a valuable and time-efficient tool for educators to provide immediate and objective feedback to learners. Automated assessment, however, puts high demands on the quality of the questions, alignment with the intended learning outcomes, and the quality of the feedback provided to the learners. We here describe the…

This study describes the role that Rasch measurement played in the development of assessments aligned to the "Next Generation Science Standards," tasks that require students to use the three dimensions of science practices, disciplinary core ideas and cross-cutting concepts to make sense of energy-related phenomena. A set of 27…

Much of the focus of international comparative studies of students' achievement has been on New Zealand students' falling standards. Using the most recent findings from the Trends in International Mathematics and Science Study (TIMSS), and, in particular, Year 9 New Zealand students' performance in specific items, this article suggests that there…

Responsive coaching at engage2learn is an innovative and evidence-based solution. This 2022-2023 study, paired with previous reports, compellingly validates the efficacy of the engage2learn program by exploring end-of-year STAAR test performance for Math and Science among Grades 6-8. LXD Research, an independent research firm, analyzed educator…

Virtual and augmented reality have seen increasing employment for teaching within medical and health sciences programs. For disciplines such as physiology and anatomy, these technologies may disrupt the traditional modes of teaching and content delivery. The objective of this systematic review and meta-analysis is to evaluate the impact of virtual…

This work is the fourth of a series of papers applying multidimensional item response theory (MIRT) to widely used physics conceptual assessments. This study applies MIRT analysis using both exploratory and confirmatory methods to the Brief Electricity and Magnetism Assessment (BEMA) to explore the assessment's structure and to determine a…

As online courses become increasingly common at the college level, an ongoing concern is how to ensure academic integrity in the online environment. One area that has received particular attention is that of preventing cheating during unproctored online exams. In this study, we examine students' behavior during unproctored exams taken in an online…

Science events are encountered in every phase of daily life. These science events can be encountered at home, in business life, or while studying at school. Human beings can learn about these scientific events both informally and formally. Science-related events can often be confusing, even when formally learned. This study, it was aimed to…

The low-stakes character of international large-scale educational assessments implies that a participating student might at times provide unrelated answers as if s/he was not even reading the items and choosing a response option randomly throughout. Depending on the severity of this invalid response behavior, interpretations of the assessment…

The current study assesses the effect of using Massive Open Online Courses (MOOCs) with the specific goal of providing remedial education. The data refer to an Italian flagship university, Politecnico di Milano, where a MOOC platform was launched following the strategy 'MOOCs to bridge the gaps'. Hence, the study aims at assessing the effect of…

This study revealed how the flipped learning model interacted with the learning styles of primary pre-service teachers. In addition, the impact of the flipped model on participants' science teaching course achievement and personal epistemologies was investigated. A mixed-method research design was conducted with 27 primary pre-service teachers…

Previous research has shown the validity of the Measure of Linked Concepts (MLC) assessment in college introductory chemistry. Herein, we present a novel model of pairing the MLC with a metacognitive exercise aligned with learning objectives in the introductory chemistry courses as an effective tool for instructors to be integrated into…

The objective of the present study was to investigate item-, examinee-, and country-level correlates of rapid guessing (RG) in the context of the 2018 PISA science assessment. Analyzing data from 267,148 examinees across 71 countries showed that over 50% of examinees engaged in RG on an average proportion of one in 10 items. Descriptive…