This study explored the relationships between English language proficiency and performance in online, asynchronous science courses. Each participant completed a Language Background Questionnaire (LBQ) to indicate if English was not their native language, thus categorizing them as an English Language Learner (ELL). The Combined English Language…

Classical automated test assembly (ATA) methods assume fixed and known coefficients for the constraints and the objective function. This hypothesis is not true for the estimates of item response theory parameters, which are crucial elements in test assembly classical models. To account for uncertainty in ATA, we propose a chance-constrained…

During the pandemic, the use of question pools for online testing was recommended to mitigate cheating, exposing multitudes of science, technology, engineering, and mathematics (STEM) students across the globe to this practice. Yet instructors may be unfamiliar with the ways that seemingly small changes between questions in a pool can expose…

To test the hypothesis that students who complete remote online tests experience an 'online grade penalty', we compared performance outcomes of second-year students who elected to complete exams online to those who completed face-to-face, paper-based tests in an organic chemistry course. We pursued the following research questions: (RQ1) Are there…

In a technology-enhanced learning environment and underpinned by a unique hybrid pedagogic model that borrows from gamification, constructivism, and experiential learning approaches, badges were purposefully used to foster engagement. This approach promoted the development of a mindset that identifies and appreciates the worth of a portfolio of…

The current assessment is demanding for a more personalised and less-time consuming testing environment. Computer Adaptive Testing (CAT) is seemed as a more effective alternative testing method in comparison to conventional test in meeting the current standard of assessment. This research reports on the calibration of the released Grade 8 Science…

This study examined students' voluntary use of digital self-assessment quizzes as a resource for learning in a large anatomy and physiology lecture course. Students (n = 238) could use 16 chapter quizzes and four analogous unit quizzes to rehearse and self-assess knowledge. Most students (75%) engaged in occasional use of self-assessment quiz…

Over the last two decades, the educational use of digital devices, including digital assessments, has become a regular feature of teaching in primary education in the Netherlands. However, researchers have not reached a consensus about the so-called "mode effect," which refers to the possible impact of using computer-based tests (CBT)…

This study describes the impact of embedding dynamic computer visualization (DCV) in an online instrument that was designed to assess students' understanding of osmosis. The randomized posttest-only control group research was designed to compare the effect and the perceived helpfulness of the integration of DCV before and after the administration…

We developed a hands-on course in molecular biology for undergraduate underrepresented in medicine (URM) students. To incentivize student preparation for team-based learning (TBL) activities, we implemented a novel grading schema that requires a minimum individual readiness assurance test (iRAT) score to share the team group readiness assurance…

Background: TIMSS 2019 is the first assessment in the TIMSS transition to a computer-based assessment system, called eTIMSS. The TIMSS 2019 Item Equivalence Study was conducted in advance of the field test in 2017 to examine the potential for mode effects on the psychometric behavior of the TIMSS mathematics and science trend items induced by the…

TIMSS (Trends in International Mathematics and Science Study) is a long-standing international assessment of mathematics and science at the fourth and eighth grades that has been collecting trend data every four years since 1995. About 70 countries use TIMSS trend data for monitoring the effectiveness of their education systems in a global…

The primary aim of the study was to examine whether performance on a science assessment in an immersive virtual environment was associated with changes in scientific inquiry self-efficacy. A secondary aim of the study was to examine whether performance on the science assessment was equitable for students with different levels of computer game…

A new vision of science learning described in the "Next Generation Science Standards"--particularly the science and engineering practices and their integration with content--pose significant challenges for large-scale assessment. This article explores what might be learned from advances in large-scale science assessment and…

Although International Association for the Evaluation of Educational Achievement-pioneered international large-scale assessment (ILSA) of education is now a well-established science, non-practitioners and many users often substantially misunderstand how large-scale assessments are conducted, what questions and challenges they are designed to…