In large-scale educational assessment data consistent with a simple-structure multidimensional item response theory (MIRT) model, where every item measures only one latent variable, separate unidimensional item response theory (UIRT) models for each latent variable are often calibrated for practical reasons. While this approach can be valid for…

This study focused on student-content interactions and engagement in an online graduate course. Student descriptions of their experiences and learning processes in relation to digital course resources were examined to understand how and why resources were used. Fourteen students provided detailed explanations of their use and perceived value of…

The resources and time constraints of assessing large classes are always weighed up against the validity, reliability, and learning outcomes of the assessment tasks. With the digital revolution in the 21st Century, educators can benefit from computer technology to carry out a large-scale assessment in higher education more efficiently. In this…

The current study examined the relationship between test-taker cognition and psychometric item properties in multiple-selection multiple-choice and grid items. In a study with content-equivalent mathematics items in alternative item formats, adult participants' tendency to respond to an item was affected by the presence of a grid and variations of…

We argue that examples can do more than serve the purpose of illustrating the truth of an existential statement or disconfirming the truth of a universal statement. Our argument is relevant to the use of technology in classroom assessment. A central challenge of computer-assisted assessment is to develop ways of collecting rich and complex data…

This paper reports our work on replacing lab report grading by post-online lab quizzes using Desire2Learn (D2L, an online course management software), specifically, how we circumvent some of the limitations imposed by D2L and the outcomes.

The purpose of this article is to support members of a student's multidisciplinary team to identify complex factors involved in providing valid classroom-based assessment data, including issues surrounding technology-based assessment for students who are deaf or hard of hearing (DHH). The diversity of this population creates unique challenges in…

Formative feedback plays an important role in assisting students in their learning process. However, administering information about student weaknesses and strengths is one of the challenges faced by teachers when implementing formative assessment. This study aims to develop a web-based formative feedback system that is able to provide specific…

Background: The need to focus more on children's abilities to change requires new assessment technologies in education. Process-oriented assessment can be useful in this regard. Dynamic testing has the potential to provide in-depth information about children's learning processes and cognitive abilities. Aim: This study implemented a…

The present study focuses on the integration of an automatic question generation (AQG) system and a computerised adaptive test (CAT). We conducted two experiments. In the first experiment, we administered sets of questions to English learners to gather their responses. We further used their responses in the second experiment, which is a…

Despite the increased research interest on the implementation of Open Book Open Web exams in developed countries, there has been very little systematic studies that investigated the difference in gender experience and the cognitive process that could affect attitude towards OBOW exams compared to the traditional ones in developing countries. This…

The COVID-19 pandemic has led to rapid change, unprecedented in higher education. One such change has been the almost complete shift to online assessment. The simultaneous employment of online assessment and proctoring has not enjoyed the rigorous academic debate and research traditionally associated with such shifts in academia. This engagement…

School readiness is recognized as one of the key starting points for children's further success in their school work and in their subsequent career. However, many kindergarten teachers still miss and long for a comprehensive, reliable and standardized diagnostic tool which could help them recognize the level of children's school readiness. That is…

Background: Examinees may not make enough effort when responding to test items if the assessment has no consequence for them. These disengaged responses can be problematic in low-stakes, large-scale assessments because they can bias item parameter estimates. However, the amount of bias, and whether this bias is similar across administrations, is…

The use of accommodations is often recommended to remove barriers to academic testing among English Learners (ELs). However, it is unclear whether accommodations are particularly effective at improving ELs' test scores. A growing foundation of empirical work has explored this topic. We conducted a meta-analysis that examined several possible…