The use of e-assessment methods raises important concerns regarding the reliability and validity of these methods. Potential threats to validity include mode effects and the possible influence of computer-related attitudes. Although numerous studies have now investigated the validity of online assessments in noncourse-based contexts, few studies…

Log files from computer-based assessment can help better understand respondents' behaviours and cognitive strategies. Analysis of timing information from Programme for the International Assessment of Adult Competencies (PIAAC) reveals large differences in the time participants take to answer assessment items, as well as large country differences…

Technology use is increasing in higher education, particularly for test administration. In this study, Capaldi's (1994) sequential theory, which postulates that the specific order of reinforcements and nonreinforcements influences persistence in the face of difficulty or failure, was applied to online multiple choice testing situations in regard…

COVID-19 has upset the traditional ways of teaching and looks set to continue to have an impact in the coming years. The situation in Taiwan--partial disruption and then an early return to classes--allows for a comparison of student performance in a conventional teaching and testing environment with the non-contact teaching/testing environment…

Considerable research effort has been devoted to investigating semantic priming effects, particularly, the locus of those effects. Semantically related primes might activate their target's lexical representation (through automatic spreading activation at short stimulus onset asynchronies (SOAs), or through generation of words expected to follow…

In large-scale educational assessment data consistent with a simple-structure multidimensional item response theory (MIRT) model, where every item measures only one latent variable, separate unidimensional item response theory (UIRT) models for each latent variable are often calibrated for practical reasons. While this approach can be valid for…

This study focused on student-content interactions and engagement in an online graduate course. Student descriptions of their experiences and learning processes in relation to digital course resources were examined to understand how and why resources were used. Fourteen students provided detailed explanations of their use and perceived value of…

The resources and time constraints of assessing large classes are always weighed up against the validity, reliability, and learning outcomes of the assessment tasks. With the digital revolution in the 21st Century, educators can benefit from computer technology to carry out a large-scale assessment in higher education more efficiently. In this…

The current study examined the relationship between test-taker cognition and psychometric item properties in multiple-selection multiple-choice and grid items. In a study with content-equivalent mathematics items in alternative item formats, adult participants' tendency to respond to an item was affected by the presence of a grid and variations of…

We argue that examples can do more than serve the purpose of illustrating the truth of an existential statement or disconfirming the truth of a universal statement. Our argument is relevant to the use of technology in classroom assessment. A central challenge of computer-assisted assessment is to develop ways of collecting rich and complex data…

This paper reports our work on replacing lab report grading by post-online lab quizzes using Desire2Learn (D2L, an online course management software), specifically, how we circumvent some of the limitations imposed by D2L and the outcomes.

The purpose of this article is to support members of a student's multidisciplinary team to identify complex factors involved in providing valid classroom-based assessment data, including issues surrounding technology-based assessment for students who are deaf or hard of hearing (DHH). The diversity of this population creates unique challenges in…

Formative feedback plays an important role in assisting students in their learning process. However, administering information about student weaknesses and strengths is one of the challenges faced by teachers when implementing formative assessment. This study aims to develop a web-based formative feedback system that is able to provide specific…

Background: The need to focus more on children's abilities to change requires new assessment technologies in education. Process-oriented assessment can be useful in this regard. Dynamic testing has the potential to provide in-depth information about children's learning processes and cognitive abilities. Aim: This study implemented a…

The present study focuses on the integration of an automatic question generation (AQG) system and a computerised adaptive test (CAT). We conducted two experiments. In the first experiment, we administered sets of questions to English learners to gather their responses. We further used their responses in the second experiment, which is a…