Although most literature in relation to student teaching evaluations argue that when the administrative format is switched from paper based to online, the impact on professors' teaching scores is minimal, but faculty may still resist change from one format to another. This article describes a pilot study at a medium sized, western university whose…

This study compared the reliability and validity of student scores from paper--pencil and e-based assessments using the "maze" and "silent reading fluency" (SRF) tasks. Forty students who were deaf and hard of hearing and reading between the second and fifth grade reading levels and their teachers (n = 21) participated. For…

Few studies have examined the psychometric properties of the test-related items from the Achievement Emotions Questionnaire (AEQ). Using a sample of 955 university students, we examined the factor structure of 12 emotion items measuring test-related anger, boredom, enjoyment, and pride. Results indicated the four emotions were distinct, allowing…

This study used computerized dynamic assessment (CDA) as a teaching and assessment method to promote Chinese EFL learners' reading comprehension, with a quasi-experimental design in which the control and experimental groups were each given three tests but in different formats. Each test consisted of multiple choice questions (MCQs) selected from…

We investigated how Natural Language Processing (NLP) algorithms could automatically grade answers to open-ended inference questions in web-based eBooks. This is a component of research on making reading more motivating to children and to increasing their comprehension. We obtained and graded a set of answers to open-ended questions embedded in a…

Many institutions are making the move from pen and paper to online examinations, but the literature offers relatively few critical reflections on the ramifications of such a shift. This research presents evidence of the ways in which the social and human practices of online exams are deeply entangled with the material and technological, and…

This study provides an initial statistical approach as an alternative model to detect the fraudulent practice estimation of national examination (NE). Trends, patterns, and relationships were analysed from the national examination (NE) scores and the national examination integrity index (NEII) on pre-and post-computer-based national examination…

The difference in how humans read and how Automated Essay Scoring (AES) systems process written language leads to a situation where a portion of student responses will be comprehensible to human markers, but unable to be parsed by AES systems. This paper examines a number of pieces of student writing that were marked by trained human markers, but…

Despite common operationalization, measurement efficiency of computerized adaptive testing should not only be assessed in terms of the number of items administered but also the time it takes to complete the test. To this end, a recent study introduced a novel item selection criterion that maximizes Fisher information per unit of expected response…

The purpose of this study was to determine which remote testing systems, all designed to ensure academic integrity, offer a realistic and secure approach to online examinations and best fulfill the needs for faculty and students. This study explored the use of 3 testing tools to determine whether there are differences in test scores and student…

Measurement specialists strive to shorten assessment time without compromising precision of scores. Computerized Adaptive Testing (CAT) has rapidly gained ground over the past decades to fulfill this goal. However, parameters for implementation of CATs need to be explored in simulations before implementation so that it can be determined whether…

Background: With digital technologies, competence assessments can provide process data, such as mouse clicks with corresponding timestamps, as additional information about the skills and strategies of test takers. However, in order to use variables generated from process data sensibly for educational purposes, their interpretation needs to be…

When we administer educational achievement tests, we want to be confident that the resulting scores validly indicate what the test takers know and can do. However, if the test is perceived as low stakes by the test taker, disengaged test taking sometimes occurs, which poses a serious threat to score validity. When computer-based tests are used,…

Both assessment and feedback have a vital impact on students' learning. Using computer-based assessment (CBA) with constructive and prompt computer-based feedback (CBF) reduces the attainment gap of the new generation of digital students. Action research methodology was employed to explore students' view of utilising CBA and/or CBF in teaching and…

Assessment plays an important role in learning and Multiple Choice Questions (MCQs) are quite popular in large-scale evaluations. Technology-enabled learning necessitates a smart assessment. Therefore, automatic MCQ generation became increasingly popular in the last two decades. Despite a large amount of research effort, system generated MCQs are…