Agreement statistics and measures of prediction accuracy are often used to assess the quality of two measures of a construct. Agreement statistics are appropriate for measures that are supposed to be interchangeable, whereas prediction accuracy statistics are appropriate for situations where one variable is the target and the other variables are…

Designing a multidimensional adaptive test (M-MST) based on a multidimensional item response theory (MIRT) model is critical to make full use of the advantages of both MST and MIRT in implementing multidimensional assessments. This study proposed two types of automated test assembly (ATA) algorithms and one set of routing rules that can facilitate…

The COVID-19 outbreak has an impact on the provision of education. One of them is the process of online assessment or examination. Difficulties occur during online exams; weak supervision can increase cheating behavior among students. Generally, teachers or lecturers think about how to prevent this behavior. However, what if they are allowed to…

In an article published in an open-access journal, (Pennebaker et al. "PLoS One," 8(11), e79774, 2013) reported that an innovative computer-based system that included daily online testing resulted in better student performance in other concurrent courses and a reduction in achievement gaps between lower and upper middle-class students.…

International large-scale assessments such as PISA or PIAAC have started to provide public or scientific use files for log data; that is, events, event-related attributes and timestamps of test-takers' interactions with the assessment system. Log data and the process indicators derived from it can be used for many purposes. However, the intended…

Competence development and measurement are of great interest to vocational education and training (VET). Although there are many instruments available for measuring competence in diverse settings, in many cases, the completed steps of validation are neither documented nor made transparent in a comprehensible manner. Understanding what an…

There have been giant leaps in the field of education in the past 1-2 years. Schools and colleges are transitioning online to provide more resources to their students. The COVID-19 pandemic has provided students more opportunities to learn and improve themselves at their own pace. Online proctoring services (part of assessment) are also on the…

When colleges and universities quickly moved their classes online last March, many faculty members gave students the option of pass/fail (P/F) grading. Usually P/F implies a student must reach the minimum passing grade of D to be awarded a P. This brings up the question of what passing a course with a D means. How much of the course material did…

Scoring essays is generally an exhausting and time-consuming task for teachers. Automated Essay Scoring (AES) facilitates the scoring process to be faster and more consistent. The most logical way to assess the performance of an automated scorer is by measuring the score agreement with the human raters. However, we provide empirical evidence that…

Twenty-three college students participated in two studies evaluating an application designed to measure stimulus overselectivity in pictures depicting facial affect. We analyzed whether this application worked as designed by evaluating whether it could provide a robust analysis of the types of errors users make (e.g., by matching by the top…

This study analyzes the effect of the i-Ready program on Yorkship Family School kindergarteners and focuses on educating kindergarteners on computer-use, to tackle the i-Ready program. The i-Ready program makes it easier for the teachers to specialize in their instructions to each student and enhance effectiveness (Fokides & Zachristou, 2020).…

Instructor feedback strategies play a key role in the learning acquisition process, especially in online environments. In addition, educational improvement and reform cannot occur without timely and effective assessment approaches. This study, grounded on Bandura's 1967 "self-efficacy and social cognitive theory," focused on identifying…

This study was conducted to reveal potential sources of students' difficulty and misconceptions about geometrical concepts with the help of eye tracking. In this study, the students' geometrical misconceptions were explored by answering the questions on the geometry test prepared based on the literature and test-taking processes and represented…

Educational tools like EdPuzzle, PlayPosit, and Kaltura have gained recent attention, as they purportedly empower educators to incorporate questions, quizzes, and discussions into instructional videos. However, there is no empirical evidence on how or under what circumstances these platforms may impact students' learning. A quasi-experimental…

Innovation courses are needed in higher education to meet workforce demands and prepare students for societal challenges. Assessment of outcomes can be challenging in innovation courses, particularly those that leverage diversity to drive innovation. The authors report on assessment methods in one such course at a public university using the…