The aim of the study was to develop a cost-effective form of online proctoring mechanism that can serve as a scalable and secure solution to cater to high-stake assessments in institutions, with a particular focus on attaining high levels of flexibility and user-friendliness. With reference to existing systems, a self-proctored mechanism is…

[This paper is part of the Focused Collection in Artificial Intelligence Tools in Physics Teaching and Physics Education Research.] Using a high-stakes thermodynamics exam as the sample (252 students, four multipart problems), we investigate the viability of four workflows for AI-assisted grading of handwritten student solutions. We find that the…

This research study focuses on the growing concern of academic misconduct in distance education courses. A quasi-experimental study was conducted to measure the impact of introducing webcam recording software as an online supervision tool for high-stakes exams in two separate online courses (Management and Accounting). Results revealed that…

The ways teachers converse about their work in relation to information and communications technologies (ICTs) are worth studying. We analyse how a teacher converses about her local practices in relation to two spreadsheet algebra programs (SAPs) on variables. During the conversations we noticed that the teacher keeps different policy documents --…

In many high-stakes testing situations, test-takers are not allowed to draw on external writing resources while writing, a practice observed more frequently in classroom settings. This may pose problems with the representativeness of test tasks and score interpretations. This study investigates the domain definition of one particular test known as…

Nonverbal behavior can impact language proficiency scores in speaking tests, but there is little empirical information of the size or consistency of its effects or whether language proficiency may be a moderating variable. In this study, 100 novice raters watched and scored 30 recordings of test takers taking an international, high stakes…

Individuals are controlled by tests in every advanced society when they want to be admitted in educational courses, to proceed from one stage to the next, or to be given a certificate (Shohamy, 2001b). Accordingly, the present study was carried out to construct and validate educational, social, and psychological consequences questionnaires of…

High-stakes, standardized testing plays an important role in the lives of many students as they apply to college and compete for scholarships. In states where college readiness measures, like the ACT® test, are used for school and district accountability, the ACT scores of all students, whether college-bound or not, are a top priority for school…

Neoliberal discourses defining and measuring "student achievement" and "teacher success" through myopic high-stakes testing-driven criteria for "accountability," can perpetuate the very inequities these reforms purport to address. Nested within a five-year inquiry using grounded theory to investigate experiences of…

As online programs at conventional universities continue to expand, administrators and faculty face new challenges. Academic dishonesty is nothing new, but an online testing environment requires different strategies and tactics from what we have had to consider in the past. Our university has recently adapted successful face-to-face programs in…

This brief research report gives an overview of a visually based methodology that has recently been used to shed light on situated decision-making in a high stakes educational assessment environment. Looking carefully at the feedback interactions taking place between senior and less senior examiners, the project aim was to gain insight into the…

The analysis of classroom observation data is seen as increasingly important in research on the impact of high-stakes language tests or new foreign-language programmes on students, teachers and other stakeholders. Video-recordings of language teaching and learning in classrooms impacted by such tests or programmes can provide revealing data,…

Automated Essay Scoring (AES) is defined as the computer technology that evaluates and scores the written prose (Shermis & Barrera, 2002; Shermis & Burstein, 2003; Shermis, Raymat, & Barrera, 2003). AES systems are mainly used to overcome time, cost, reliability, and generalizability issues in writing assessment (Bereiter, 2003; Burstein,…

The IADIS CELDA 2012 Conference intention was to address the main issues concerned with evolving learning processes and supporting pedagogies and applications in the digital age. There had been advances in both cognitive psychology and computing that have affected the educational arena. The convergence of these two disciplines is increasing at a…