Manual composition of tasks and exams is a challenging and time-consuming task. Especially when exams are taken remotely without the personal monitoring by examiners, most exams can easily lose their integrity with the use of previously done exercises or student communication. This research introduces an approach that incorporates the principles…

This brief research report gives an overview of a visually based methodology that has recently been used to shed light on situated decision-making in a high stakes educational assessment environment. Looking carefully at the feedback interactions taking place between senior and less senior examiners, the project aim was to gain insight into the…

Technological developments are impacting upon UK assessment practices in many ways. For qualification awarding bodies, a key example of such impact is the ongoing shift towards examiners marking digitally scanned copies of examination scripts on screen rather than the original paper documents. This digitisation process has obvious benefits,…

This paper outlines the procedures used in the textual analysis of examiner reports for 101 PhD candidates across disciplines in one Australian University. The method involves the use of QSR software. Three levels of findings are outlined. The first level is the coding categories that emerged out of reading the report text. There are five broad…

One hundred and sixteen test administrators in Job Service offices throughout the United States who are currently using the automated typing test software were contacted by telephone about the software. Sixty-nine percent have used the software less than 1 year, and 21 percent have used it more than 1 year. In 78 percent of the offices, there is…

A method for understanding and controlling the multiple facets of an oral examination (OE) or other judge-intermediated examination is presented and illustrated. This study focused on determining the extent to which the facets model (FM) analysis constructs meaningful variables for each facet of an OE involving protocols, examiners, and…