Maintaining the quality and comparability of qualifications has become a major priority for vocational education and training (VET) systems world-wide, especially for those countries which have decentralised assessment and reporting systems. In the absence of external examinations, one policy solution to align the assessment standards of different…

Examiners' judgements play a critical role in competency-based assessments such as objective structured clinical examinations (OSCEs). The standardised nature of OSCEs and their alignment with regulatory accountability assure their wide use as high-stakes assessment in medical education. Research into examiner behaviours has predominantly explored…

This paper aims to survey the current landscape of education policy evaluation across OECD countries and economies by examining recent trends and contextual factors that can promote more robust education policy evaluation, as well as identifying key challenges. It takes a view of policy evaluation as an activity that takes place throughout the…

Oral narrative assessments are important for diagnosis of language disorders in school-age children so scoring needs to be reliable and consistent. This study explored the impact of training on the variability of story grammar scores in children's oral narrative assessments scored by multiple raters. Fifty-one speech pathologists and 19 final-year…

Doctoral examiners judge the quality of a thesis and give the student assessment feedback if the student fails to reach certain goals. This paper investigates if and how examiners take on the evaluator or teaching role. We analysed doctoral examination reports from three disciplines. Most examiners provided assessment and feedback, but this often…

Quality outcomes from vocational education and training (VET) are fundamental to ensuring a skilled workforce and supporting a productive economy. In a competency-based training system, assessment is the gatekeeper for quality. Audits undertaken by the Australian Skills and Quality Authority (ASQA) have identified concerns with compliance against…

Assessment in aesthetic fields presents a myriad of challenges in the higher education environment. This paper uses a metaphorical representation to explore the role of assessors within aesthetic assessment settings in higher education. It begins with a discussion of aesthetic fields and an exploration of the role of assessment in this area.…

Programs and policies invariably contain new knowledge. Theories about knowledge utilization, diffusion, implementation, transfer, and knowledge translation theories illuminate some mechanisms of change processes. But more often than not, when it comes to understanding patterns about change processes, "the foreground" is privileged more…

This is a mixed methods investigation of consistency in PhD examination. At its core is the quantification of the content and conceptual analysis of examiner reports for 804 Australian theses. First, the level of consistency between what examiners say in their reports and the recommendation they provide for a thesis is explored, followed by an…

Audit trail analysis can provide valuable insights to researchers and evaluators interested in comparing and contrasting designers' expectations of use and students' actual patterns of use of educational technology environments (ETEs). Sequence analysis techniques are particularly effective but have been neglected to some extent because of real…

Describes the evaluation of school librarians in Australia, including who should do the evaluating and reasons for evaluation. Questions the accuracy of perceptions of the librarian's role by some evaluators and presents a model for evaluating the library evaluators to encourage administrative support for the library. (LRW)

Evaluated external assessor ratings of the quality of the research team and the proposed research for proposals submitted to the Australian Research Council large grants program. Data from 313 evaluations show that the reliability of the assessments varied systematically with the number of assessors and the score considered. Discusses implication…

This paper specifically reports on a comprehensive evaluation of competency based assessment within the mining industry in Queensland, Australia. However, it also addresses a broader problem associated with competency-based assessment already identified in the literature. The qualitative component of the study involved 83 people, nineteen mine…

In recent years there has been a marked change in the inspector's functions, with increased emphasis on professional advice and leadership. However, it has not been possible to eliminate elements of incompatibility between the inspector's dual role of assessor and that of adviser. (Author)

A responsive illuminative approach was used to evaluate a program for training motorcycle riders. This approach provided interaction between evaluators and participants, and attempted to provide a detailed report reflecting stakeholders' views. The design, implementation, and reporting of the evaluation are described, as are implications for…