Despite its name, the halo effect in student evaluation of teaching (SET) response is not mystical. Halo in SET results from psychological processes that undermine SET validity, particularly for summative evaluation (pay decisions, etc.). These processes span psychological concepts of cognition, motivation and affect. This paper demonstrates that…

Over the past two decades, curricula in higher education have increasingly incorporated collaborative learning. However, due to (a) large variations in students' domain-specific abilities (e.g. knowledge and/or skills) and the effort they invest into the collaboration and (b) teachers' limited knowledge about how to assess collaborative learning,…

In today's market-driven educational culture, universities are coming under increasing pressure to justify funding through the disclosure of measurable outcomes in education and research. One educational objective that receives particular attention is critical thinking, regarded as an essential skill in both academic and work environments. The…

Peer assessment in higher education has been studied for decades. Despite the substantial amount of research carried out, peer assessment has yet to make significant advances. This review identifies themes of recent research and highlights the challenges that have hampered its advance. Most of these challenges arise from the manual nature of peer…

Portfolio assessment (PA) has been extensively adopted for writing development in the past three decades. Much research on PA primarily investigates students' and teachers' perceptions of its benefits, and how it influences students' motivation and general writing abilities. Despite its purported effectiveness, not much has been…

There have been calls in the literature for changes to assessment practices in higher education, to increase flexibility and give learners more control over the assessment process. This article explores the possibilities of allowing student choice in the format used to present their work, as a starting point for changing assessment, based on…

Evaluating the level of degree programmes became crucial with the Bologna Agreement in 1999 when European ministers agreed to implement common bachelor's and master's degree programmes and a common system of quality assurance. The European Quality Assurance system demands evaluation of the degree programme level based on valid and reliable…

Student evaluation of teaching (SET) is now commonplace in many universities internationally. While much effort has been devoted to examining the statistical validity of SET instruments, there has been limited examination of the methodological and consequential validity (together referred to as "utility") of the ways in which SET data…

The aim of this study was to assess the effect of the introduction of peer review processes on the quality of multiple-choice examinations in the first three years of an Australian medical course. The impact of the peer review process and overall quality assurance (QA) processes were evaluated by comparing the examination data generated in earlier…

This paper examines the stability and validity of a student evaluations of teaching (SET) instrument used by the administration at a university in the PR China. The SET scores for two semesters of courses taught by 435 teachers were collected. Total 388 teachers (170 males and 218 females) were also invited to fill out the 60-item NEO Five-Factor…

This paper analyses the popular RateMyProfessors (RMP) website where students evaluate instructors in higher education. A study was designed to measure (1) the awareness and utilisation of the RMP website, (2) the internal and external validity of the RMP ratings in measuring teaching effectiveness, and (3) variation in the above across…

This article uses the case of designing a new course questionnaire to discuss the issues of validity, reliability and diagnostic power in good questionnaire design. Validity is often not well addressed in course questionnaire design as there are no straightforward tests that can be applied to an individual instrument. The authors propose the…

This paper critically reviews the empirical research on the use of rubrics at the post-secondary level, identifies gaps in the literature and proposes areas in need of research. Studies of rubrics in higher education have been undertaken in a wide range of disciplines and for multiple purposes, including increasing student achievement, improving…

The argument made in this essay is that it is necessary to theorize a form of assessment--the academic viva in higher education. It is threatened with extinction because of its high cost compared with written exams, multiple choice and other forms of assessment. However, little empirical research, both in Norway and internationally, has been…

Japanese universities' total capacity to accommodate new entrants will reach 100% before 2009. Partly to attract students as "courted customers" (Kitamura 1997, 147), and, with a growing trend towards university accountability and assessment to meet the needs of homogeneously skilled students with diverse study backgrounds,…