Feedback can be powerful, but its effects are dependent on what students do. There has been intensive research in recent years under the banner of 'feedback literacy' to understand how to help students make the most of feedback. Although there are instruments to measure feedback literacy, they largely measure perceptions and orientations rather…

Over the last 20 years there has been significant growth in the volume of higher education pedagogical research across disciplines and national contexts, but inherent tensions in defining quality remain. In this paper we present a framework to support understanding of what constitutes internationally excellent research, drawing on a range of…

Despite its name, the halo effect in student evaluation of teaching (SET) response is not mystical. Halo in SET results from psychological processes that undermine SET validity, particularly for summative evaluation (pay decisions, etc.). These processes span psychological concepts of cognition, motivation and affect. This paper demonstrates that…

The Assessment Experience Questionnaire has been widely used to measure conditions of learning from assessment. It is one of three methods used in the 'Transforming the Experience of Students through Assessment' research process, originally funded by the Higher Education Academy to explore programme assessment patterns, and now used extensively in…

We proposed an extended form of the Govindarajulu and Barnett margin of error (MOE) equation and used it with an analysis of variance experimental design to examine the effects of aggregating student evaluations of teaching (SET) ratings on the MOE statistic. The interpretative validity of SET ratings can be questioned when the number of students…

This study examines the utility of a new method of analysing and reporting qualitative student survey comments. Visualisations of the sentiment of and key themes from qualitative student survey comments were developed for 34 subjects from two undergraduate health sciences courses undergoing transformation. The course and subject visualisation…

Scholarly debate about student evaluations of teaching (SETs) often focuses on whether SETs are valid, reliable and unbiased. In this article, we assume the most optimistic conditions for SETs that are supported by the empirical literature. Specifically, we assume that SETs are moderately correlated with teaching quality (student learning and…

Formative assessment is widely accepted as being crucial to promoting student learning and, since 2010, the UK General Medical Council has mandated its use in workplace-based clinical training for all new doctors. As a result, the Royal College of Radiologists (RCR) instituted a range of formative workplace-based assessments including the…

Although a variety of learning benefits of peer assessment have been documented, many concerns remain regarding its reliability and validity, especially for peers at early learning stages and for English as a foreign language (EFL) learners in general. Such concerns may prevent adoption of peer assessment for instruction. To help localize the…

This study uses decision tree analysis to determine the most important variables that predict high overall teaching and course scores on a student evaluation of teaching (SET) instrument at a large public research university in the United States. Decision tree analysis is a more robust and intuitive approach for analysing and interpreting SET…

According to teaching-learning theories, interventions in educational practice require a valid diagnosis of students' learning preconditions. Cognitive dispositions at the beginning of studies are the strongest predictor of knowledge acquisition. In the context of increasing numbers of beginning students with heterogeneous preconditions, valid…

To advance the discussion on the validity of student evaluations of university teaching, student ratings of two teaching dimensions -- student involvement and rapport -- were compared with corresponding observer ratings. Seven potential bias variables were tested with regard to their impact on the students' teaching assessment: three teacher…

This article presents an empirical evaluation of the validity and reliability of a peer-assessment activity to improve academic writing competences. Specifically, we explored a large group of psychology undergraduate students with different initial writing skills. Participants (n = 365) produced two different essays, which were evaluated by their…

The student evaluation of teaching process is generally thought to produce reliable results. The consistency is found within class and instructor averages, while a considerable amount of inconsistency exists with individual student responses. This paper reviews these issues along with a detailed examination of common measures of reliability that…

Effective teamwork skills are essential for success in an increasingly team-based workplace. However, research suggests that there is often confusion concerning how teamwork is measured and assessed, making it difficult to develop these skills in undergraduate curricula. The goal of the present study was to develop a sustainable tool for assessing…