Student evaluations of teaching (SETs) are a ubiquitous feature of higher education. However, scholars have presented numerous challenges to the accuracy, validity, reliability and objectivity of SETs as a measure of teaching effectiveness. Given the potential for bias, the use of SETs in professional review may constitute a form of institutional…

Student evaluations of courses and teaching (SETs) are used for various purposes, are omnipresent in academic teaching, and cause tensions within universities. Their analytical power is contested, and specific uses are problematised for negative effects on lecturers and academic relationships. This interpretive interview study addresses how…

The validity of traditional opinion-based student evaluations of teaching (SETs) may be compromised by inattentive responses and low response rates due to evaluation fatigue, and/or by personal response bias. To reduce the impact of evaluation fatigue and personal response bias on SETs, this study explores peer prediction-based SETs as an…

Peer review is a powerful method to enhance teaching in higher education. Peers, however, may not be the most relevant people in evaluating teaching success; as the most important stakeholders in learning, students' evaluations need to be heard. Whilst some efforts to capture "the student voice" are simplistic and may foster consumerist…

Evaluation in higher education is an evolving social practice; that is, it involves what people, institutions and broader systems do and say, how they do and say it, what they value, the effects of these practices and values, and how meanings are ascribed. The textual products (verbal, written, visual and gestural) that inform and are produced by,…

RateMyProfessors.com (RMP) is becoming an increasingly popular tool among students, faculty and school administrators. The validity of RMP is a point of debate; many would argue that self-selection bias obscures the usefulness of RMP evaluations. In order to test this possibility, we collected three types of evaluations: RMP evaluations that…

We evaluate the case for using feedback iteratively, to improve student engagement and learning. In this model, students were invited to respond to tutor feedback with students' own responses. Among the three courses/modules (three tutors) studied, differences in feedback styles were evident from: (a) thematic analysis of tutor comments and, for…

A multilevel analysis approach was used to analyse students' evaluation of teaching (SET). The low value of inter-rater reliability stresses that any solid conclusions on teaching cannot be made on the basis of single feedbacks. To assess a teacher's general teaching effectiveness, one needs to evaluate four randomly chosen course implementations.…

A teacher evaluation system can be threatening to faculty, especially if used for summative decisions. Therefore, it is important to obtain valid and pertinent information. Since students are extensively exposed to course elements, students' evaluation of instruction should be one of several components in the teacher evaluation system. Since…

Many personnel committees at colleges and universities in the USA use student evaluation of faculty instruction to make decisions regarding tenure, promotion, merit pay or faculty professional development. This study examines the construct validity and internal consistency reliability of the student evaluation of instruction (SEI) used at a large…

This exploratory study investigated the students' use of formative, weekly, online evaluations of teaching through a virtual learning environment. Results were based on in-depth interviews of seven students at a rural university college in the UK. Students from different genders, education levels and backgrounds volunteered for the study. The…

This article reports and demonstrates two SPSS macros for calculating Krippendorff's alpha and intraclass reliability coefficients in repetitive situations where numerous coefficients are needed. Specifically, the reported SPSS macros were used to evaluate the interrater agreement and reliability of student evaluations of teaching in thousands of…

This paper analyses the popular RateMyProfessors (RMP) website where students evaluate instructors in higher education. A study was designed to measure (1) the awareness and utilisation of the RMP website, (2) the internal and external validity of the RMP ratings in measuring teaching effectiveness, and (3) variation in the above across…

All tertiary institutions in Australia use the same Course Experience Questionnaire (CEQ); however, for the internal evaluation of teaching they use their own surveys. This paper performs an analysis of the internal Quality of Teaching Surveys (QTS) used in Australian universities. We classify the questions within the QTS surveys. This…

The explicit purpose of gathering feedback in college classes is to improve those courses, usually along the lines of structure, organisation, pace, or some other aspect of the course over which the professor typically has control. A potential outcome that is less immediately obvious is the shift that can take place regarding who is responsible…