We analysed the full text of all journal articles returned to the education subpanel of the 2021 Research Excellence Framework (REF2021). Using a latent Dirichlet allocation topic model, we identified 35 topics that collectively summarise the journal articles that research units, typically schools of education, selected for submission. We found…

This article assesses the risk of two COVID-19-related changes necessary for the expert review of the REF2021's Impact criterion: the move from face to face (F2F) to virtual deliberation; and the changing research landscape caused by the COVID-19 crisis requiring an extension of deadlines, and accommodation of COVID-19-related mitigation. Peer…

The present study explores two rating methods for peer assessment (analytical rating using criteria and comparative judgement) in light of concurrent validity, reliability and insufficient diagnosticity (i.e. the degree to which substandard work is recognised by the peer raters). During a second-year undergraduate course, students wrote a one-page…

This study examines a basic assumption of peer review, namely, the idea that there is a consensus on evaluation criteria among peers, which is a necessary condition for the reliability of peer judgements. Empirical evidence indicating that there is no consensus or more than one consensus would offer an explanation for the "disagreement…

To become effective learners, students need to develop good evaluative judgment skills. Unfortunately, numerous studies find that self-evaluation estimates provided by undergraduates often differ significantly from the marks awarded by the tutor. This suggests that students either have a rather poor grasp of the assessment criteria, or they find…

The rapid shift towards online learning in higher education has transformed the landscape of essential academic skills, with presentation abilities emerging as a crucial competency for student success. This paper addresses the challenges and opportunities associated with teaching presentation skills in a distance education context. Traditional…

Securing research funding is essential for all researchers. The standard evaluation method for competitive grants is through evaluation by a panel of experts. However, the literature notes that peer review has inherent flaws and is subject to biases, which can arise from differing interpretations of the criteria, the impossibility for a group of…

Background/purpose: This study addresses the challenge of engaging students in meaningful assessment processes within mathematics education, particularly in pre-university preparatory courses. Peer assessment, a growing pedagogical practice, can enhance learning outcomes, promote critical thinking, and improve collaborative skills. However,…

In the context of the "Higher Education Standards Framework (Threshold Standards) 2021" (HES Framework), 'scholarship' refers to those activities concerned with gaining new or improved understanding, or appreciation and insights into a field of knowledge, or engaging with and keeping up to date with advances in the field. The Australian…

The allocation of scientific funding through grant programs is crucial for research advancement. While independent peer panels typically handle evaluations, their decisions can lean on personal preferences that go beyond the stated criteria, leading to inconsistencies and potential biases. Given these concerns, our study employs a novel method,…

Peer evaluation consists of the evaluation of students by their peers following criteria or rubrics provided by the teacher, where the way to evaluate students is specified so that they achieve the desired competencies. The quality of the measurement instrument must meet two essential criteria: validity and reliability. In this research, we…

Giving and receiving peer feedback is seen as an important vehicle for deep learning. Defining assessment criteria is a first step in giving feedback to peers and can play an important role in feedback providers' learning. However, there is no consensus about whether it is better to ask students to think about assessment criteria themselves or to…

Choreography is an important and challenging educational objective in dance courses. However, most previous technology-enhanced learning studies for dance education mainly focused on students' dance skills, while the issue concerning the approaches to promoting students' choreographic performance has generally been ignored. To address this issue,…

There is a growing interest in using comparative judgement as a peer assessment tool involving students choosing the 'better' of two pieces of work. However, it has not been shown whether peer assessment through comparative judgement is effective for students' learning. To gain a better understanding of the comparative judgement process, we…

Learner agency, or the ability to take control of one's own learning and the learning of others, is a substantial goal of the curricular reform across the world. This can be seen in the implementation of the 2013 curriculum (K13) in Indonesia. However, there has been little evidence regarding the ways that Indonesian teachers have engaged with…