One of the main generic competencies in Higher Education is "Learning to Learn". The key component of this competence is the capacity for self-regulated learning (SRL). For this competence to be developed, peer feedback seems useful because it fosters evaluative judgement. Following the principles of peer feedback processes, an online…

Automated scoring of free drawings or images as responses has yet to be used in large-scale assessments of student achievement. In this study, we propose artificial neural networks to classify these types of graphical responses from a TIMSS 2019 item. We are comparing classification accuracy of convolutional and feed-forward approaches. Our…

Rating scales for writing assessment are critical in that they determine directly the quality and fairness of such performance tests. However, in many EFL contexts, rating scales are made, to certain extent, based on the intuition of teachers who strongly need a feasible and scientific route to guide their construction of rating scales. This study…

We evaluate two reforms that modified the procedures of recruitment and promotion in Italian academia to balance the preeminent role of the recruiting school and to counter nepotism. We theoretically derive the decision rule of the evaluation committees and test it against data including information from all selections to associate and full…

The importance of engaging in high quality program evaluation is a generally accepted principle underscored by external pressure from funders. High quality evaluation necessarily begins with good evaluation planning. This paper outlines Evolutionary Evaluation and specifically the Systems Evaluation Protocol, an approach that emphasizes…

In this research report, we describe the design and empirical findings for a large-scale study of essay writing ability with approximately 2,500 high school students in Germany and Switzerland on the basis of 2 tasks with 2 associated prompts, each from a standardized writing assessment whose scoring involved both human and automated components.…

King Abdulaziz University (KAU) took extra measures in response to COVID-19 in March 2020. The current research evaluated an Emergency Training Session (ETS) Knowledge Model during the pandemic with the aim of identifying for the Deanship of e-Learning and Distance Education (DeLDE) to evaluate how the e-learning services support learning and…

This research aimed to develop an appropriate module based on the writing needs of the learners. The author took the fourth-semester learners of the English Department at the State Islamic Institute of Palopo in the academic year 2018/2019. The author involved 40 learners as her participants. The method of the research was Research and…

Assessment is a crucial aspect of academic work. Indeed, there is substantial literature on assessment design and how to ensure the integrity of students' learning. Much work goes into enhancing assessment practices to ensure the validity of assessment to safeguard the reliability of students' knowledge. Yet relatively little research has…

Written communication skills are one of the most assessed criteria in higher education contexts, especially in humanities disciplines, including teacher education. There is a need to research and develop an assessment grading tool (i.e. criteria sheet or rubric) that would assist students in pre-service teacher education programs to better…

This article provides results from a study of the hidden processes of consensus formation that precede and make possible official judgments and decisions of the Swedish Schools Inspectorate (SI). The research question for the study was: How is knowledge negotiated on the back stage of school inspection and presented on the front stage? The article…

In this study, we examined whether interpreters and interpreting trainees are better predisposed to respeaking than people with no interpreting skills. We tested 57 participants (22 interpreters, 23 translators and 12 controls) while respeaking 5-minute videos with two parameters: speech rate (fast/slow) and number of speakers (one/many). Having…

In many less developed democracies Voluntary Organizations for Professional Evaluation (VOPEs) face the challenges of low demand for evaluation and the resulting low economic capacity of national evaluation communities. The VOPE model that evolved in well-developed democracies is not directly applicable under these circumstances, so a new model…

Evaluation capacity building (ECB) has become an area in the evaluation field that is attracting both scholarly attention and the practical work of evaluators. Despite some recent contributions, differing conceptions still exist concerning what constitutes ECB, let alone the nature of the capacity being built. Responding to an earlier call on the…

Continuing professional development (CPD) evaluation in education has been heavily influenced by "level models", deriving from the work of Kirkpatrick and Guskey in particular, which attempt to trace the processes through which CPD interventions achieve outcomes. This paper considers the strengths and limitations of such models, and in…