Automated scoring of student responses to open-ended questions, including short-answer questions, has great potential to scale to a large number of responses. Recent approaches for automated scoring rely on supervised learning, i.e., training classifiers or fine-tuning language models on a small number of responses with human-provided score…

The rise in the use of scientific evidence as a basis for educational policymaking has been a noticeable feature globally. In this study, we describe and discuss how educational research is used to make policy and governing evidence-based. To illustrate this, we use the Swedish Schools Inspectorate (SSI) as a case and focus on two of the processes…

Researchers frequently evaluate rater judgments in performance assessments for evidence of differential rater functioning (DRF), which occurs when rater severity is systematically related to construct-irrelevant student characteristics after controlling for student achievement levels. However, researchers have observed that methods for detecting…

Program reviews are standard practice in higher education. Yet, due to the infancy of the leadership discipline, little is known about the process of conducting reviews of leadership programs. Through interviewing 13 experienced leadership program reviewers in both curricular and co-curricular contexts, the authors of this study aim to address…

A quality management system is an essential and mandatory instrument for maritime higher education institutions mandated by the International Convention on Standards of Training, Certification, and Watchkeeping for Seafarers. To design an effective quality management system, it is strongly recommended to take the most comprehensive model of the…

This article presents experiences and conclusions of an audit approach that focuses on the thesis that universities can gain most from external impulses when actively acquired and adapted by participants. This approach dubbed 'collegial audit' refers to the idea of autopoietic systems according to Luhmann and the consideration that systems do not…

This article explores issues that had to be confronted over a three-year period in terms of two New York State funded grants for which I was the evaluator. Major, critical challenges are presented, described, and discussed. Specifically, the paper addresses issues related to lack of planning at the grant design stage that resulted in challenges…

In classroom learning, students need mathematical cognitive flexibility to be able to solve mathematical problems with the various ideas they express. To solve the problems, they must be able to grasp the problem, see it from various points of view, and should not be rigid thinking with one solving method. In fact, the students still lack the…

Evaluations are practiced in political contexts, posing ethical dilemmas to evaluators. It is important, therefore, to prepare evaluation students for ethical decision-making in their future evaluative work. This study explores the use of scenario-based moral reasoning and ethical argumentation as an instructional strategy for teaching evaluation…

This study examined the therapeutic collaboration in a case of Life Design Counseling (LDC) with narrative change and positive career outcomes. The therapeutic collaboration-change model and correspondent coding system were used to intensively study the helping relationship throughout three sessions of LDC. The collaboration coding system enables…

This study aimed at establishing the impact of extra lessons on the political field in Zimbabwean urban day high-density secondary schools. It was guided by the interpretivist perspective based on the interpretation of interactions and social meaning that teachers, learners, parents, and school inspectors assigned to the role of extra lessons on…

Overseas students who have learned English as a second or foreign language (L2) form a prominent subgroup of research students in Australian universities. However, there is a paucity of research exploring the linguistic experiences of this population in connection with thesis examination and in comparison with first language users of English (L1).…

Evaluators play a central role in assessments of researchers' performance for reward, but the nature of their role and influence is not well understood. Ongoing reliance on evaluator judgement is typically justified as a need for referees in contests for reward, because quantitative performance measures alone can be subject to distortion. Yet, if…

Throughout Europe, school inspection has become a visible means of governing education. This education and inspection policy is mediated, brokered, interpreted, and learned through networked activities where the global/European meet the national/local, giving national and local "uptake" a variety of characteristics. We explore the local…

A large data set of L1 psycholinguistic norms (Balota "et al." 2007) was used to assess spoken L2 English lexical proficiency in cross-sectional and longitudinal learner corpora. Behavioral norms included lexical decision and word naming latencies (i.e. reaction times) and accuracies for 40,481 English words. A frequency measure was…