Automated scoring of student responses to open-ended questions, including short-answer questions, has great potential to scale to a large number of responses. Recent approaches for automated scoring rely on supervised learning, i.e., training classifiers or fine-tuning language models on a small number of responses with human-provided score…

A quality management system is an essential and mandatory instrument for maritime higher education institutions mandated by the International Convention on Standards of Training, Certification, and Watchkeeping for Seafarers. To design an effective quality management system, it is strongly recommended to take the most comprehensive model of the…

This study examined the therapeutic collaboration in a case of Life Design Counseling (LDC) with narrative change and positive career outcomes. The therapeutic collaboration-change model and correspondent coding system were used to intensively study the helping relationship throughout three sessions of LDC. The collaboration coding system enables…

The importance of engaging in high quality program evaluation is a generally accepted principle underscored by external pressure from funders. High quality evaluation necessarily begins with good evaluation planning. This paper outlines Evolutionary Evaluation and specifically the Systems Evaluation Protocol, an approach that emphasizes…

Assessment is a crucial aspect of academic work. Indeed, there is substantial literature on assessment design and how to ensure the integrity of students' learning. Much work goes into enhancing assessment practices to ensure the validity of assessment to safeguard the reliability of students' knowledge. Yet relatively little research has…

This article provides results from a study of the hidden processes of consensus formation that precede and make possible official judgments and decisions of the Swedish Schools Inspectorate (SI). The research question for the study was: How is knowledge negotiated on the back stage of school inspection and presented on the front stage? The article…

This research examines how the use of the CAT (Critical thinking Assessment Test) and involvement in CAT-Apps (CAT Applications within the discipline) training can serve as an important part of a faculty development model that assists faculty in the assessment of students' critical thinking skills and in the development of these skills within…

Targeting Outcomes of Programs (TOP) is a seven-step hierarchical programming model in which the program development and performance sides are mirror images of each other. It served as a framework to identify a simple method for targeting photographic events in nonformal education programs, indicating why, when, and how photographs would be useful…

As Americans shift their work and leisure activities online, Extension seeks to remain viable by delivering programs through a website known as eXtension. eXtension is predicated on the voluntary labor of Extension specialists and educators who form Communities of Practice to create and deliver content through the website. Evaluation of eXtension…

This article focuses on ethical issues faced in evaluation practice from the viewpoint of third generation of activity theory, which gives a constructive perspective on how contradictions can be a driving force behind interorganizational learning and development in multiactor networks. The problem field is firstly addressed through an illustration…

This dissertation addresses theory and practice of evaluation and assessment in university student affairs, by applying logic modeling/program theory to a case study. I intend to add knowledge to ongoing dialogue among evaluation scholars and practitioners on student affairs program planning and improvement as integral considerations that serve…

The potential for using case examples in the education of evaluators is paralleled to the legal case method of instruction currently used in the education of law students. Ways in which such cases are used in instruction are discussed. Types of information an evaluation case history might contain are then documented and the QUEMAC acronym is…

This study consists of two parts: (1) a discussion of legal education, which uses the Socratic method of pedagogy and the study of case histories, and (2) an examination of aspects of legal education that might be used as a model for educating evaluators. (Author/JAZ)

The first stage of an evaluation and academic management project to be carried out at Bath University is presented. Included are the background to course evaluation, a proposed model, the development and testing of the model in the context of an innovative biology course at Queen's University, and the transferability of the model to other courses.…

Three exploratory studies involving 116 students examined the relevance of a developmental model for approaching supervision of graduate students in evaluation studies. The model includes three stages and eight developmental tasks in each stage. Three case studies support using the developmental model in conceptualizing student progress. (SLD)