The assessment process in higher education considers four aspects: assessment agents, procedure, content, and scoring. In this study, we delve into the who. We analyze the role of transversal competence assessment agents in the framework of professional internships in university master's degree programs, comparing the suitability of their…

The practice of second language (L2) speech perception has traditionally relied on equal-interval perceptual scales and novice listeners' (NLs) impressionistic judgments of constructs such as accentedness and comprehensibility (Munro & Derwing, 2011). However, issues have surfaced with respect to how well NLs can use these scales, whether they…

The factors that influence rater scoring have been a subject of great interest to researchers in second language assessment. However, the research on the impact of test-takers' speech profiles (e.g., a jagged or a flat profile reflecting analytic subscores) on raters' scoring behaviors remains to be seen. To investigate the role of speech profiles…

This paper explores the concept of dynamically generating definitions using a deep-learning model. We do this by creating a dataset that contains definition entries and contexts associated with each definition. We then fine-tune a GPT-2 based model on the dataset to allow the model to generate contextual definitions. We evaluate our model with…

Implementation fidelity data indicate to what extent the delivered educational intervention (e.g., pedagogies, curricula) differs from the designed intervention (Gerstner & Finney, 2013; O'Donnell, 2008). Fidelity data help practitioners make more accurate inferences regarding program effectiveness (Dumas, Lynch, Laughlin, Smith, & Prinz,…

In an era of ever-deepening budget cuts and a concomitant demand for substantiated programs, many organizations have elected to conduct internal program evaluations. Internal evaluations offer advantages (e.g., enhanced evaluator program knowledge and ease of data collection) but may confront important challenges, including credibility threats,…

This chapter introduces the idea of school inspectors as implementers of public policy, framing their role within the context of policy implementation and the governance of education. Using a framework for policy implementation developed by Weible and Sabatier (Handbook of public policy analysis. Taylor and Francis, London, pp. 123-136, 2006), it…

This chapter focuses on the governing work of Swedish school inspectors with regards to the role and function of knowledge. As professionals, inspectors are situated as relays and brokers of policy standing in contact with both the political arena and practice arenas. School inspectors use and produce knowledge and they rely on, search for,…

Purpose: Spoken language serves as a primary means of social interaction, but speech and language skills change with age, a potential source of age-related stereotyping. The goals of this study were to examine how accurately age could be estimated from language samples, to determine which speech and language cues were most informative, and to…

To progress as a field, evaluators must be able to describe their work to nonevaluators, and to persuade an audience they have something unique and valuable to offer. Yet anecdotal reports suggest many evaluators have difficulty describing their work. Through 42 interviews with practicing evaluators, we aimed to better understand evaluators'…

Although research on evaluation instruction has increased in the past decade, little is known about evaluation education in Council on Education for Public Health (CEPH)-accredited schools of public health and master of public health (MPH) programs. In this study, instruction of competencies for program evaluators as enumerated by Stevahn, King,…

Rater cognition or "think-aloud" studies have historically been used to enhance rater accuracy and consistency in writing and language assessments. As assessments are developed for new, complex constructs from the "Next Generation Science Standards (NGSS)," the present study illustrates the utility of extending…

The use of translation and interpreting (T&I) in the language learning classroom is commonplace, serving various pedagogical and assessment purposes. Previous utilization of T&I exercises is driven largely by their potential to enhance language learning, whereas the latest trend has begun to underscore T&I as a crucial skill to be…

This study investigates the effect of explicit teaching of segmentals vs. prosody on the quality of interpreting by Farsi-to-English interpreter trainees. Participants were native speakers of Farsi and BA students of English translation and interpreting in Iran, who were assigned to one of three groups. No differences in English language skills…

In this article, we focus on a set of remote activities regarding simulated juries, judges' evaluations, communication of verdicts, and a post-discussion conversation. These activities aimed to promote learning of the preservice teachers about the differences between remote and in-person teaching in a chemistry teaching methods course. The set of…