Summative assessment of interpretation is widely conducted in interpreting courses/programs to inform high-stakes decision making, such as the selection, certification, and conferral of academic degrees. Yet there has been very limited empirical research to investigate the score dependability of summative interpretation assessment. The present…

The speech of second language learners is often influenced by phonetic patterns of their first language. This can make them difficult to understand, but sometimes for listeners of the same first language to a lesser extent than for native listeners. The present study investigates listeners' awareness of the accent by asking whether accented speech…

Recent research suggests that designing a syllabus using learner-centered principles may increase students' perceptions of their instructor on the characteristics of rapport, caring, helpfulness, willingness to seek help from the instructor, and student motivation. Typically, a learner-centered syllabus is one that presents a positive tone at the…

Research on evaluation theories, methods, and practices has increased considerably in the past decade. Even so, little is known about whether published findings from research on evaluation are read by evaluators and whether such findings influence evaluators' thinking about evaluation or their evaluation practice. To address these questions, and…

This literature review attempts to survey representative studies within the context of L2 speaking assessment that have contributed to the conceptualization of rater cognition. Two types of studies are looked at: 1) studies that examine "how" raters differ (and sometimes agree) in their cognitive processes and rating behaviors, in terms…

In this book the authors explain how to build, and over time improve, the elements of an observation system that equips all observers to identify and develop effective teaching. It is based on the collective knowledge of key partners in the Measures of Effective Teaching (MET) project--which carried out one of the largest-ever studies of classroom…

In this study, data on grades awarded for bachelor and master theses at a large Polish university were used to identify possible discrimination on gender or physical attractiveness. The focus is on the gap between the grades awarded by the advisor (who knows the student personally) and the referee (who typically does not, so that gender is less…

This study was designed to determine how well existing analytic rating scales functioned in the assessment of low- to mid-proficiency Japanese university students' interactive English speaking ability when engaged in small group discussions. Many-facet Rasch measurement (MFRM) was employed to evaluate the quality of adapted rating scales for…

This article reports on the development and validation of a rubric for assessing students' written responses to artworks. Since the implementation of the Hong Kong New Senior Secondary Curriculum in 2009, art educators have seen responding to artworks as increasingly important. In this context, the Art Criticism Assessment Rubric (ACAR) was…

In this article the authors present the full interview conducted with George Grob in 2011 at the American Evaluation Association (AEA) Conference in Anaheim, CA. George Grob is former Director of the Office of Evaluation and Inspections in the Office of Inspector General. Prior to serving in that Office, he was Director of Planning and Policy…

Eleven years ago, this author became the director of the Idaho State Legislature's Office of Performance Evaluations. As only the second person in that role, he considered the office and its function to be still evolving and because he understood legislative leadership to be interested in seeing evaluation work that could actually…

Purpose: The purpose of this paper is to compare two years of results for one state's performance-based assessments for principal licensure Performance Assessment for Leaders (PAL). This includes the field trial (2014-2015) and first year of statewide implementation (2015-2016) when passing score requirements and fees were added. Survey results on…

Ten secondary schools in a large state-wide education system initiated a virtual school network to address the lack of upper secondary school courses for university entry in smaller high schools. This article highlights the yearlong professional learning program designed to prepare a cohort of classroom teachers, who were novices to teaching…

Past studies have shown that multimodal presentation of story can improve story-retelling performance in the first language. The purpose of the present study was to investigate whether similar multimedia effects can be observed in second language learning and graphic novel reading. A total of 51 Chinese elementary school children, aged 7-8, who…

Borrowing from a clinical psychology observational methodology, thin-slice observations were used to assess autism characteristics in toddlers. Thin-slices are short observations taken from a longer behavior stream which are assigned ratings by multiple raters using a 5-point scale. The raters' observations are averaged together to assign a…