Capturing progression in students' formal knowledge and employability skills is essential in higher education but evokes questions concerning how to assess and monitor progression. While methods for capturing students' formal knowledge progression have traditionally been at the forefront, methods for capturing employability skills have been less…

This study investigated teacher evaluation practices used in Indiana as the state was implementing a mandated teacher evaluation system (Public Law 90) and early reporting of subsequent teacher effectiveness results by the Indiana Department of Education. The study surveyed public school administrators: (a) superintendents, (b) special education…

This study examines language attitudes towards different varieties of English through listener judgments of speaker and speech traits; in addition, the study explores the relationship of these judgments to the intelligibility, as well as the perceived accentedness and comprehensibility, of varieties of Asian English and General American English.…

In writing assessment, finding a valid, reliable, and efficient scale is critical. Appropriate scales, increase rater reliability, and can also save time and money. This exploratory study compared the effects of a binary scale and an analytic scale across teacher raters and expert raters. The purpose of the study is to find out how different scale…

Background: A strong interest in researching World Englishes (WE) in relation to language assessment has become an emerging theme in language assessment studies over the past two decades. While research on WE has highlighted the status, function, and legitimacy of varieties of English language, it remains unclear how raters respond to the results…

Studies of interaction in speaking assessment have highlighted problems regarding the unequal distribution of interaction patterns in interviews versus paired formats (Van Lier, 1989; Young & He, 1998). These studies, however, only looked at verbal interaction features, and no attempts in these studies were made to investigate both verbal and…

Assessing writing is a demanding task. If a lecturer of writing is not prepared with a reliable scoring rubric, the students' real performance might not be known. One of the well-known English as a second language (ESL) writing rubric is the Jacobs ESL Composition Profile which was developed by Jacobs, Zingraf, Wormuth, Hartfiel, & Hughey in…

Rater subjectivity has long been an intriguing topic. The use of discussion as a resolution method is a practical way to reduce this subjectivity. However, the efficacy of discussion depends on whether different raters get equally engaged in it or one rater tends to dominate others. This study investigated whether and how rater dominance occurs in…

The present study aims to reveal the effects of test type, pronunciation and proficiency levels of the students on speaking test scores. A total of 147 Turkish EFL students consisting of 38 beginner, 36 elementary, 37 pre-intermediate and 36 intermediate levels participated in the study. Presentation as planned, and paired speaking test as…

Assessment in special education is a shared practice by a number of professionals. Educational diagnosticians are one such group of licensed professionals who assess students to determine eligibility and service recommendations. This study examined educational diagnosticians' perceptions of their role in fostering home--school collaborations. In…

Districts nationwide have increased the frequency of teacher evaluations. Yet, we know little about the role of evaluator feedback for teacher improvement. Using unique classroom observation-level data, we use evaluator ratings and teacher self-assessments of teacher performance to rigorously examine (positive and negative) feedback valence from…

This article investigates the role of emotions of inspectors while inspecting schools as reported by inspectors themselves within an education context of increased accountability that arguably privileges rationality over emotions. The study is built on an emotion management framework that regards emotions not only as unavoidably natural and…

This study examined the therapeutic collaboration in a case of Life Design Counseling (LDC) with narrative change and positive career outcomes. The therapeutic collaboration-change model and correspondent coding system were used to intensively study the helping relationship throughout three sessions of LDC. The collaboration coding system enables…

The term measurement disturbance has been used to describe systematic conditions that affect a measurement process, resulting in a compromised interpretation of person or item estimates. Measurement disturbances have been discussed in relation to systematic response patterns associated with items and persons, such as start-up, plodding, boredom,…

Making causal claims is central to evaluation practice because we want to know the effects of a program, project, or policy. In the past decade, the conversation about establishing causal claims has become prominent (and problematic). In response to this changing conversation about causality, we argue that evaluators need to take up some new ways…