In the Swedish educational system, teachers have the dual responsibility of assigning final grades and marking their own students' national tests. The Government has mandated the Swedish Schools Inspectorate to remark samples of the national tests to see if teacher marking can be trusted. Reports from this project have concluded that intermarker…

The "e-rater"® automated essay scoring system is used operationally in the scoring of "TOEFL iBT"® independent and integrated tasks. In this study we explored the psychometric added value of reporting four trait scores for each of these two tasks, beyond the total e-rater score.The four trait scores are word choice, grammatical…

This paper examines how competency progression and completion is implemented in practice in three trades. In particular, it focuses on: interactions between teachers and/or assessors and workplace supervisors; the different approaches used to integrate on- and off-the job training; assessment and signoff practices; and the ways by which workplace…

Very few studies (e.g., Arnold, 1998; Joosten-ten Brinke, et al., 2009) have examined the ways in which evaluators assess students' prior learning. This investigation explored the ways that evaluators described students' prior learning in final assessment reports at a single, multiple-location institution. Results found four themes; audience,…

Criticism of specific-purpose language (LSP) tests is often directed at their limited ability to represent fully the demands of the target language use situation. Such criticisms extend to the criteria used to assess test performance, which may fail to capture what matters to participants in the domain of interest. This paper reports on the…

We investigated the alignment between a teacher survey self-report measure and classroom observation measure of ambitious mathematics instructional practice among teachers in two urban school districts using two different standards-based mathematics curricula. Survey reports suggested mild differences in teachers' instructional practices between…

Passage of the Every Student Succeeds Act (ESSA) in December 2015 signaled a new era for teacher evaluation reform. Under ESSA, states and districts have greater autonomy to design and implement teacher evaluation systems independent of federal influence. This new flexibility brings with it new responsibilities and challenges for states and…

This study explores the attitudes of raters of English speaking tests towards the global spread of English and the challenges in rating speakers of Indian English in descriptive speaking tasks. The claims put forward by language attitude studies indicate a validity issue in English speaking tests: listeners tend to hold negative attitudes towards…

This paper attempts to demonstrate the differences in writing between International English Language Testing System (IELTS) bands 6.0, 6.5 and 7.0. An analysis of exemplars provided from the IELTS test makers reveals that IELTS 6.0, 6.5 and 7.0 writers can make a minimum of 206 errors, 96 errors and 35 errors per 1000 words. The following section…

Objective: Work Place-Based Assessments (WPBAs) were introduced into psychiatry along with the new curriculum in 2005. The Royal College of Psychiatrists decided to pilot several WPBAs to ascertain their suitability. Method: Eight types of assessments (Case-Based Discussion, Assessment of Clinical Expertise, Mini-Assessed Clinical Encounter,…

The article addresses some problems and options in setting standards on language tests and examinations. More specifically, it reports on a set of three workshops conducted in the European context where standard setting in language education typically concerns linking tests and examinations to the Council of Europe's "Common European…

Assessors' scores in performance assessments are known to be highly variable. Attempted improvements through training or rating format have achieved minimal gains. The mechanisms that contribute to variability in assessors' scoring remain unclear. This study investigated these mechanisms. We used a qualitative approach to study…

This paper focuses on the dual dependencies apparent at the intersection of the media society and the audit society by empirically exploring and discussing the relationship between Swedish local newspaper coverage and school inspection activities. The research questions pertain to the Inspectorate's media strategy, how inspection is represented…

The Benjamin Banneker Scholars Program (BBSP) was designed at an HBCU to increase the academic performance, retention, and graduation of minority students in science, technology, engineering and mathematics (STEM). At the end of each academic year, students completed a BBSP Post-Program Satisfaction Survey. Each year Mentoring was consistently…

It is a truism of American social policy that our nation has great success generating innovative programs that improve outcomes for participants--but that we are far less effective at moving from small, "boutique" programs into broadly applied solutions that improve the prospects of large numbers of individuals. This is certainly true in…