Teacher agency is a pivotal element of professionalism and second/foreign language (L2) education. However, its role in L2 assessment has remained under-researched. Part of this negligence is due to the absence of a validated questionnaire to measure the construct and its underlying components. To address this gap, drawing on the ecological…

Sight translation has been widely used in aptitude testing to screen prospective trainee interpreters at leading interpreter training schools, including ESIT, ISIT, and EMCI. However, it has also been criticised for its lack of validity and reliability. No empirical study has thus far been conducted to explore its power to predict interpreting…

Panahi and Mohebbi review James Dean Brown's 50-years of research in language testing, curriculum development and research statistics with reference to an impressionistic framework for analysis containing two components with their subcomponents: Annotations (i.e., briefing and implications) and main concepts and themes (i.e., testing and teaching…

The purpose of the study is to have a relook at the ESL reading comprehension assessment system for Malaysian Year Five students. Traditionally, the ESL teachers have been assessing and reporting on their primary year's students by merely giving a composite grade with some vague remarks. This process has been used and is still being employed in…

This study has attempted to investigate the administered written tests in the language department of Islamic Azad University of Hamedan, Iran from validity, practicality and reliability points of view. To this end two steps were taken. First, examining 112 tests, we knew that the face validity of 50 tests had been threatened, 9 tests lacked…

This study describes research used for supporting a validity argument for a new Spanish Listening Exam, whose scores are intended to place examinees into appropriate levels of university Spanish classes. This study contributes to the field of argument-based approaches to language assessment by implementing Bachman's (2005) assessment use argument…

Describes what a computer-adaptive test (CAT) is, examines its roots, and points out some of the challenges this approach to assessment presents. (Author/VWL)

This technical report focuses on the decision-making potential provided by second language performance assessments. First, performance assessment is situated within the broader discussion of alternatives in language assessment and in educational assessment in general. Next, issues in performance assessment design, implementation, reliability, and…

Based on the responses of 50 ESL instructors to a composition-scoring exercise, a detailed method of scoring compositions was developed that divides the writing into basic components (structure, content, vocabulary, organization, and mechanics) and provides a scoring mechanism for each component for each of three competency levels. (MSE)

The faculty of an intensive program of English as a second language for college-bound students, questioning the objectivity of faculty evaluations of non-native college applicants' written essays, assessed the existing evaluation process, reformed it, tested it, and planned for ongoing development. In the first stage, readers read and graded…

A comparison of the holistic, error-count, and categorical methods of assessing written work presents disadvantages and advantages in terms of validity, reliability, and efficiency. The results of a pilot study indicate that the error-count method may provide the most benefits. (CB)

This document examines the concepts of validity, reliability, and appropriateness from a language testing perspective as they apply to the following four assessment issues raised by the National Reporting System (NRS): (1) What type of language assessment seems to be required by the NRS: proficiency or achievement?; (2) Knowing that the NRS…

This report was undertaken to help the Tennessee State government comply with federal requirements that all states collect valid, reliable, and uniform data for programs receiving federal funds as English-as-a-Second-Language (ESL) adult education programs. Data must be collected to report learner gains in reading, writing, speaking, and…

Second language (L2) computer-adaptive testing (CAT) is a technologically advanced method of assessment in which the computer selects and presents test items to examinees according to the estimated level of the examinee's language ability. The basic notion of an adaptive test is to mimic automatically what a wise examiner would normally do.…

Presents an overview of the variables that contribute to the complexity of English-as-a-Second-Language writing assessment design. (63 references) (Author/CK)