As diagnostic classification models become more widely used in large-scale operational assessments, we must give consideration to the methods for estimating and reporting reliability. Researchers must explore alternatives to traditional reliability methods that are consistent with the design, scoring, and reporting levels of diagnostic assessment…

Panahi and Mohebbi review James Dean Brown's 50-years of research in language testing, curriculum development and research statistics with reference to an impressionistic framework for analysis containing two components with their subcomponents: Annotations (i.e., briefing and implications) and main concepts and themes (i.e., testing and teaching…

C-tests are gap-filling tests widely used to assess general language proficiency for purposes of placement, screening, or provision of feedback to language learners. C-tests consist of several short texts in which parts of words are missing. We addressed the issue of local dependence in C-tests using an explicit modeling approach based on testlet…

In order to comply with the regulations put forth by the Elementary and Secondary Education Act (ESEA), as amended by the Every Student Succeeds Act (ESSA), states are required to submit evidence associated with their statewide accountability systems to the United States Department of Education (ED) for peer review. Some states have elected to…

Proficiency in English language and how it is measured have become central issues in higher education research as the English language is increasingly used as a medium of instruction and a criterion for admission to education. This study evaluated the English language assessment in the foundation Programme at the Colleges of Applied sciences in…

Across the world, university teachers are increasingly being required to engage with diversity in the classes they teach. Using the data from a large Economics 1 class at a South African university, this attempts to understand the effects of diversity on chances of success and how assessment can impact on this. By demonstrating how theory can be…

English language learners (ELLs) with disabilities are an increasing presence in schools in the United States. Title I and Title III of the Elementary and Secondary Education Act require that these students meet the same academic grade-level standards and participate in content assessments as their fluent-English speaking peers without…

Applied linguistics and psychometrics have influenced language testing, providing additional tools for investigating factors affecting language test performance and assuring measurement reliability. An examination is presented of language testing, including the theoretical issues involved, the methodological advances, language test development,…

The purpose of this document is to explore the world of assessment within the context of the No Child Left Behind Act of 2001. The definitions provided will help those with little knowledge of as-sessment to understand the essentials of practice and theory. The information is meant for assess-ment users so they can interpret the purpose of tests…

Reviews recent theoretical, methodological, and analytical developments in language testing, focusing on more refined models of language ability, reliability and validity, performance testing, innovative test formats, new applications of Item Response Theory and Generalizability Theory to test performance. An annotated bibliography discusses seven…

A new measure of reading comprehension, the Diagnostic Assessment of Reading Comprehension (DARC), designed to reflect central comprehension processes while minimizing decoding and language demands, was pilot tested. We conducted three pilot studies to assess the DARC's feasibility, reliability, comparability across Spanish and English,…

Differences in procedures used by academic institutions and government agencies in administering the American Council on the Teaching of Foreign Languages' Oral Proficiency Interview test are examined, and results and implications of two studies of interrater reliability are discussed. (MSE)

This document examines the concepts of validity, reliability, and appropriateness from a language testing perspective as they apply to the following four assessment issues raised by the National Reporting System (NRS): (1) What type of language assessment seems to be required by the NRS: proficiency or achievement?; (2) Knowing that the NRS…

This study examines the reliability and validity of translation tests as a reading comprehension measure. The following tests were administered to 70 Japanese high school students: (1) open-ended translation (OE-TRAN) test from English to Japanese; (2) multiple-choice translation (MC-TRAN) test; (3) cloze test (CLOZE-T); and (4) short-answer…

Second language (L2) computer-adaptive testing (CAT) is a technologically advanced method of assessment in which the computer selects and presents test items to examinees according to the estimated level of the examinee's language ability. The basic notion of an adaptive test is to mimic automatically what a wise examiner would normally do.…