The teaching of English as a foreign language in Indonesia has a long history, and it is always important to ask whether the assessment of the students' language skills has been valid and reliable. A screening of many articles in several prominent databases reveal that a number of evaluation studies have been done by Indonesian scholars in the…

This paper will deal, firstly, with the South African context, that cries out for attention to responsible language assessment. The renewed interest in language testing in South Africa is well illustrated in assessments of language ability for educational purposes generally, and more specifically in the assessment of academic literacy. Secondly,…

This article describes and reviews the Singapore-Cambridge General Certificate of Education Advanced Level General Paper (GP) examination. As a written test that is administered to preuniversity students, the GP examination is internationally recognised and accepted by universities and employers as proof of English competence. In this article, the…

This chapter introduces theory that undergirds the role of testing adaptations in assessment, provides examples of item modifications and testing accommodations, reviews research relevant to each, and introduces a new paradigm that incorporates opportunity to learn (OTL), academic enablers, testing adaptations, and inferences that can be made from…

Standardizing aspects of assessments has long been recognized as a tactic to help make evaluations of examinees fair. It reduces variation in irrelevant aspects of testing procedures that could advantage some examinees and disadvantage others. However, recent attention to making assessment accessible to a more diverse population of students…

Lissitz and Samuelsen (2007) have proposed a framework that seemingly deems construct validity evidence irrelevant to supporting educational test meaning. The author of this article agrees with Lissitz and Samuelsen that internal evidence establishes test meaning, but she argues that construct validity need not be removed from the validity sphere.…

Lissitz and Samuelsen (2007) propose a new framework for validity theory and terminology, emphasizing a shift in theory and practice toward issues of test content rather than constructs. The author of this article argues that several of Lissitz and Samuelsen's critiques of validity theory focus on previously considered, but subsequently discarded,…

This simulation study considered the effects on statistical measures of test dimensionality that result from systematic sampling variation in both a single- and a double-trait assessment model. Results suggest that there are distinct psychological and psychometric states of test dimensionality, and that psychometric unidimensionality may be…

This handbook is designed as a quick reference for first-year teachers who find themselves in an assessment driven environment with little experience to help make sense of the language, underlying philosophy, or organizational structure of the assessment system. The handbook begins with advice on developing and evaluating effective learning…

A qualitative study investigated the test-taking behaviors, knowledge, and perceptions of 20 urban, adult basic education students reading at third to fifth grade equivalency levels. The entire reading comprehension subtest of the Test of Adult Basic Education, levels E and M, was administered under standardized conditions. A combination of…

Reviews procedures followed in developing a set of science items for Chemistry, Physics, Biology, Geology content areas and examines the items' construct validity in relation to a specific technique of evaluation. Analysis supported the items' construct validity and viability for testing certain science skills at the secondary level. (ML)

A discussion of language testing in the context of a program in English for Special Purposes (ESP) focuses on the lack of "fit" between the two areas and makes some recommendations for improvement. It begins with overviews of recent trends in testing and recent issues in ESP. Overlap is seen in two areas: construct and content validity. It is…

The internal construct validity of the 1989 Advanced Placement Spanish Language Examination was analyzed to determine whether the traditional four-factor examination structure hypothesized by test developers (listening, reading, writing, speaking) was invariant for relevant subpopulations. Using a nested hierarchical design, multiple confirmatory…

The process of designing and validating a test of English-as-a-Second-Language (ESL) speaking skills is described. The study examined: (1) whether nine traits (pronunciation, grammar, discourse, fluency, content, vocabulary, comprehensibility, interactional competence, sociolinguistic competence) are relevant and separable parts of speaking…