The current paper on writing assessment surveys the literature on the reliability and validity of essay tests. The paper aims to examine the two concepts in relationship with essay testing as well as to provide a snapshot of the current understandings of the reliability and validity of essay tests as drawn in recent research studies. Bearing in…

This chapter introduces theory that undergirds the role of testing adaptations in assessment, provides examples of item modifications and testing accommodations, reviews research relevant to each, and introduces a new paradigm that incorporates opportunity to learn (OTL), academic enablers, testing adaptations, and inferences that can be made from…

Provides a history of validation in language testing, discusses current approaches to validation in language testing (hypothesis about testing outcomes, relevant evidence for testing the hypothesis, developing a validity argument), and gives an overview of current challenges in language-test validation (defining the language construct to be…

Argues that IQ tests work only for some people some of the time. Offers a theory that emphasizes the roles in intelligence of information-processing, the environmental context, and coping with novelty and automatization of task performance, as a possibility for improving levels of prediction. (CMG)

Traces student comprehension in beginning economics course examinations in the United Kingdom from 1969 to 1973. Demonstrates that males performed better on multiple-choice tests, females performed better on essay examinations, and that female learning rates were lower than male learning rates. Reviews the influence of precollege courses. Includes…

Provides information on statistical data and jargon so that English department members can more confidently and responsibly identify the inevitable weaknesses and limitations of both tests of writing ability and the research on them. (RL)

Investigates the general factor and uniqueness characteristics of the individual tests of the Woodcock-Johnson Test of Cognitive Ability-Revised (WJTCA-R). Only 2 of the 19 WJTCA-R tests examined had low general factor loadings, while 2 had low uniqueness. All other tests had medium or high uniqueness. Discusses implications for clinical…

A behavioral domain is well-defined when it is clear to both test developers and test users which categories of performance should or should not be considered for potential test items. Only those tests that are keyed to well-defined domains meet the definition of criterion-referenced tests. The greatest proliferation of criterion-referenced tests…

Notes that significantly different results frequently exist between tests that purport to measure the same skill when the same child is tested on both instruments. Considers discrepancies related to examinee, examiner, examinee-examiner interactions, environment, and psychometric characteristics of the tests employed. Cites 10 major psychometric…

Teachers need valid information to judge the types of programs, instruction, and colleges best suited to students. Teachers appear to support the use of standardized tests to provides some of that information. Abolishing such tests may lead to dependence on more subjective measures, resulting in inequities in placement and selection. (FG)

Reviews developments in language testing research and practice over the last 20 years, and suggests future directions in the areas of professionalizing the field and validation research. Argues that concerns for ethical conduct must be grounded in valid test use, so that professionalization and validation research are inseparable. (Author/VWL)

Since speech communication evaluators are beginning to adapt the analytic and holistic instruments and methods used for rating written products to oral products and performance, this research review investigated: (1) what the labels "analytic" and "holistic" mean; (2) the theoretical bases of the two scoring approaches; and (3)…

Reviews recent theoretical, methodological, and analytical developments in language testing, focusing on more refined models of language ability, reliability and validity, performance testing, innovative test formats, new applications of Item Response Theory and Generalizability Theory to test performance. An annotated bibliography discusses seven…

Research on the potential effects of different item arrangement schemes on item statistics is reviewed for three separate periods. Earliest studies investigated the simple main effect of item order on test performance. The late 1960s emphasized interactions between item order and examinees' characteristics. Current concern focuses on item…

Reviews medical and psychoeducational assessment models, illustrating need to expand assessment procedure database resulting from the measurement errors in traditional assessment practices. Introduces assessment model emphasizing collection of classroom-based information over time and evaluating data more critically. Suggests model facilitates…