This scope-review presents the milestones of how Hierarchical Rater Models (HRMs) become operable to used in automated essay scoring (AES) to improve instructional evaluation. Although essay evaluations--a useful instrument for evaluating higher-order cognitive abilities--have always depended on human raters, concerns regarding rater bias,…

This report summarizes the complex research literature on quantitative methods for assessing how impacts of educational interventions on instructional practices and student learning differ across students, educators, and schools. It also provides technical guidance about the use and interpretation of these methods. The research topics addressed…

This report addresses challenges associated with the reporting of test scores of students with disabilities participating in alternate assessments. It summarizes six models currently under construction or already being used by states. Using proficiency levels as a common reporting approach, the six models are: (1) same proficiency levels for…

This paper discusses variables influencing written composition quality and how they can best be controlled to improve the reliability of assessment of writing ability. The study aimed to concentrate on the effects of different imposed time limits on student performance in written composition at grade 10 level using methods of generalizability…

Theoretical issues underlying the development of scales of language proficiency are examined. First, a brief classification of scale types is presented, and problems identified in them and advantages they offer are outlined. Discussion then moves to the issues of describing and measuring language proficiency. In this section, behaviorally-based…

This article describes the evolution of Raymond B. Cattell's data box (covariation chart), a synoptic conception of psychological data, from its introduction in 1946. Analytical techniques and related methodologies developed from this model by Cattell and other psychological researchers are discussed. (BS)

Reviews current and developing technology uses that are relevant to language assessment and discusses examples of recent linguistic applications from the laboratory at the Educational Testing Service. The processes of language test development are described and the functions they serve from the perspective of a large testing organization are…

Instructional models for foreign language reading and listening comprehension are outlined and synthesized, and an instructional procedure based on immediate recall, a standardized method for assessing first-language comprehension, is proposed. First, the interrelated processes of reading and listening comprehension, as currently defined in the…

Presents a literature review seeking to answer four questions: (1) What is washback? (2) How does washback work? (3) How can we promote positive washback? and (4) How can we investigate washback? A model is proposed that identifies participants, processes and products which may influence or be influenced by, washback. Strategies for investigating…