Essay tests are widely used to assess ESL/EFL learners' writing abilities for instructional, administrative, and research purposes. Relevant literature was searched to identify 70 empirical studies on ESL/EFL essay tests. The majority of these studies examined task, essay, and rater effects on essay rating and scores. Less attention has been given…

Essay tests, despite their limitations, have a number of strengths and, therefore, appropriate uses in higher education, as long as users are aware of the limitations. Essay questions (extended response and restricted response) are designed to assess student learning. There is considerable agreement in the educational measurement literature about…

Several studies have shown that essays receive higher marks when preceded by poor quality scripts than when preceded by good quality scripts. This study investigated the effectiveness of providing scorers with model essays to reduce the influence of context. Context effects persisted despite the scoring procedures used. (Author/EGS)

Essay questions, interviews, and personality inventories of 35 male and female college students revealed that the avoidance of sexist language was linked to less traditional sex role views and a lesser adherence to fundamentalist Christian beliefs. (DM)

The role of sample papers (i.e., anchor papers, prototypes, range-finders) in holistic evaluation of writing is discussed. When, where, and how many sample papers are to be selected, and who should perform the selection are covered. The process of sample selection should proceed as follows: (1) a general reading of papers by committee members to…

After an extensive review of the available research on large-scale writing assessment, certain issues in writing assessment seem to be unresolved, and still other issues are not supported by adequate research. This paper reviews the basic issues in writing assessment, points out which topics are supported by strong research, and which topics are…

Much previously published material for estimating the reliability of classification has been based on the assumption that a test consists of a known number of equally weighted items. The test score is the number of those items answered correctly. These methods cannot be used with classifications based on weighted composite scores, especially if…

This paper provides empirical data on two approaches to statistically equate scores derived from the direct assessment of writing. These methods are linear equating and equating based on the general polychotomous form of the Rasch model. Data from the Maryland Functional Writing Test are used to equate scores obtained from two prompts given in…

The relationships among variables for a group of first year medical students were examined. The variables included previous test-taking experience, test-taking training, test anxiety, and level of test wiseness. The study also provided initial normative data concerning the level of test anxiety among entering medical students for comparison with…

The purpose of this paper is to compare the precision of direct and indirect measures of writing assessment using the test information functions from a graded response Item Response Theory (IRT) model. Subjects were 192 sophomore English students from a parochial high school in Wisconsin. Both direct and indirect measures of writing ability were…

The Test of Standard Written English (TSWE) is a 50-item multiple choice instrument designed to assess the ability of college students to use English. In this study, based upon a sample of 45 students, the TSWE was revalidated with writing samples. The coefficient of 0.54 was most impressive given that the TSWE scores were restricted to those…

Based on a study dealing with problem-finding behavior of artists as the first step in the creative process (Getzels and Czikszentmihalyi), this study on the empirical nature of problem-finding included middle school students from a suburban-rural area in Western Pennsylvania. Eight students identified through three measures as creative were…

This paper deals with test fairness regarding a test consisting of two parts: (1) a "common" section, taken by all students; and (2) a "variable" section, in which some students may answer a different set of questions from other students. For example, a test taken by several thousand students each year contains a common multiple-choice portion and…

This report identifies the methods and issues in the evaluation of student writing in classrooms and large scale assessments using an analytical scoring system from the Illinois Inventory of Educational Progress (IIEP). This guide is written for staff in state offices of education conducting large-scale writing assessments, and also for personnel…

This study evaluated procedures for establishing a minimum performance standard for the essay subtest of the National Teacher Examinations Communications Skills test. Results indicated the preferred procedure for setting standards on essays should involve a blind review followed by an informed review. (Author/DWH)