When test-takers are offered a choice of essay questions, some questions may be harder than others. If the test includes a common portion taken by all test-takers, an adjustment to the scores is possible. Previously proposed adjustment procedures disregard the test-makers' efforts to create questions of equal difficulty; these procedures tend to…

The usual assessment of speededness for rights-only scored tests does not account for the possibility that examinees respond in a random or patterned fashion to the items at the end of the test as the time limit approaches. This study represented an attempt to determine if Sections 2 and 3 of the Test of English as a Foreign Language (TOEFL) are…

This paper explains the multifacet technology for analyzing performance examinations and the fair average method of setting criterion standards. The multidimensional nature of performance examinations requires that multiple and often different facets elements of a candidate's examination form be accounted for in the analysis. After this is…

This paper argues for a direct, holistic assessment of writing of limited-English-proficient (LEP) students. Holistic writing assessment is the term used for tests that evaluate writing wholly through the production of writing. A holistic writing assessment has at least the following five characteristics: each individual taking the assessment must…

Samples of student writing from the Alberta (Canada) 9th grade achievement test in writing (administered in June 1990) are presented with evaluative commentaries. They are intended to offer teachers, administrators, and students illustration of the criteria and approach used to score the exam. The exam is one part of a two-part standardized test…

This monograph for institutional researchers on questionnaire survey research aims to be both a guide to the basic steps of survey research and a useful reference tool. The monograph is in an informal, question and answer format and organized around the various steps of the survey research process. Chapter I discusses planning the survey including…

To study the stability of students' writing performances across occasions, four essays were obtained from each of 107 college students. These were scored with an analytic system that counts errors in 18 categories. Score reliability, computed by summing the 18 categories, was .36 for a single essay and .68 for the set of four essays. Score…

The diagnostic testing component of the Critical Thinking Project of the Pittsburgh schools is described and a rationale for the project's particular choice of testing procedures is provided. The purpose of the project was to help students develop skills for thinking critically and communicating critical thought through reading, discussion, and…

As a step toward developing a standardized measure for evaluating the impact of child protective services, three indices were developed: the abuse index, the neglect index, and the sexual abuse index. Each is composed of physical indicators of the problem and social and behavioral indicators found to be statistically correlated with physical…

This paper offers answers to nine important questions concerning standard-setting issues and methods: (1) Should normative or content-referenced standards be used? (2) Different standard-setting methods yield different results. What is your reaction to this finding? That of your clients? Does this finding present a problem for the application of…

This is the preliminary report of a new memory scoring method. Using the Wechsler Memory Scale as its base, it scores lateralized verbal and figural memory and long- and short-term memory. Six independent memory scales were developed. Studies of 105 subjects demonstrate that these scales are reliable and valid. (Author)

A multidimensional aggression scoring system for preschool children's responses to the structured doll play interview is described. The system, which incorporates previous investigator's findings, scales doll play responses along three dimensions of aggression: intensity, agent, and directionality. (Author)

Some basic statistical concepts relevant to the teacher--mean scores, standard deviation, normal and skewed distributions, z scores, item analysis, standard error of measurement, reliability--and their use by the teacher are explained. (RM)

This paper presents the author's responses to nine questions addressed to the standard-setting symposium participants. A central theme in this assessment is that one cannot clearly demonstrate, a priori, that either a normative or a content-referenced approach is superior. Most methods used to date have been insufficiently grounded in…

A computer program has been developed to assist users of DIAL-R (Developmental Indicators for the Assessment of Learning-Revised), a widely used screening test, in the accurate scoring of young children's performance. In addition to print-out feedback for parents and teachers, the program generates suggested objectives for each child based on the…