This paper is a report of a study designed to develop recommendations on minimum qualifying scores for National Teacher Examinations (NTE) that are valid for certification and endorsement in Tennessee. The functions performed in the review of the NTE Core Battery and Specialty Area tests were conceptualized as panel activities. The number of…

Discrepancies among the standards produced by different criterion-referenced standard-setting techniques may be the result of a failure to adequately define the minimally competent candidate. Current research in this area is reviewed in terms of three categories: studies in which no formal assistance in conceptualization is given to judges,…

The role of sample papers (i.e., anchor papers, prototypes, range-finders) in holistic evaluation of writing is discussed. When, where, and how many sample papers are to be selected, and who should perform the selection are covered. The process of sample selection should proceed as follows: (1) a general reading of papers by committee members to…

"The Holocaust" is an exercise designed to measure thinking processes of students in grades 8 through 12. It consists of a 14-minute videotape and a four-page handout describing the destruction of the European Jews. The exercise is based on an approach to measuring thinking suggested by the work of E. A. Peel (1971). Peel maintains that…

The reliability, validity, and score discrepancies of 94 expository essays scored in conference versus remote settings were studied. Focus was on comparing holistic ratings obtained in both settings. Essays written by college freshmen on two different topics were scored by readers working in a conference setting and by different readers working in…

An Educational Testing Service (ETS) procedure was evaluated, which is based on item response theory and estimates true scores on tests not taken. The reading, vocabulary, and mathematics tests of high school seniors from the National Longitudinal Study (NLS) of 1972 and the High School and Beyond (HSB) seniors of 1980 and 1982 were found to share…

Forty adolescent subjects with behavior problems at home or at school were administered the Woodcock Reading Mastery Tests. Subjects ranged in age from 12 to 18, and included 25 males and 15 females. The Passage Comprehension Test for each subject was rescored using three different ceiling criteria: (1) five errors in six consecutive responses,…

The "Write a Sentence Test" was developed for use in the evaluation of student writing abilities in association with a project in Memphis, Tennessee. This paper discusses ways of administering and scoring the test, decisions concerning modification of the test, and experiences when the test was administered to sample subjects. All forms…

The first of three sequels to the booklet "Student Assessment," this booklet begins by describing and providing examples of four different forms that objective questions can take: (1) conventional multiple choice questions; (2) true/false questions; (3) assertion/reason items; and (4) matching items. Guidance is offered on how to decide which type…

The third of three sequels to the booklet "Student Assessment," this booklet begins by describing and giving examples of three forms that essay-type questions can take: (1) unstructured-essay questions; (2) structured-essay questions; and (3) short-notes questions. Guidelines are then provided for deciding which type of question to use in a given…

A pilot study was undertaken to develop appropriate writing samples for assessment of composing tasks, to examine the utility and time requirements of scoring keys, particularly regarding their consistency and objectivity, and to study the efficacy of scoring guides. Five classes from second to sixth grade in a school in the Los Angeles Unified…

Holistic evaluation, defined as the grading of an entire piece of writing without tallying or correcting specific errors, is discussed as preferable to discrete point testing or objective measures in assessing writing proficiency of English as a second language (ESL) students. The assessment process, in which the papers are evaluated as excellent,…

This paper describes the implementation of a computer-based approach to scoring open-ended problem lists constructed to evaluate student and practitioner clinical judgment from real or simulated records. Based on 62 previously administered and scored problem lists, the program was written in BASIC for a Heathkit H11A computer (equivalent to DEC…

This paper evaluates the magnitude of the total error in estimates of the difference between an examinee's domain score and the cutoff score. An observed score based on a random sample of items from the domain, and an estimated cutoff score derived from a judgmental standard setting procedure are assumed. The work of Brennan and Lockwood (1980) is…

This report investigates an area of uncertainty in using the Angoff method for setting standards, namely whether or not a judge's conceptualizations of borderline group performance are realistic. Ratings are usually made with reference to the performance of this hypothetical group, therefore the Angoff method's success is dependent on this point.…