Techniques for maximizing discrimination between groups in norm referenced measurement to reflect sensitivity to group differences inherent in the evaluation of multilevel educational systems are discussed. Data from the Beginning Teacher Evaluation Study (BTES) were used to examine relationships between reading and mathematics achievement and…

The purpose of this report is to describe the development of a pool of mathematical problem-solving situations and a set of items for each situation which provides information about students' qualitatively different levels of reasoning ability as applied to that situation. For each problem-solving situation, a set of "structured…

A method for measuring recognition memory (free of distractors) and false recognition was based on the assumption that the subject was "honest." A distractor-free test of word recognition (a single-item test trial in which the 36 targets were presented prior to the 36 distractors) was compared with a traditional target-distractor…

This report investigates an area of uncertainty in using the Angoff method for setting standards, namely whether or not a judge's conceptualizations of borderline group performance are realistic. Ratings are usually made with reference to the performance of this hypothetical group, therefore the Angoff method's success is dependent on this point.…

Although the Rotter Incomplete Sentence Blank (ISB):High School Form has been used to distinguish between normal and abnormal adolescents, it has been hypothesized that in facility placed juvenile delinquents' highly conflictual responses (i.e., those that index maladjustment) reflect removal from home and agency placement rather than long-term…

One means of learning about the processes operating in a multiple choice test is to include some test items, called nonsense items, which have no correct answer. This paper compares two versions of a mathematical model of test performance to interpret test data that includes both genuine and nonsense items. One formula is based on the usual…

This document, prepared as a conference handout, consists of a description of the revised General Educational Development (GED) Tests scheduled for introduction in 1988 and a series of recommendations concerning the content of future GED tests, which were formulated by a committee appointed by the Commission on Educational Credit and Credentials…

The Responsiblity Test measures the secondary school student's level of knowledge (remembering or recall, understanding and thinking) of social responsibility, other types of responsibility, the benefits and costs of responsibility, the conditions and conflicts of responsibility, and ways of providing responsible behavior. It consists of 21…

It is usually assumed that the procedures followed in developing criterion-referenced (CR) educational achievement tests ensure their content validity. This assumption is reasonable for the class of "domain-specified" CR tests, in which the item domain is completely specified by item generation rules. However, most CR tests are of the…

It was concluded that a multiple choice form corresponding to a sentence completion measure, test clearly defined personality areas (such as autonomy) could be a reasonable alternative for many purposes. (Author/DEP)

A pilot study was conducted on test item ambiguity in standardized tests. A group of second and third grade children were selected and given a random sample of items from four standardized test series. Items were drawn from the reading, science and social studies subtests and put together in a composite reading comprehension, science, and social…

In the specific methods of standard setting in testing, judgments about individuals being tested, contrasting groups being tested, and judgments about the test items are discussed. In judgments about individual test-takers, assumptions are presented based on the knowledge and skills the test is intended to measure, the test-takers' skills at the…

A project was conducted to develop a criterion-referenced student testing program for secondary home economics (consumer education) in South Carolina. Procedures used to develop the test included the following: (1) the content elements of the consumer education curriculum were identified; (2) each content element was classified into the type and…

Academic psychology has long been composed of two disciplines, one experimental and one correlational. These two disciplines each developed their own method of studying structure in data: multidimensional scaling (MDS) and factor analysis. Both methods use similar kinds of input data, proximity measures on object pairs. Both represent the object…

This paper presents the interim results of a set of studies undertaken to develop a much needed methodology for establishing content validity in domain-referenced achievement tests. The study results are presented in the context of the larger issue of the improvement of test design. School teachers, administrators and graduate students were…