When norm-referenced tests are developed for instructional purposes, to assess the effects of educational programs, or for educational research purposes, it can be very important to conduct item and test analyses. These analyses can evaluate the quality of items and of the test as a whole. Such analyses can also be employed to revise and improve…

This paper discusses a survey instrument that was developed to measure educators' receptivity to the inclusion of elements of global education in the curriculum. The instrument was designed to elicit attitudinal responses. Responses were measured using a six point, strongly-agree-to-strongly-disagree, Likert type scale. A random sample of K-12…

Much of the effort involved in a major restructuring of the Graduate Record Examinations (GRE) Aptitude Test was intended to result in the creation of an analytical module to supplement the verbal and quantitative sections of the test, thus providing broadened measurement. Factor extension analysis was used in the present study to investigate…

College faculty (n=171) from 16 Arkansas colleges were asked to make validity and cut score judgments about the test items for the 1982 Arkansas National Teacher Examination (NTE) study of 23 area examinations. Each of the 23 data collection panels began with a training session which included specific directions for the estimates of the judges.…

This study compared item difficulty and item discrimination indices for parallel multiple-choice items in three content areas: measurement concepts, statistical terminology, and synonyms. The statistics and measurement items were administered in classes where graduate students taking the test were studying the content. Vocabulary items represented…

This computer program, written in BASIC, performs three different calculations of test reliability: (1) the Kuder-Richardson method; (2); the "common split-half" method; and (3) the Rulon-Guttman split-half method. The program reads sequential access data files for microcomputers that have been set up by statistical packages such as…

Significant to a latent trait or item response theory analysis of a mental test is the determination of exactly what is being quantified. The following are practical problems to be considered in the formulation of a good theory: (1) deciding whether two tests measure the same trait or traits; (2) analyzing the relative contributions of a pair of…

The predictive analysis approach to adaptive testing originated in the idea of statistical predictive analysis suggested by J. Aitchison and I.R. Dunsmore (1975). The adaptive testing model proposed is based on parameter-free predictive distribution. Aitchison and Dunsmore define statistical prediction analysis as the use of data obtained from an…

The accuracy of standards obtained from judgmental methods is dependent on the quality of the judgments made by experts throughout the standard setting process. One important dimension of the quality of these judgments is the consistency of the judges' perceptions with item performance of minimally competent candidates. Several interrelated…

Differential functioning of males and females on achievement test items was studied in a sample of 110,000 students in kindergarten through grade 12. First, item parameters and ability estimates for these parameters were obtained from LOGIST computer program runs for the entire group. Predicted performance for each item for each group was…

The study was designed to examine the similarity of response options generated by different item writers using a systematic approach to item writing. The similarity of response options to student responses for the same item stems presented in an open-ended format was also examined. A non-systematic (subject matter expertise) approach and a…

A standard method for exploring item bias is the intergroup comparison of item difficulties. This paper describes a refinement and generalization of this technique. In contrast to prior approaches, the proposed method deletes outlying items from the formulation of a criterion for identifying items as deviant. It also extends the mathematical…

An Attitude Toward Blindness Questionnaire (ATBQ) was developed to assess individual progress through a Veterans Administration blind rehabilitation program. The instrument is also meant to measure attitudes toward blindness for blind persons, rehabilitation workers, and a "naive" group without contact with the blind. A method of…

National Assessment of Educational Progress (NAEP) Mathematics Assessment (1982) data were analyzed using latent class models to determine patterns of distinct skills required by different exercises and to estimate the pattern distributions. The populations were 9-, 13-, and 17-year-old examinees. Skills were assumed to be intermediate between…

Reliability and validity of the Ilyin Oral Interview (IOI) are examined with respect to interscorer agreement. This test is a structured questionnaire based on a sequence of pictures depicting common events in the daily life of a student. Interviews of 11 students from an English as a second language (ESL) class at the University of New Mexico…