An approach was developed based on item-response models defined at the level of salient subject groups rather than at the level of individuals, designed for use with multiple-matrix sampling designs. In each of three National Assessment of Educational Progress (NAEP) mathematics subtopics, Reiser's group-effects latent trait model was fitted to…

The concept under investigation was the reliability of estimates of mean scores of groups under various assumptions of multiple-matrix sampling when reliabilities are computed according to procedures based on generalizability theory. Four different cases were compared with respect to the generalizability coefficients depending upon whether pupils…

A general process for testing the feasibility of applying alternative mathematical or statistical models to the solution of a practical problem is presented and flowcharted. The system is used to compare five models for test equating: (1) anchor test equating using classical test theory; (2) anchor test equating using the one-parameter logistic…

The implications of a mathematical model of test scores are explored where the data are limited to a random sample of items without replacement from an indefinitely large population or item domain in which items are scored either zero or one. The purpose is to obtain an unbiased estimate of a student's proportion of items correct in the item…

The purposes of the assessment project were to determine when the fourth grade math skills were acquired by the majority of students in the Salem, Oregon public schools, and to compare accomplishment on the criterion-referenced test with accomplishment on a standardized test. Because the project required testing grades 3-6, multiple matrix…

A tailored testing model employing the beta distribution, whose mean equals the difficulty of an item and whose variance is approximately equal to the sampling variance of the item difficulty, and employing conditional item difficulties, is proposed. The model provides a procedure by which a minimum number of items of a test, consisting of a set…

As part of a larger study to develop a Supply/Demand Model for Vocational Education Planners, this phase of the study was concerned with devising effective methods of providing program planners and administrators with current information relating to graduates and what they do upon completion of their programs. Using basic data obtained from…

Any systematic approach to the assessment of students' ability implies the use of a model. The more explicit the model is, the more its users know about what they are doing and what the consequences are. The Rasch model is a strong model where measurement is a bonus of the model itself. It is based on four ideas: (1) separation of observable…

Generalizability theory was used to analyze the dependability of elementary school student ratings of attitudes toward school subjects. The rating scales under investigation have been developed to measure the attitudes of students toward four school subjects at both the primary and intermediate levels. Two generalizability coefficients, differing…

Differing patterns of abilities among high school males of four ethnic groups were investigated, as reflected in the interrelationships of scores on a multi-test aptitude battery. If such differences in patterns of ability exist among these groups, their existence and nature should be revealed in the interrelationships of the various test scores…

In studies involving matrix sampling on items, it is often the case that there are too few responses per individual to use latent trait item response models. A model is formulated wherein individual level variability appears as independent error within the cells of a cross classification of demographic variables. (JKS)

Studies carried out over a 12-year period addressed fundamental questions on the use of Rasch-based item banks. Large field tests administered in grades 3-8 of reading, mathematics, and science items, as well as standardized test results were used to explore the possible effects of many factors on item calibrations. In general, the results…

Two different methods for collecting course-specific data on class learning and growth are discussed. The first, Item/Student Sampling, is directly dependent upon assessing class performance both prior to and following instruction. This procedure relies on multiple matrix sampling techniques. The second method, referred to as Self-Report of Course…

The National Education Association's Task Force on Testing has stated its opinion that standardized tests are overused. The task force suggests that the application of sampling techniques and a variety of alternatives to current testing practices would accomplish the same purposes. Representatives of the testing industry have indicated that the…

An induced course load matrix (ICLM) can be a valuable tool for examining the educational process at most postsecondary educational institutions, but the complexity and bulk of the ICLM computer printout is a hindrance. Experiences in using an ICLM at the University of North Carolina at Chapel Hill are described. Examples from an ICLM printout are…