This study is an a priori demonstration of the applicability of multiple matrix sampling techniques to the practical research problem of parameter estimation. Three tests were administered to two separate but parallel populations, with one receiving item samples and the other receiving full tests. Special efforts were made to minimize the context…

This study involving 352 students was designed to verify empirically the a priori use of multiple matrix sampling procedures in an elementary school using a nationally normed, commercizlly published achievement test. The study focused on effect of changes in item context, effect of previous exposure to items, and relative effectiveness of multiple…

A test of mental arithmetic skills was developed and normed for children in grades one to six. Statistical techniques were used to predict the probability correct for each item and to rank order the items. Students in a given grade took only one level of the test and inferences were made of their performance on those tests which they did not take.…

In this paper, a proposal is made by which a content validity coefficient can be calculated. An example of the use of the coefficient is given, demonstrating that different question combinations in a CSE biology examination in which a choice of questions was given gave different levels of content validity. (Author)

When norming tests, it may be preferable to use the matrix sampling technique. The results from the samples may be used to estimate what the distribution of scores would have been if each subject had taken all the items. This paper compares four methods for making these estimates. The sample size made it possible to compare the techniques in a…

Test construction is not the strictly logical process that we might wish it to be. This is particularly true in a large on-going project such as the National Assessment of Educational Progress (NAEP). Most of the really deep questions can only be answered by the exercise of well-informed human judgment. Criterion-referenced testing is still a term…

This handbook for training program evaluators provides background information and practice activities in the following areas: (1) measurement: purposes, ideals, possibilities; (2) defining measurement domains; (3) person and item sampling; (4) test and item selection--with a selected list of standardized tests with pertinent information on each,…

This study investigated the relationship between instructional use of handheld graphing calculators and student achievement in Algebra 1. Three end-of-course test forms were administered (without calculators) using matrix sampling to 458 high-school students in two suburban school districts in Oregon and Kansas. Test questions on two forms were…

The purposes of the assessment project were to determine when the fourth grade math skills were acquired by the majority of students in the Salem, Oregon public schools, and to compare accomplishment on the criterion-referenced test with accomplishment on a standardized test. Because the project required testing grades 3-6, multiple matrix…

The National Education Association's Task Force on Testing has stated its opinion that standardized tests are overused. The task force suggests that the application of sampling techniques and a variety of alternatives to current testing practices would accomplish the same purposes. Representatives of the testing industry have indicated that the…

Representing a set of required readings for those who would keep abreast of developments in the field of educational evaluation, this book presents nine chapters, each written by a recognized scholar on the topic being considered. Several chapters are also available as separate booklets, thereby increasing the flexibility with which the materials…

This study attempted to determine the effectiveness of cloze procedures as norm-referenced instruments by comparing the differential responses of four groups of college students of English as a second language on two identical cloze passages. The responses were scored using both exact-answer and acceptable-word methods. The results indicate that…

An achievement testing framework is being developed by the Los Angeles Unified School District to assess the educational progress of 14,000 secondary level compensatory education students with something other than standardized tests. The technique of multiple matrix sampling was applied to the use of large item domains in the subject area of…