Multiple matrix sampling is a sampling design in which both test items and examinees are randomly sampled from their respective populations. This study was designed to develop and assess a method for computing an estimate of a correlation coefficient when a multiple matrix sampling design is used. The examinee populations included 212 third-grade…

Measures of consistency and completeness of order relations derived from test-type data are proposed. The measures are generalized to apply to incomplete data such as tailored testing. The measures are based on consideration of the items-plus-persons by items-plus-persons matrix as an adjacency matrix in which a 1 means that the row element…

Computer-assisted test construction is a simple, inexpensive natural complement to computer-based test scoring. Parallel tests can be made for individually-paced instruction, and the computer can produce feedback to improve item quality. The adaptability of computer-assisted test construction means that its introduction will likely be accepted by…

In discussing assessment and its applicability to the needs of Spanish-speaking students, several types of testing approaches are needed. This paper focuses on the use of comprehensive assessment offered by multiple matrix sampling techniques. (SW)

This study investigated the relationship between instructional use of handheld graphing calculators and student achievement in Algebra 1. Three end-of-course test forms were administered (without calculators) using matrix sampling to 458 high-school students in two suburban school districts in Oregon and Kansas. Test questions on two forms were…

Presents a case study that tests a mathematical model for its ability to predict second language vocabulary gains achieved through reading. To overcome the problem of small word gains noted in earlier studies of incidental acquisition, an adult learner of Dutch read a lengthy text and was tested on hundreds of words. The participant's gains were…

The problem of dimensionality with respect to Raven's Advanced Progressive Matrices (APM) specifically and, more generally, "g" or fluid intelligence, has been a long-standing issue. The present article reports two studies examining the dimensionality of both the original Set II of the APM (n = 506) and a short form (n = 644), using principal…

Multiple matrix sampling is a data collection technique that ensures accuracy and efficiency in group performance. It has been widely used in large-scale curriculum evaluation since the 1980s. However, the design does not always fully embrace the dynamics of local evaluation demands. The purpose of this study is to introduce a modified matrix…

Three statistical problems related to criterion-referenced testing are investigated: estimation of the likelihood of a false-positive or false-negative decision with a mastery test, estimation of true scores in the Compound Binomial Error Model, and comparison of the examinees to a control. Two methods for estimating the likelihood of…

Sixteen item statistics recommended for use in the development of criterion-referenced tests were evaluated. There were two major criteria: (1) practicability in terms of ease of computation and interpretation and (2) meaningfulness in the context of the development process. Most of the statistics were based on a comparison of performance changes…

In order to meet the needs of all the Armed Services, new forms of the Armed Services Vocational Aptitude Battery (ASVAB) must periodically be developed, refined, and standardized on an appropriate normative sample. Since one of the uses of the ASVAB is to determine candidate suitability for military service, it is necessary for the…

The usefulness of item sampling with unobtrusive measures and observational data is demonstrated. Particular emphasis is given to the question: Is item sampling appropriate for estimating the differences between means as well as the means themselves? A descriptive analysis is made of one aspect of a junior high school curriculum. Twenty four…

Author discusses and defines criterion tests in the context of classroom needs that have created much of the interest in the theory at this time. The primary source of interest is related to the growing implementation of individualized curricula. (Author/CB)

To determine the accuracy of simulated data sets, an investigation was conducted of the effects of item sampling plans in the application of multiple matrix sampling using both simulated and empirical data sets. Although results were similar, empirical data results were more precise. (SLD)

This document is about a program that was proposed and initiated involving the teaching of the metric system using performance objectives for each level from first through sixth grade. A total of 45 performance objectives were used for the six grade levels. The goal for the program was to have students master 80% of the performance objectives as…