Achievement tests which are specifically linked to an instructional program and have been developed in relation to an objectives base and/or to an item generation rule are considered, as well as student response data. Three types of studies are outlined and the kind of procedures thought useful illustrated. As various methods for examining…

Described and listed herein with concomitant sample input and output is the Fortran IV program which estimates parameters and standard errors of estimate per parameters for parameters estimated through multiple matrix sampling. The specific program is an improved and expanded version of an earlier version. (Author/BJG)

One solution to the problem of obtaining test scores in order to assess multiple outcomes of educational programs is a basically simple technique called matrix sampling. Matrix sampling is the estimation of total test score statistics by administering random subsets of test items to randomly selected students. This chapter lays out the specific…

The adequacy of a test developed for statewide assessment of basic mathematics skills was investigated. The test, comprised of multiple-choice items reflecting a series of behavioral objectives, was compared with a more extensive criterion measure generated from the same objectives by the application of a strict item sampling model. In many…

The present research was initiated to investigate whether item-sampling as a procedure would yield a more accurate and stable index of student achievement during formative evaluation when compared to indices arrived at by the traditional method of assessing pupil knowledge and understandings within the framework of multiple choice testing for…

Investigates how student ability, anxiety level, question wiseness, and relative difficulty of questions influence students' opinions of and performance on a chemistry examination. Examines strategies employed by students in selecting questions. Concludes that the major problem for test candidates is anxiety. (Author/DB)

Maximum likelihood factor analysis provides an effective method for estimation of factor matrices and a useful test statistic in the likelihood ratio for rejection of overly simple factor models. A reliability coefficient is proposed for analysis of factor solution. (Author/RK)

First purpose of this study was to investigate empirically the accuracy of prediction using regression weights selected through the use of variance-reduction procedures. (Author)

Vocational and technical education researchers need to be aware of the uses and limits of various statistical models. The author reviews the Rasch Model and applies it to results from a nutrition test given to student nurses. (Author)

Multiple matrix sampling of items and examinees was applied to an 18-item rank order instrument administered to a randomly assigned group and compared to the ordering and ranking of all items by control subjects. High correlations between ranks suggest the methodology may viably reduce respondent effort on long rank ordering tasks. (Author/CM)

Multiple matrix sampling (MMS) theory indicates how data may be gathered to most efficiently convey information about levels of attainment in a population, but standard analyses of these data require random sampling of items from a fixed pool of items. This assumption proscribes the retirement of flawed or obsolete items from the pool as well as…

This report describes new statistical procedures for item response analysis using estimation of item response curves used in mental testing with ability parameters treated as a random sample. Modern computer technology and the EM algorithm make this solution possible. The research focused on the theoretical formulation and solution of maximum…

Both criterion-referenced testing and behavioral assessment share the basic assumption that test behavior is a sample rather than a sign. In addition, both types of assessment focus on response capabilities and performance in specified content domains. Although content validity has been traditionally recognized as essential to criterion-referenced…

This study examined the effects of certain item selection methods on the classification accuracy and classification consistency of criterion-referenced instruments. Three item response data sets, representing varying situations of instructional effectiveness, were simulated. Five methods of item selection were then applied to each data set for the…

The literature on criterion referenced testing is full of discussions concerning whether classical measurement techniques are appropriate, whether variance is necessary, whether new indices of reliability are needed, and the like. What appears to be lacking, however, is a clear and simple discussion of why the problems occur. This paper suggests…