Educational reform priorities such as emphasis on quantitative modelling (QM) have positioned undergraduate biology instructors as designers of QM experiences to engage students in authentic science practices that support the development of data-driven and evidence-based reasoning. Yet, little is known about how biology instructors adapt to the…

A procedure for estimating the reliability of a factorially complex composite is considered. An application of its use with Scholastic Aptitude Test data is provided. (Author/JKS)

The contention that interpretation of a student's performance on a criterion referenced test should be independent of the performance of his classmates is challenged. The Mastery Learning Test Model, which was developed for analyzing criterion referenced test data, is described. An estimate of the proportion of students in an instructional group…

Fairness or unfairness may be an attribute of a test per se, or of its use, or of its statistical treatment. An hypothetical situation designed to be intrinsically fair and unbiased is used to show that analysis of covariance as a statistical method may introduce bias to the treatment of test scores. In contrast, equipercentile equating methods…

This paper traces the course of the consequences of viewing test responses as simply providing dichotomous data concerning ordinal relations. It begins by proposing that the score matrix is best considered to be items-plus-persons by items-plus-persons, and recording the wrongs as well as the rights. (Author/CTM)

It is shown that empirical mental test P - P plots are approximately equal to theoretical item-item curves, at least for long tests administered to many people. This result is important because it leads to (1) a distribution free method for estimating points on item-item curves; (2) a general method for defining estimates of item parameters; and…

Since the primary purpose of classical testing is to rank order examinees consistently, the absolute value of the true score has been relatively unimportant. However, the major purpose of criterion referenced testing is to estimate the true capabilities of examinees to perform specific tasks. Hence, the problems of true score determination assume…

The restrictions on item difficulties that must be met when binomial models are applied to domain-referenced testing are examined. Both a deterministic and a stochastic conception of item responses are discussed with respect to difficulty and Guttman-type items. (Author/BH)

For anchor test equating, 3 linear observed score methods are derived for populations differing in ability. Each version requires that the correlations of the tests with the selection variable be known. Five sets of assumptions are made for each model--yielding 15 methods--which are then related to existing methods. (SLD)

Several special cases of the general Rasch model, varying in complexity, were investigated to determine whether they could successfully model realistic multidimensional item response data. Whether the parameters of the model could be readily interpreted was also investigated. The models investigated included: (1) the vector model; (2) the product…

The difficulties in comparing profile variability (a measure of test scatter) are briefly discussed and the limitations of current techniques pointed out. Test scatter is defined as individual variation in test scores between or within various psychological and educational tests. Currently, no statistical technique for the comparison of profile…

A simplex model is presented for the analysis of longitudinal academic growth variables in which only one measure is obtained at each time. When this model fits the observed data, then reliabilities and unattenuated correlations can be estimated except for the first and last periods. (Author)