The stability of annual normal curve equivalent (NCE) on the Iowa Test of Basic Skills over a period of six years was established in a previous study of status (position within a reference group). This study investigated the relationship between status stability and student achievement level. Third grade students in a suburban school district who…

Three statistical problems related to criterion-referenced testing are investigated: estimation of the likelihood of a false-positive or false-negative decision with a mastery test, estimation of true scores in the Compound Binomial Error Model, and comparison of the examinees to a control. Two methods for estimating the likelihood of…

The federally funded longitudinal field study called Management Implications of Team Teaching (MITT) required a search for an appropriate strategy for analyzing through-time relationships among selected variables. The MITT project used questionnaires and interviews to collect data concerning the work, governance, attitudes, and orientation of…

Data from the verbal portion of the College Entrance Examination Board Scholastic Aptitude Tests were used in an experimental test of the accuracy of equating for a variety of models in three categories: linear equating, equipercentile equating, and item characteristic curve equating. The models were tested for both mean squared error and bias.…

Performance testing often entails the usage of expensive, time-consuming measures in the quest for determining the level of performance on some desired behavior. It is concluded that a generalizability theory approach to dealing with departures from reality in testing can aid in the establishment of empirically-based choices of measurement…

The previous theoretical development of the Poisson process as a strong model for the true-score theory of mental tests is discussed, and additional theoretical properties of the model from the standpoint of individual examinees are developed. The paper introduces the Erlang process as a family of test theory models and shows in the context of…

The primary objective of this study was to examine the construct validity of two multiple-content testing programs, the multiple-choice Comprehensive Tests of Basic Skills (CTBS/5) and the performance-based Maryland School Performance Assessment Program (MSPAP), by evaluating the true-score longitudinal associations among multiple-content scores…

Author discusses and defines criterion tests in the context of classroom needs that have created much of the interest in the theory at this time. The primary source of interest is related to the growing implementation of individualized curricula. (Author/CB)

For six tests, coefficient delta as an index for internal optimality is computed. Internal optimality is defined as the magnitude of risk of the decision procedure with respect to the true score. Results are compared with an alternative index (coefficient kappa) for assessing the consistency of decisions. (Author/JKS)

The monograph by D. Rogosa and G. Ghandour represents a body of cohesive and comprehensive research that can be the basis of a new measurement theory combining features of generalizability theory and strong true-score theory. Principles, approaches, arguments, and conclusions are reviewed; and critical comments are offered. (SLD)

Issues raised with the statistical models developed are discussed point by point, restating the emphasis on finite observation time, and reiterating the criticism of traditional psychometric methods. It is noted that the language and technical formulation of psychometrics can be extremely awkward in dealing with biased estimates. (SLD)

The degree to which reliability affects the power of analysis of variance (ANOVA) tests involving one factor with two and three samples was quantified and tabulated by taking into account sample size, level of significance, and true score effect size. Results confirm a substantial effect on power. (SLD)

The contrasting groups method is one of many possible methods for setting passing scores. The most commonly used method is probably that developed by W. H. Angoff (1971), but it has been suggested that the Angoff method may not be appropriate for many standard setting applications in education. The contrasting groups method is explored as an…

An important feature of recent large-scale performance assessments has been the reporting of pupil and school performance in terms of performance or proficiency categories. When an assessment uses such ordered categories as the primary means of reporting results, the natural way of reporting on the quality of the assessment is through the…