Generalizability theory extends previous methods of estimating the reliability of rating instruments such that one can estimate the precision of a measurement system for differentiating among students, scales, or any other important dimension. In this study, generalizability theory is applied to faculty ratings of junior and senior dental students…

Two models were identified for criterion-referenced tests, one based on the assumption of a continuous achievement variable and the other assuming a dichotomous or binary variable. Several test characteristics were examined and contrasted for the two models, including the distribution of scores, establishment of a cutting score, test length, item…

Describes two simple methods of error analysis: (1) combining errors in the measured quantities; and (2) calculating the error or uncertainty in the slope of a straight-line graph. Discusses significance of the error in the comparison of experimental results with some known value. (MDH)

Scholastic achievement tests and mental ability tests normally consist of a set of multiple choice items, all of which are assumed to measure school-relevant cognitive abilities. The presumption, in a given test situation, is that the answers/solutions to the given tasks represent cognitive capabilities on the part of the examinees. The purpose of…

Data on the intellectual maturity of children 6-11 years of age in the noninstitutionalized population of the U. S. is analyzed in relation to their demographic and socioeconomic background. This is the second report on the Goodenough-Harris Drawing Test, administered in the Health Examination Survey of 1963-65, and deals with the results in…

Principles of test administration, test validity, and accuracy of measurement underlying interpretation of standardized test scores in educational administration, instruction, and guidance are presented. Types of norm-referenced score transformations, including percentiles, standard scores, and grade equivalents, and of criterion referenced…

Two data collection designs, counterbalanced and spiraling (Angoff's Design I and Angoff's Design II) were compared using item response theory and equipercentile equating methodology in the vertical equating of 2 mathematics achievement tests using 1,000 eleventh graders and 1,000 twelfth graders. The greater stability of Design II is discussed.…

The feasibility of pre-equating, or establishing conversions from raw to scaled scores through the use of pretest data before operationally administering a test, was investigated for the Scholastic Aptitude Test (SAT). Item-response theory based equating methods were used to estimate item parameters on SAT pretest data, instead of using final form…

Forming a sequence covering the various aspects of the simplex model, four articles are presented here under the following titles: "A Simplex Model for Analyzing Academic Growth", "Analyzing Ratings With Correlated Intrajudge Measurement Errors", "The Correlation of States With Gain", and "The Reliability of…

A central problem for the user of domain-referenced tests in instruction is deciding who has passed and who has failed. Two procedures were presented and discussed. The first, employing classical test theory, was found to be more useful for larger domains and where the passing standard is 70 percent or less. The sampling procedure suggested by…