This paper discusses the issues involved in calculating indices of composite reliability for "modular" or "unitised" assessments of the kind used in GCSEs, AS and A level examinations in England. The increasingly widespread use of on-screen marking has meant that the item-level data required for calculating indices of…

Much has already been written on the controversies surrounding the use of different test theories in educational assessment. Other authors have noted the prevalence of classical test theory over item response theory in practice. This Special Issue draws together articles based upon work conducted on the Reliability Programme for England's…

This chapter introduces theory that undergirds the role of testing adaptations in assessment, provides examples of item modifications and testing accommodations, reviews research relevant to each, and introduces a new paradigm that incorporates opportunity to learn (OTL), academic enablers, testing adaptations, and inferences that can be made from…

The binomial error model includes form-to-form difficulty differences as error variance and leads to Ruder-Richardson formula 21 as an estimate of reliability. If the form-to-form component is removed from the estimate of error variance, the binomial model leads to KR 20 as the reliability estimate. (Author/BW)

Examines the performance characteristics of 83 school-identified learning-disabled children on the Differential Ability Scales. Sixty percent showed a significant standard score discrepancy between the General Conceptual Ability and at least one achievement test. Implications regarding the educational diagnostic and intervention processes…

Teachers need valid information to judge the types of programs, instruction, and colleges best suited to students. Teachers appear to support the use of standardized tests to provides some of that information. Abolishing such tests may lead to dependence on more subjective measures, resulting in inequities in placement and selection. (FG)

An achievement test for the secondary school vocational electricity programs in South Carolina was constructed by a research coordinating unit (RCU) project. A trade and industrial supervisor and consultant, three electricity instructors, and four industry representatives comprised an advisory committee that participated in its development. Three…

The viewpoint is expressed that adding to test reliability by either selecting a more homogeneous set of items, restricting the range of item difficulty as closely as possible to the most efficient level, or increasing the number of items will not add to test validity and that there is considerable danger that efforts to increase reliability may…

These studies in test adequacy focus on two problems: procedures for estimating reliability, and techniques for identifying ineffective distractors. Fourteen papers are presented on recent advances in measuring achievement (a response to Molenaar); "an extension of the Dirichlet-multinomial model that allows true score and guessing to be…

The usefulness of the 1992 TSA in reading was studied using interviews from 26 state directors of assessment. Perceptions about TSA credibility and orientation of test components and current use of TSA results were examined. The directors suggested involving more teachers in assessment, modifying descriptors, disseminating results quicker, and…

Studies carried out over a 12-year period addressed fundamental questions on the use of Rasch-based item banks. Large field tests administered in grades 3-8 of reading, mathematics, and science items, as well as standardized test results were used to explore the possible effects of many factors on item calibrations. In general, the results…

Standardized achievement tests are often misused as indicators of a school's quality or effectiveness relative to other schools. This is an incorrect use because it ignores variation among schools in student abilities, family support of education, student mobility, and other factors. People also misuse tests because they impute to them more…

The feasibility of criterion referenced testing is held to be dependent on the tenability of two postulates: (1) that bias can be controlled in a principled manner from one test to the next; and (2) that one mental process measured by such tests may lawfully interact with another. Without the first postulate, criterion scores could not be…

The existence of criterion-referenced (CR) measurement is questioned in this paper. Despite beliefs that differences exist between two alternative forms of measurement, CR and Norm Referenced (NR), an analysis of philosophical and psychological descriptions of measurement, as well as a growing number of empirical studies, reveal that the common…

This handbook was designed to help Australian technical, adult, and further education (TAFE) teachers, especially those in vocational education areas, to assess and evaluate students. The guide contains seven chapters, each written so it can stand alone. At the beginning of each chapter is an explanation of what is to follow and a statement of the…