Methods of probability modeling to analyze rater agreement are described, emphasizing their basic similarities and viewing them as variants of a common methodology. Statistical techniques for analyzing agreement data are described to address questions such as how many opinions are required to make a medical diagnosis with necessary accuracy. Kappa…

A brief, nontechnical state-of-the-art review of four common instruments and current practices in the field of scholastic aptitude testing is presented. The instruments include: the 1971 Cognitive Abilities Test (CAT), 1973 Henmon-Nelson Tests of Mental Ability (H-NTMA), 1979 Otis-Lennon School Ability Test (OLSAT) and the 1970 Short Form Test of…

Issues concerning equating test scores are discussed in an introduction, four papers, and two commentaries. Equating methods research, sampling errors, linear equating, population differences, sources of equating errors, and a circular equating paradigm are considered. (SLD)

Arguments against competency testing surface continually, and classic counter-arguments reoccur. Nevertheless, minimum competency testing and other accountability efforts have much public support. Those claiming that the tests are not relevant or do not have predictive validity, also say they are coachable and biased. Answers are given to these…

The National Center for Education Statistics (NCES) has been conducting the National Assessment of Educational Progress (NAEP) since 1969. In addition to conducting regular assessments in reading, mathematics, science, and writing, the NAEP conducts assessments in other subjects, such as geography, U.S. history, civics, and the arts. Each national…

The discrete mathematics topics of trees and computational complexity are implemented in a simple reliability program which illustrates the process advantages of the PASCAL programing language. The discussion focuses on the impact that reliability research can provide in assessment of the risks found in complex technological ventures. (Author/JJK)

This report provides an overview of the research on the testimony of young children in cases of sexual abuse, focusing on preschoolers' presumed suggestibility and the role of researchers and mental health professionals as expert witnesses in such cases. It does so in light of the McMartin preschool case, in which seven defendants were acquitted,…

This special issue covers recent technical developments in the field of criterion-referenced testing. An introduction, six papers, and two commentaries dealing with test development, test score uses, and evaluation of scores review relevant literature, offer new models and/or results, and suggest directions for additional research. (SLD)

Assessment systems to measure high educational standards emerged as the major theme at the 1996 conference of the National Center for Research on Evaluation, Standards, and Student Testing (CRESST), "Moving Up to Complex Assessment." This feature article, providing a summation of the proceedings of the conference, reports that the…

The psychometric characteristics of the Graduate Record Examinations General Test (GRE-GT) were studied for three handicapped groups. Experimental subjects took the GRE-GT between October 1981 and June 1984; they include: (1) 151 visually-impaired students taking large-type, extended-time administrations; (2) 188 visually-impaired students taking…

The trend of student evaluation of college faculty performance is documented, and implications for humanization of the university are considered. Research in the area of teacher evaluation is cited, and it is proposed that reviews of the literature on student evaluations indicate by and large that student ratings are reliable and valid, even…

This issue of Measurement in Education is presented in the form of a dialogue between Dr. Robert L. Ebel, Distinguished Professor of Educational Measurement at Michigan State University, and Dr. Samual A. Livingston, Program Research Scientist at the Educational Testing Service. Alternative views on some aspects of the use of tests in assessing…

This special issue presents seven papers describing programs for children with behavioral disorders. Among topics addressed are use of role playing to foster social skills, truancy intervention, and cooperative efforts by mental health agencies and public schools. (CL)

The increased attention to measuring career skills has resulted in more instrument development, more testing of students, and more test administrators. There are three key areas of concern. The first area is that of identifying purposes to be served by assessing career skills. Purposes include permitting descriptions of the current status of…

The authors argue that personnel who select standardized achievement tests have been led to believe that the major achievement test batteries differ very little in terms of the topics they test; but that the content covered by these major tests is different, and that such differences have consequences for instructional content. To test this…