The commentary and overview explored how curriculum and assessment reforms are being used by a small university and small country to improve the quality of education and gain international recognition. Although the reforms are potentially beneficial to the students, university, and country, there are dilemmatic factors that may either enhance or…

This paper provides a history of ETS's role in developing assessment instruments and psychometric procedures for measuring change in large-scale national assessments funded by the Longitudinal Studies branch of the National Center for Education Statistics. It documents the innovations developed during more than 30 years of working with…

In educational testing, subscores may be provided based on a portion of the items from a larger test. One consideration in evaluation of such subscores is their ability to predict a criterion score. Two limitations on prediction exist. The first, which is well known, is that the coefficient of determination for linear prediction of the criterion…

Classical procedures for calculating the two indices of decision consistency (P and Kappa) for criterion-referenced tests require two testings on each child. Huynh, Peng, and Subkoviak have presented one-testing procedures for these indices. These indices can be estimated without any test administration using Ebel's estimates of the mean, standard…

The current status of state testing programs is assessed drawing primarily on information provided by the Educational Testing Service publication, "State Testing Programs, 1973 Revision." Increases in state operated programs are indicated and are probably due to an increase in federal money for testing purposes. Because of possible…

The proposition, "That measurement issues in competency-based educational programs (CBE) are not different from those in other kinds of testing (NCBE)" must be declared false. (1) Measurement in CBE focuses on the present while NCBE measurement focuses on information needed for future planning. (2) CBE measurement starts with definitive statements…

Identifies questions pertinent to the issue of assessment. Notes that comparison of student achievements has negative social and psychological consequences. Suggests problems which are inherent in the process of assessment by objectives. Urges the measurement of the progress of each pupil from one stage of learning to the next. (KO)

Six experimental approaches to the problems of setting cutoff scores and choosing proper test length are briefly mentioned. Most of these methods share the premise that a test is a random sample of items, from a domain associated with a carefully specified objective. Each item is independent and is scored zero or one, with no provision for…

The four parts of this report are: (1) the purposes of evaluation and reporting; (2) relationship to educational philosophy and methods of teaching, including historical development, present reporting practice and criticisms of these practices, and alternatives to conventional grading; (3) the best way to report student achievement; and (4)…

A computer simulation of Bayes' Theorem was conducted in order to determine the probability that an examinee was a master conditional upon his test score. The inputs were: number of mastery states assumed, test length, prior expectation of masters in the examinee population, and conditional probability of a master getting a randomly selected test…

The author contends that the crucial variable distinguishing two types of tests is the way in which the content domain is specified, rather than the use of norm-vs. criterion-referenced interpretations. Because some modes of content specification lead to specified domain and mastery interpretations, and some lead to open domains, the author…

This paper delineates several problems which arise when criterion-referenced test results are used to evaluate the effects of a specific educational treatment. Focus is on these topics: (1) the aggregation of individual students' data on objectives, (2) the sensitivity of the instrument to instruction, (3) the interpretation of…

This project is concerned with the development and implementation of some new statistical techniques that will facilitate a continuing input of information about the student to the instructional manager so that individualization of instruction can be managed effectively. The source of this informational input is typically a short…

The proposed standard for judging proficiency test score reliability requires that the proportion of items passed for each objective assessed be a dependable estimate of the universe score for the domain strata established by the objective. Domain breadth is the focusing issue. Data from a field trial of the Tennessee Proficiency Test are analyzed…

The Ontario Ministry of Education conducted case studies of the testing programs in nine selected school districts. Results are presented in narrative form on the major study questions: testing program development and organization, the tests administered, uses of test results, and perceived role of the ministry in evaluation programs. (SJL)