Current Scoring practices for multiple-choice tests are rooted in early Associationist Theory and are based on a two-step procedure: (1) right answers counted as ones and wrong answers are zeros, and (2) number of right answers form a total-correct score. The author contends that if either step is invalid, the use of the general linear model (GLM)…

A novel scoring procedure was investigated in order to obtain scores from a conventional multiple-choice test that would be free of the guessing component or contain a known guessing component even though examinees were permitted to guess at will. Scores computed with the experimental procedure are based not only on the number of items answered…

Performance testing often entails the usage of expensive, time-consuming measures in the quest for determining the level of performance on some desired behavior. It is concluded that a generalizability theory approach to dealing with departures from reality in testing can aid in the establishment of empirically-based choices of measurement…

During the past few years the problem of bias in testing has become an increasingly important issue. In most research, bias refers to the fair use of tests and has thus been defined in terms of an outside criterion measure of the performance being predicted by the test. Recently however, there has been growing interest in assessing bias when such…

This paper is part 3 of Research Department Report Number 123, "Exploring the T.R.Q.: An Assessment of the Effectiveness of the Teachers' Rating Questionnaire," which gave questionnaire users information necessary to tailor the instrument to their own needs. Retention of TRQ questions which generated good distributions of teacher ratings…

This report assesses the validity, reliability, and efficiency of the Teachers' Rating Questionnaire (TRQ), a pupils' school success measure developed in connection with a 1961 longitudinal Study of Achievement. TRQ ratings on nearly 14,000 pupils, gathered in the Study of Achievement and a New Canadian Report, constituted the data source.…

A review of selected literature on evaluation of open education programs provides a background for the author's discussion of the conditions essential to open education and the evaluation of its effectiveness. Other factors mentioned are: (1) the importance of the types of measuring instruments used to evaluate these programs, (2) the application…

Two studies attempted to clarify the Intellectual Tasks test assessment of number conservation by testing for two possible artifacts due to procedure: (1) Effects of preceding questions on the following test questions, and (2) operations or manipulations of the test materials by the examiner. Forty Mexican-American first and second graders were…

Although the "Don't Know" (DK) option has received telling criticism in maximum performance summative tests, its potential use in formative evaluation was considered and judged to be more promising. The pretest of an instructional module was administered with DK options. Examinees were then required to answer each question to which they had…

The 1968 Invitational Conference on Testing Problems dealt with educational evaluation and the problems of the socially disadvantaged. Papers presented in Session I, Educational Evaluation--Various Levels and Aspects, were: (1) "The Comparative Field Experiment: An Illustration from High school Biology" by Richard C. Anderson; (2) "Evaluation of…

This report reviews the employment testing of minorities and discusses the limitations of the test results. Statistical validation of test results is stressed as a means to avoid cultural bias and avoid discriminatory screening tests. Noting that fair hiring practices and valid tests may not be enough to provide equal employment opportunities for…

This paper addresses itself to the history and use of standardized aptitude and achievement tests for practical judgements about schools in New Jersey. In the author's opinion, school-wide aptitude testing is not a particularly useful practice when other types of information, particularly grades, achievement tests, and teacher's comments, are…

Using examples from evaluations of the Emergency School Aid Act (ESAA) Basic Grants Program, the ESAA Pilot Program, and the sustaining effects of compensatory education programs, school and student attrition are discussed. As in the example cases, appreciable attrition can be expected in most longitudinal studies. The possible effects of this…

This article examines 10 critical factors to be considered in selecting a well constructed standardized tests. The 10 factors may serve as model selection criteria for educational practitioners who are responsible for selecting tests for Black students. (Author/DOW)