Computer-based test interpretation (CBTI) is discussed in terms of its potential dangers to the public interest, problems with professional review of CBTI systems, and needed policies for these systems. Several problems with CBTI systems are outlined: (1) they may be nicely packaged, but it is difficult to establish their value; (2) they do not…

Since fall 1976, an undergraduate measurement class has utilized a 32K microcomputer programmed in APL to present replicate sets of questions randomly selected from 80-question item pools representing each of three domains of knowledge based on Sax's Principles of Educational Measurement and Evaluation. Multiple choice questions are presented on a…

The practice of not sharing tests results with clients may soon be in conflict with the Ethical Standards for Psychologist (sic). Studies using self-validation of feedback information to study feedback parameters have shown that the form of feedback is less important than the content. To investigate direct feedback of test results by computer, the…

This simulation study involved the design of two two-stage tests in which the routing tests and the second-stage measurement testlets took the form of a multidimensional knapsack problem with prespecified target informations and constraints to be enumerated using the algorithm of E. Balas. Two conventional tests of similar length to the two-stage…

This paper describes two procedures for making binary classification decisions using tailored testing: the sequential probability ratio test (SPRT) and a Bayesian decision procedure. The first procedure described, the SPRT, was developed by Wald for quality control work. It has not been widely applied for testing applications because the…

Research has produced mixed results in evaluating whether people are influenced more by computer output than by other information. The present study examined how teachers' perceptions of psychological reports differ when the reports are identified as being produced by a computer program or by a school psychologist. Subjects were 40 experienced…

Effect sizes have been increasingly emphasized in research as more researchers have recognized that: (1) all parametric analyses (t-tests, analyses of variance, etc.) are correlational; (2) effect sizes have played an important role in meta-analytic work; and (3) statistical significance testing is limited in its capacity to inform scientific…

The Educational Testing Service is moving rapidly to computerize its tests for admissions to postsecondary education and occupational licensure/certification. Computerized tests offer important advantages, including immediate score reporting, the convenience of testing when the examinee wishes, and for adaptive tests, equal accuracy throughout the…

A method of qualitative data analysis that used computer software as a tool to help organize and analyze open-ended survey responses was examined. Reasons for using open-ended, as opposed to closed-ended questionnaire items, are discussed, as well as the construction of open-ended questions and response analysis. Because the method is based on…

This paper describes teacher usage of the microcomputer programs Test Analysis Package (TAP) and Student Problem Package (SPP) to analyze students' test item responses. These methods of organizing, analyzing, and reporting test results have proven useful to classroom teachers. The TAP consists of four integrated microcomputer programs to edit,…

A group of seven conference papers, all dealing with the role of testing and evaluation in the schools, is presented in this document. The papers are as follows: (1) "Framework for Effective Schools" (Eric Cooper), which identifies indicators of efficacy, quality, and equity; (2) "Quality Indicators for Monitoring Equity"…