Evaluation models are being developed for assessing artificial intelligence (AI) systems in terms of similar performance by groups of people. Natural language understanding and vision systems are the areas of concentration. In simplest terms, the goal is to norm a given natural language system's performance on a sample of people. The specific…

The Rasch Model and various extensions of this model can be formulated as a quasi loglinear model for the incomplete subgroup x score x item response 1 x ... x item response k contingency table. By comparing various loglinear models, specific deviations of the Rasch model can be tested. Parameter estimates can be computed using programs such as…

The document is part of the final report on Project STEEL (Special Teacher Education and Evaluation Laboratory) intended to extend the utilization of technology in the training of preservice special education teachers. This volume focuses on the third of four project objectives, the development and implementation of a computer-based testing…

The effects of computer-based diagnostic testing on the laboratory achievement of 91 preservice elementary teachers were assessed. These teachers were enrolled in one of four laboratory sections of a general science course. Intact classes were randomly assigned to one of two treatment groups. All students completed the same laboratory activities…

Suspecting that computer assisted instruction (CAI) could help teach grammar to freshman composition students at Northeast Missouri State University (NMSU), three instructors received a research grant to begin a program of testing basic writing skills and to initiate CAI instruction for those students who needed help in the tested areas. A survey…

This is a continuation of a previous study in which a new method of estimating the operating characteristics of discrete item responses based upon an Old Test, which has a non-constant test information function, was tested upon each of two subtests of the original Old Test, Subtests 1 and 2. The results turned out to be quite successful. In the…

Using Guttman's facet design analysis, four parallel forms of a multiple-choice test were developed. A mapping sentence, logically representing the universe of content of a basic cardiology course, specified the facets of the course and the semantic structural units linking them. The facets were: cognitive processes, disease priority, specific…

The concurrent validity of a computer assisted test construction system designed to measure information in the medical sciences was assessed. Results support the usefulness of the system. (Author/JKS)

Evaluates the Computer-Based Assessment Instrument (CRAI) as a test for reading proficiency. Notes strengths of CRAI, including its use as a quick assessment of silent reading comprehension level, and the problems with readability and content specific words lists and the lack of scoring features. (JC)

Investigates the effects of structural cueing (color or no color) and decision level (rote or semantic) on students' verbatim retention of technical prose and concludes that the results support the distinctiveness of encoding hypothesis for learning via the microcomputer. (DF)

Considers the nature of receptive language proficiency, the nature of performance on language tests, and possible improvements in receptive language testing. Emphasizes how testing of reading comprehension and testing of listening comprehension raise similar concerns which should be addressed in the design of receptive language tests. (SED)

Proposes an experimental computer-based curriculum in foreign language which focuses on reading and is designed to take the learner from no reading proficiency through intermediate reading proficiency. The material presented would include alphabet and sound/symbol correspondence, morphology and syntax, vocabulary, and exercise material to develop…

This publication presents the reports from two studies, Math Online (MOL) and Writing Online (WOL), part of the National Assessment of Educational Progress (NAEP) Technology-Based Assessment (TBA) project. Funded by the National Center for Education Statistics (NCES), the Technology-Based Assessment project is intended to explore the use of new…

This investigation of the comparability of writing assessment prompts was conducted in two phases. In an exploratory Phase I, 47 writing prompts administered in the computer-based Test of English as a Foreign Language[TM] (TOEFL[R] CBT) from July through December 1998 were examined. Logistic regression procedures were used to estimate prompt…

Online assessment promises a faster and more useful return of data about student performance in states accountability assessments. The prospect of gaining quick access to such information is alluring, and many states are creating new assessments for an online environment in order to obtain it. This period of retooling presents a significant…