This Monte Carlo study examined the effect of complex sampling of items on the measurement of differential item functioning (DIF) using the Mantel-Haenszel procedure. Data were generated using a three-parameter logistic item response theory model according to the balanced incomplete block (BIB) design used in the National Assessment of Educational…

This paper presents preliminary, but statistically significant, findings from a study that compares two methods of measuring instructional effectiveness: global evaluation by experts and systematic observation using the SCRIBE Ob.2 software developed at the University of Texas at Austin. Hierarchical instruction of a performance skill…

Research has produced mixed results in evaluating whether people are influenced more by computer output than by other information. The present study examined how teachers' perceptions of psychological reports differ when the reports are identified as being produced by a computer program or by a school psychologist. Subjects were 40 experienced…

The integration of test-banks for computer-based testing, textbooks, and electronic lecture notes in first-year mathematics courses has changed the way mathematics is taught at Bennett College (Greensboro, North Carolina). Classes meet in two electronic classrooms each with 27 computers on a local area network and a projection system. An…

The Computerized Inventory of Developmental Writing Traits (CIDWT) is meant to provide a valid reliable measure of program improvement, particularly for teachers implementing a process writing approach in their classrooms. While standardized tests, portfolio, and holistic scoring all have something to offer, the CIDWT is an inexpensive direct…

The National Center for Education Statistics conducts surveys which require the coding of the respondent's major field of study. This paper presents a new system for the coding of major field of study. It operates on-line i a Computer Assisted Telephone Interview (CATI) environment and allows conversational checks to verify coding directly from…

To evaluate student learning in a computer-supported environment known as "GenScope," a system was developed for assessing students' understanding and learning of introductory genetics material presented in two developed GenScope instruments. Both quantitative and qualitative methods were used to address traditional evidential validity…

Because of the crucial nature of the technical literacy problem and the necessity for employees to be able to understand and apply information contained in technical manuals, a technical literacy test was developed in order to identify the level of a person's familiarity with or likely aptitude for work using a computer. The information yielded by…

Differences in learners' control decisions in computer-assisted learning were studied during part task versus whole task practice. The criterion task was chosen for its relevance to air crew training problems. Forty-one male and female undergraduates participated in a computer simulation task estimating the location and orientation of target…

Providing instructors an efficient way to acquire a well-defined, tailored test for a given student, or group of students, the Item Bank deals in multiple-choice, Rasch-calibrated problems which are deposited under two subject areas: reading and mathematics. Users can obtain a test which is appropriate to what their migrant students have been…

This study investigated the transfer of solution strategies between close variants of quantitative reasoning questions. Pre- and posttests were obtained from 406 college undergraduates, all of whom took the same posttest; pretests varied such that one group of participants saw close variants of one set of posttest items while other groups saw…

Advantages and disadvantages of standard Rasch analysis computer programs are discussed. The unconditional maximum likelihood algorithm allows all observations to participate equally in determining the measures and calibrations to be obtained quickly from a data set. On the advantage side, standard Rasch programs can be used immediately, are…

The Miller Motivation Scale is a 160-item computer scored scale. It was developed to measure quickly and easily and display the motivational profile of the client. It has eight subscales. Five subscales measure encouragement, self-fulfillment and social interest. They are called Creative, Innovative, Productive, Cooperative, and Power. Three…

Drawing from personal experiences in the development of an interactive testing program for a sociology course, this paper discusses issues related to the use of computer-based education in social science classes. First, the paper describes the steps taken by the Community College of Denver to introduce interested faculty to the possibilities of…

To provide an objective statement of how a wide range of students at the University of Texas at El Paso performed on a test measuring verbal basic skills, a computerized analysis of variance compared group mean scores on a test of basic skills competence for 1,553 students in 6 groups, including graduating seniors and students in 4 levels of…