This Monte Carlo study examined the effect of complex sampling of items on the measurement of differential item functioning (DIF) using the Mantel-Haenszel procedure. Data were generated using a three-parameter logistic item response theory model according to the balanced incomplete block (BIB) design used in the National Assessment of Educational…

This paper presents preliminary, but statistically significant, findings from a study that compares two methods of measuring instructional effectiveness: global evaluation by experts and systematic observation using the SCRIBE Ob.2 software developed at the University of Texas at Austin. Hierarchical instruction of a performance skill…

Research has produced mixed results in evaluating whether people are influenced more by computer output than by other information. The present study examined how teachers' perceptions of psychological reports differ when the reports are identified as being produced by a computer program or by a school psychologist. Subjects were 40 experienced…

The integration of test-banks for computer-based testing, textbooks, and electronic lecture notes in first-year mathematics courses has changed the way mathematics is taught at Bennett College (Greensboro, North Carolina). Classes meet in two electronic classrooms each with 27 computers on a local area network and a projection system. An…

Thousands of older incarcerated youth (17-18 years old) pass through the juvenile justice system every year. Many are not viable candidates for traditional high school graduation because of limited earned credits and large gaps in education. The purpose of this study was to establish an effective and efficient means for determining students'…

Computerized adaptive (CA) testing uses an algorithm to match examinee ability to item difficulty, while self-adapted (SA) testing allows the examinee to choose the difficulty of his or her items. Research comparing SA and CA testing has shown that examinees experience lower anxiety and improved performance with SA testing. All previous research…

The Grammar, Spelling, and Punctuation (GSP) test is administered to students in the College of Communication at the University of Texas, Austin, as a means of determining eligibility to register for certain courses in journalism, broadcasting, and advertising. The test was administered in a paper-and-pencil version to 16 students and in a…

The Computerized Inventory of Developmental Writing Traits (CIDWT) is meant to provide a valid reliable measure of program improvement, particularly for teachers implementing a process writing approach in their classrooms. While standardized tests, portfolio, and holistic scoring all have something to offer, the CIDWT is an inexpensive direct…

The National Center for Education Statistics conducts surveys which require the coding of the respondent's major field of study. This paper presents a new system for the coding of major field of study. It operates on-line i a Computer Assisted Telephone Interview (CATI) environment and allows conversational checks to verify coding directly from…

This paper recounts the use of a computerized multiple-measures placement model at Yuba College in Marysville, California. Yuba began using computerized placement tests in 1994, based on suggestions from faculty and student assessment staff. Two years later, a set of multiple measures criteria, consisting mainly of self-reported high school…

To evaluate student learning in a computer-supported environment known as "GenScope," a system was developed for assessing students' understanding and learning of introductory genetics material presented in two developed GenScope instruments. Both quantitative and qualitative methods were used to address traditional evidential validity…

While computer-based tests might be as simple as computerized versions of paper-and-pencil examinations, more innovative applications also exist. Examples of innovations in computer-based assessment include the use of graphics or sound, some measure of interactivity, a change in the means in which examinees responded to items, and the application…

Because of the crucial nature of the technical literacy problem and the necessity for employees to be able to understand and apply information contained in technical manuals, a technical literacy test was developed in order to identify the level of a person's familiarity with or likely aptitude for work using a computer. The information yielded by…

Differences in learners' control decisions in computer-assisted learning were studied during part task versus whole task practice. The criterion task was chosen for its relevance to air crew training problems. Forty-one male and female undergraduates participated in a computer simulation task estimating the location and orientation of target…

This study investigated the relationship between examinee achievement-specific locus of control and the differences between self-adapted testing (SAT) and computerized adaptive testing (CAT) in terms of mean estimated proficiency and posttest state anxiety. Subjects were 379 college students. A disordinal interaction was found between test type…