Curriculum-based measurement is a system for monitoring students' progress and formatively evaluating instruction backed by 25 years of validation research. Most of this research has been conducted in elementary schools. In middle and high school classrooms, where there is an emphasis on mastering content knowledge, elementary-level measurements…

Latent semantic analysis (LSA) is an automated, statistical technique for comparing the semantic similarity of words or documents. In this article, I examine the application of LSA to automated essay scoring. I compare LSA methods to earlier statistical methods for assessing essay quality, and critically review contemporary essay-scoring systems…

This study was designed to address two frequent criticisms of the SAT essay--that essay length is the best predictor of scores, and that there is an advantage in using more "sophisticated" examples as opposed to personal experience. The study was based on 2,820 essays from the first three administrations of the new SAT. Each essay was…

This report contains results of a field test conducted to determine the relationship between a Graduate Records Examination (GRE) linear computer-based test (CBT) and a paper-and-pencil (P&P) test with the same items. Recent GRE examinees participated in the field test by taking either a CBT or the P&P test. Data from the field test…

This Monte Carlo study examined the effect of complex sampling of items on the measurement of differential item functioning (DIF) using the Mantel-Haenszel procedure. Data were generated using a three-parameter logistic item response theory model according to the balanced incomplete block (BIB) design used in the National Assessment of Educational…

This paper presents preliminary, but statistically significant, findings from a study that compares two methods of measuring instructional effectiveness: global evaluation by experts and systematic observation using the SCRIBE Ob.2 software developed at the University of Texas at Austin. Hierarchical instruction of a performance skill…

Research has produced mixed results in evaluating whether people are influenced more by computer output than by other information. The present study examined how teachers' perceptions of psychological reports differ when the reports are identified as being produced by a computer program or by a school psychologist. Subjects were 40 experienced…

The integration of test-banks for computer-based testing, textbooks, and electronic lecture notes in first-year mathematics courses has changed the way mathematics is taught at Bennett College (Greensboro, North Carolina). Classes meet in two electronic classrooms each with 27 computers on a local area network and a projection system. An…

Thousands of older incarcerated youth (17-18 years old) pass through the juvenile justice system every year. Many are not viable candidates for traditional high school graduation because of limited earned credits and large gaps in education. The purpose of this study was to establish an effective and efficient means for determining students'…

Computerized adaptive (CA) testing uses an algorithm to match examinee ability to item difficulty, while self-adapted (SA) testing allows the examinee to choose the difficulty of his or her items. Research comparing SA and CA testing has shown that examinees experience lower anxiety and improved performance with SA testing. All previous research…

The Grammar, Spelling, and Punctuation (GSP) test is administered to students in the College of Communication at the University of Texas, Austin, as a means of determining eligibility to register for certain courses in journalism, broadcasting, and advertising. The test was administered in a paper-and-pencil version to 16 students and in a…

The Computerized Inventory of Developmental Writing Traits (CIDWT) is meant to provide a valid reliable measure of program improvement, particularly for teachers implementing a process writing approach in their classrooms. While standardized tests, portfolio, and holistic scoring all have something to offer, the CIDWT is an inexpensive direct…

The National Center for Education Statistics conducts surveys which require the coding of the respondent's major field of study. This paper presents a new system for the coding of major field of study. It operates on-line i a Computer Assisted Telephone Interview (CATI) environment and allows conversational checks to verify coding directly from…

This paper recounts the use of a computerized multiple-measures placement model at Yuba College in Marysville, California. Yuba began using computerized placement tests in 1994, based on suggestions from faculty and student assessment staff. Two years later, a set of multiple measures criteria, consisting mainly of self-reported high school…

To evaluate student learning in a computer-supported environment known as "GenScope," a system was developed for assessing students' understanding and learning of introductory genetics material presented in two developed GenScope instruments. Both quantitative and qualitative methods were used to address traditional evidential validity…