At Santa Fe Community College, the development of a biology course and departmental final examination was accomplished in the following stages: (1) faculty reached consensus on course content, major objectives and sub-objectives; (2) faculty contributed final examination questions corresponding to the 10 major course topics to a pool for review…

This paper discusses systemic problems with testing and outlines two scenarios for reformulating testing based on intelligent tutoring systems. Five desiderata are provided to underpin the type of testing proposed: (1) tests should emphasize learning and thinking; (2) tests should require generation as well as selection; (3) tests should be…

In self-adapted testing, examinees are allowed to choose the difficulty of each item to be presented immediately before attempting it. Previous research has demonstrated that self-adapted testing leads to better performance than do fixed-order tests and is preferred by examinees. The present study examined the strategies that 29 college students…

The effects of item position on item statistics were studied in a large set of data from tests of word knowledge (WK) and arithmetic reasoning (AR). Position effects on item response theory (IRT) parameter estimates and classical item statistics were also investigated. Data were collected as part of a project to refine the Army's Computerized…

The process of writing test items is analyzed, and a blueprint is presented for an authoring system for test item writing to reduce invalidity and to structure the process of item writing. The developmental methodology is introduced, and the first steps in the process are reported. A historical review traces the advances made in the field and the…

Four discussions of test construction based on item response theory (IRT) are presented. The first discussion, "Test Design as Model Building in Mathematical Programming" (T. J. J. M. Theunissen), presents test design as a decision process under certainty. A natural way of modeling this process leads to mathematical programming. General…

Gender differences were examined on three computer-administered spatial processing tasks: (1) the Intercept task, requiring processing dynamic or moving figures; (2) the mental rotation test, employing rotated asymmetric polygons; and (3) the integrating details test, in which subjects performed a complex visual synthesis. Participants were about…

This study presents data augmenting the validity studies of the Wheatley Cube (McDaniel and Kroll, 1984), a computer managed test of spatial visualization. Twenty-one students in pilot training are administered several instruments designed to measure the ability to construct a cognitive three-dimensional space, including: (1) the Wheatley Cube,…

The use of computers to build diagnostic inferences is presented in two contexts: (1) closed world, exemplified by the space shuttle launch monitoring system; and (2) open world, represented by computerized diagnostic testing of reading comprehension. The analysis shows that the closed world provides a substantially cleaner environment within…

The answer-until-correct procedure has made comparatively little impact on the field of educational testing due to the absence of a sound theoretical base for turning the response data into measures. Three new latent trait models are described. They differ in their complexity, though each is designed to yield a single parameter to measure student…

Two related studies were conducted to determine whether students read all-capital text and mixed text displayed on a computer screen with the same speed and accuracy. Seventy-seven college students read M. A. Tinker's "Basic Reading Rate Test" displayed on a PLATO computer screen. One treatment consisted of paragraphs in all-capital type…

Online practice tests and quizzes are commonly available to higher education students. The extent of student use of such study tools and the relationship of use to achievement, however, have not been fully investigated. One hundred twelve college students were encouraged to use optional online quizzes in preparation for proctored examinations.…

Based on the premise that teaching basic writing involves first understanding what tends to go wrong when students write, a computer assisted system of error prediction and analysis was designed to improve college students' writing skills in both English and French. Students were to complete a sequenced series of writing assignments first in…

The Multnomah County Education Service District (MCESD) provides the following support services to the 12 school districts in its jurisdiction in the metropolitan Portland area: (1) curricular support in terms of developing measurable goals and objectives; (2) support for nationally and locally developed group tests; (3) development and field…

The theory and technology of item characteristic curve (ICC) response theory and adaptive testing were applied to judging individuals' competencies against a prespecified mastery level to determine whether each individual is a "master" or "nonmaster" of a specified content domain. Items from two conventionally administered mastery tests…