The study examines the rule space model, a probabilistic model capable of measuring cognitive skill acquisition and of diagnosing erroneous rules of operation in a procedural domain. The model involves two important components: (1) determination of a set of bug distributions (bug density functions representing clusters around the rules); and (2)…

Information provided by typical and improved conventional classroom achievement tests was compared with information provided by an adaptive test covering the same subject matter. Both tests were administered to over 700 college students in a general biology course. Using the same scoring method, adaptive testing was found to yield substantially…

To what degree testing can become adaptive is considered in three ways: from a formal methodological perspective; from a human process, stability, perspective; and from a sub-system or component view within an adaptive instructional system (AIS). With the advent of large computer-based training systems, the opportunity to broadly implement…

The purpose of this article is to describe the development, validation and use of the "Constructivist Multimedia Learning Environment Survey" (CMLES). This questionnaire assesses teachers' and students' perceptions of the learning environment when students use online multimedia programs while teachers use constructivism as a referent for…

The Delaware Department of Education (DDOE) was interested in evaluating components of a statewide pilot program to support instruction in World Languages (particularly Spanish and French). The first component was an online student assessment, the Standards-based Measurement of Proficiency (STAMP) to measure the learning outcomes. The DDOE also…

Purpose: The purpose of this paper is to propose and demonstrate an evidence-based scenario design framework for assessment-based computer games. Design/methodology/approach: The evidence-based scenario design framework is presented and demonstrated by using BELLA, a new assessment-based gaming environment aimed at supporting student learning of…

Although many people in education are intimidated by the use of computer-based instruction (CBI), others are committed to exploiting the opportunities it provides. Three areas comprise CBI: instruction about computers, instruction by computers, and instruction using computers; the first two areas have received the most attention. (1) Attention to…

Probabilistic models with more than one latent variable are designed to report profiles of skills or cognitive attributes. Testing programs want to offer additional information beyond what a single test score can provide using these skill profiles. Many recent approaches to skill profile models are limited to dichotomous data and have made use of…

The placement and diagnostic tests used in instructional systems designed to be adaptive to the individual learner's characteristics are examined. The necessity of pretesting students before instruction is questioned. According to the author, both the necessity for and the content of the Individually Prescribed Instruction (IPI) type of pretest…

During a three-year project (1977-1980) on computerized adaptive achievement testing, item characteristic curve theory (ICC) and adaptive testing strategies designed almost exclusively for ability testing were applied to achievement testing. Adaptive techniques substantially reduced test length without reducing quality, when applied to three…

Detecting differential item functioning (DIF) on test items constructed to favor 1 group over another was investigated on parameter estimates from 2 item response theory-based computer programs--BILOG and LOGIST--using data for 1,000 White and 1,000 Black college students. Use of prior distributions and marginal-maximum a posteriori estimation is…

Reports on a study of 257 London Train Operators who viewed a short Computer-based Training Module (CBT), completed a Cognitive Styles Analysis, and then performed related tasks. Multivariate analysis revealed the influence on learning performance of age, cognitive style, and attitude to technology. Includes tables, graphs, and statistical…

This research investigated whether computer anxiety is different if the measure is administered by computer rather than by paper and pencil. The study compared two groups of students (N=83) who were gathered from three undergraduate sections and one graduate section of a required computer class for in-service and pre-service teachers using anxiety…

A study was undertaken at Amarillo College (AC), in Texas, to evaluate the services offered by the college and generate data to provide a basis for personnel planning, the continuation of programs, and the development of new programs. Computerized surveys were developed to ensure increased efficiency in tabulating results and to standardize the…

A situation in which computer-assisted instruction was combined with teacher-taught classes and computerized diagnostic adaptive testing was examined. The computerized diagnostic adaptive test for pre-algebra signed-number lessons was programmed along with a computer-managed routing system by which examinees were sent to the instructional unit…