A computerized flexilevel test was implemented and its ability estimates were compared with those of a Bayesian estimation based computerized adaptive test (CAT) as well as with known true ability estimates. Results showed that when the flexilevel test was terminated according to Lord's criterion, its ability estimates were highly and…

This study validated computerized versions of selected tests from the Kit of Factor-Referenced Cognitive Tests of 1976, compared performance of higher education students on computerized and paper-and-pencil versions of the tests, and explored whether gender, academic status, or age interacted with the tests. (MBR)

The Internet has become an inevitable tool for collecting health and health behavior questionnaires. This study compared the feasibility, presence of score differences, and subjective evaluations by children between Internet and identical paper (asthma/fruit) questionnaires in elementary schools. A randomized crossover design was applied, with…

This study was designed to address two frequent criticisms of the SAT essay--that essay length is the best predictor of scores, and that there is an advantage in using more "sophisticated" examples as opposed to personal experience. The study was based on 2,820 essays from the first three administrations of the new SAT. Each essay was…

This study evaluated agreement between expert system and human scores on 12 algebra word problems taken by Graduate Record Examinations (GRE) General Test examinees from a general sample of 285 and a study sample of 30. Problems were drawn from three content classes (rate x time, work, and interest) and presented in four constructed-response…

Results of administering a computerized adaptive version of the Grammar, Spelling, and Punctuation Test (GSP) to students in the College of Communication at the University of Texas, Austin were studied. The computerized adaptive version (CAT) was administered for the first time in June 1992 to 35 prospective students who participated in the…

This study compared essay scores from paper-based and computer-based versions of a writing test for prospective teachers. Scores for essays in the paper-based version averaged nearly half a standard deviation higher than those in the computer-based version, after applying a statistical control for demographic differences between the groups of…

Monte Carlo simulation was used to investigate score bias and information characteristics of Owen's Bayesian adaptive testing strategy, and to examine possible causes of score bias. Factors investigated in three related studies included effects of item discrimination, effects of fixed vs. variable test length, and effects of an accurate prior…

The purposes of this study were to determine if there is a significant difference in postsecondary business student scores and test completion time based on settable test item exposure control interface format, and to determine if there is a significant difference in student scores and test completion time based on settable test item exposure…

Describes the use of the Northwest Evaluation Association's Achievement Level Test for Reading as an assessment tool in an elementary school to measure student progress in reading. Discusses interpreting scores across grade levels; computerized versions; linking test items to new curriculum; reducing reading class size; and the role of technology.…

The instructional validity of computer administered tests was studied with a focus on whether differences in test scores and item behavior are a function of instructional mode (computer versus non-computer). In the first of 3 studies, performance test scores for approximately 400 high school students in 1990-91 for tasks accomplished with the…

The study evaluated the comparability of two versions of a teacher certification test: a paper-and-pencil test (PPT) and computer-based test (CBT). Standardized mean difference (SMD) and differential item functioning (DIF) analyses were used as measures of comparability at the test and item levels, respectively. Results indicated that effect sizes…

Student achievement test scores were compared and equated, using three different testing methods: paper-administered, computer-administered, and computerized adaptive testing. The tests were developed from third and sixth grade mathematics item banks of the California Assessment Program. The paper and the computer-administered tests were identical…

A study involving four sections of a general psychology course at Delta College (Michigan) was conducted to determine: (1) the effectiveness of repeated, cumulative testing on long-term retention of information; (2) its effect on students' ability to generalize information learned as measured by the College Level Examination Program (CLEP) general…

Item parameter estimates vary for a variety of reasons, including estimation error, characteristics of the examinee samples, and context effects (e.g., item location effects, section location effects, etc.). Although we expect variation based on theory, there is reason to believe that observed variation in item parameter estimates exceeds what…