Children (ages 5, 7, and 9 years) and young adults completed two visual attention tasks that required them to make a forced choice identification response to a target shape presented in the center of a computer screen. In the first task (high correlation condition) each target was flanked with the same distracters on 80% of the trials (valid…

This study investigated factors related to score differences on computerized and paper-and-pencil versions of a series of primary K-3 reading tests. Factors studied included item and student characteristics. The results suggest that the score differences were more related to student than item characteristics. These student characteristics include…

The purpose of the study was to determine comparability of an online version to the original paper-pencil version of Defining Issues Test 2 (DIT2). This study employed methods from both Classical Test Theory (CTT) and Item Response Theory (IRT). Findings from CTT analyses supported the reliability and discriminant validity of both versions.…

Undergraduate students routinely rated science-related courses such as biopsychology as intimidating and very difficult. Identification of factors that may contribute to success in these types of courses is important in order to help increase performance and interest in these topics. To examine what variables are related to performance, we studied…

This study investigates the application of voice recognition technology to online lectures focusing on the efficacy of the text component of a multimedia presentation. Specifically, participants were provided with online access to multimedia instructional packages comprising an image of the lecturer with accompanying computer slides, plus…

When an examination consists, in whole or in part, of constructed response items, it is a common practice to allow the examinee to choose among a variety of questions. This procedure is usually adopted so that the limited number of items that can be completed in the allotted time does not unfairly affect the examinee. This results in the de facto…

The purpose of this study was to identify differentially functioning items on operational administrations of the Graduate Management Admission Test (GMAT) through the use of the Mantel-Haenszel statistic. Retrospective analyses of data collected over 3 years are reported for black/white and female/male comparisons for the Verbal and Quantitative…

The annotated reading list cites works of fiction and non-fiction felt to be appropriate for learners of English as a Second Language (ESL) or English as a Foreign Language (EFL). Most are suitable for students at the "professional proficiency" level, although some may be read by students at the "limited working proficiency" level, and some are…

Examinee response times from a computerized adaptive test taken by 204 examinees taking a certification examination were analyzed using a hierarchical linear model. Two equations were posed: a within-person model and a between-person model. Variance within persons was eight times greater than variance between persons. Several variables…

Tests in social studies and integrated science given in Saint Vincent, Saint Lucia, Grenada, and Dominica were analyzed by the Organization for Co-operation in Overseas Development (OCOD) Comprehensive Teacher Training Program (CTTP) for discrimination, difficulty, and reliability, as well as other characteristics. There were 767 examinees for the…

This study investigated the characteristics of Computer-based Case Simulations (CCS) that may be associated with case difficulty. Difficulty was defined as the average rating by physicians of examinee performance on a nine-point scale or the passing rate on the cases. Two data sets were used, one from an administration of 18 cases to 201 medical…

When an examination consists in whole or part of constructed response test items, it is common practice to allow the examinee to choose a subset of the constructed response questions from a larger pool. It is sometimes argued that, if choice were not allowed, the limitations on domain coverage forced by the small number of items might unfairly…

A Monte Carlo study was conducted to estimate the small sample standard errors and statistical bias of psychometric statistics commonly used in the analysis of achievement tests. The statistics examined in this research were: (1) the index of item difficulty; (2) the index of item discrimination; (3) the corrected item-total point-biserial…

A study investigated differences in discourse styles that may affect second language listening comprehension. Ten amateur actors performed three speaking tasks: (1) reading aloud a short self-contained narrative; (2) acting out a memorized script; and (3) conversing with the researcher for 20-30 minutes. Excerpts of the recorded tasks in different…

This paper explores the comparability of item calibrations for three types of items: (1) text only; (2) text with photographs; and (3) text plus graphics when items are presented on written tests and computerized adaptive tests. Data are from five different medical technology certification examinations administered nationwide in 1993. The Rasch…