Three descriptive statistics (difficulty, discrimination, and reliability) of multiple-choice (MC) test items were compared to those of a new (1980s) format of machine-scored questions. The new method, answer-bank multi-digit testing (MDT), uses alphabetized lists of up to 1,000 alternatives and approximates the completion style of assessment…

The present paper represents a demonstration of how LISREL V can be used to investigate scale invariance (1) across time (its relationship to test-retest reliability), and (2) across groups. Five criteria were established to test scale invariance across time and four criteria were established to test scale invariance across groups. Using the…

Describes a study examining the relationship between scores on a Sentence Skills component of an English placement test and final course grades in a community college marketing course. Finds a significant positive correlation between scores and final grades, but one not strong enough to be used for predictive purposes. (13 citations) (BCY)

Assessment procedures to evaluate inpatient treatment effectiveness can provide information to inform clinical practice. The Computerized Assessment System for Psychotherapy Evaluation and Research (CASPER) represents a standardized approach to assess patients' target problems that combines elements of individualized and nomothetic approaches.…

Describes study conducted with U.S. Marine Corps enlisted personnel to measure response time to computer-administered questionnaire items, and to evaluate how measurement of response time might be useful in various research areas. Topics addressed include mood states; the occurrence of straight lining; and experimental effects of sleep loss and…

Multidimensional item response data were created. The strength of a general factor, the number of common factors, the distribution of items loadingon common factors, and the number of items in simulated tests were manipulated. LOGIST effectively recovered both item and trait parameters in nearly all of the experimental conditions. (Author/JAZ)

Reports the results of several test-reliability experiments which compared a modified confidence weighted-admissible probability measurement (MCW-APM) with conventional forced choice or binary type (R-W) test scoring methods. Psychometric properties using G theory and conventional correlational methods are examined, and their implications for…

Description of the development of a theoretically based instrument--the Computer Aversion Scale (CAVS)--to measure negative reactions to computers, focuses on the use of microcomputers in the mental health field. Previous efforts to assess computer anxiety are reviewed, and studies testing the reliability and validity of the CAVS are described.…

This study explored the relationship between traditional item difficulty and cognitive complexity as measured by response time. Rural students (n=43) responded to computer-based tests of the Individualized Study by Technology General Mathematics Course developed by Alaska's Department of Education. Results indicated that mean response times were…

Presents an analysis of the correlation between computerized placement test scores and subsequent academic performance for 74 2-year college students. Finds a low correlation between scores and course pass rates. Suggests that other qualitative measures be employed in addition to computerized testing to assess students. (12 citations) (BCY)

Test-item writing efforts typically results in item pools with an undesirable correlational structure between the content attributes of the items and their statistical information. If such pools are used in computerized adaptive testing (CAT), the algorithm may be forced to select items with less than optimal information, that violate the content…

The purpose of the study was to determine comparability of an online version to the original paper-pencil version of Defining Issues Test 2 (DIT2). This study employed methods from both Classical Test Theory (CTT) and Item Response Theory (IRT). Findings from CTT analyses supported the reliability and discriminant validity of both versions.…

This study examined the construct validity of the "e-rater"® automated essay scoring engine as an alternative to human scoring in the context of TOEFL® essay writing. Analyses were based on a sample of students who repeated the TOEFL within a short time period. Two "e-rater" scores were investigated in this study, the first…

A computer-administered version of the Yale-Brown Obsessive-Compulsive Scale was administered to 31 patients with obsessive-compulsive disorder, 16 with other anxiety disorders, and 23 nonpatient controls. The computer version correlated highly with the clinician-administered version and was well understood and liked by subjects. (SLD)

Discussion of time-related measures in computerized ability tests focuses on a study of college students that used two intelligence test item types to develop a multitrait, multimethod assessment of response time measures. Convergent and discriminant validation are discussed, correlations between response time and accuracy are examined, and…