The assessment framework underlying a science performance monitoring program is process-oriented and intended to appeal to generalizability theory for a suitable estimation paradigm. Preliminary applications are described. Results suggest that computerized question-banking, domain-sampling of questions, and generalizablity theory together provide…

Item parameter estimates vary for a variety of reasons, including estimation error, characteristics of the examinee samples, and context effects (e.g., item location effects, section location effects, etc.). Although we expect variation based on theory, there is reason to believe that observed variation in item parameter estimates exceeds what…

The availability of item response times made possible by computerized testing represents an entirely new type of information about test items. This study explores the issue of how to represent response-time information in item banks. Empirical response-time distribution functions can be fit with statistical distribution functions with known…

The original data strategy on which PISA was based suggested that, after the completion of the first three assessments in 2000, 2003 and 2006, the cycle would repeat itself with three-yearly assessments in the areas of reading, mathematics and science. However, in light of newly emerging policy priorities and the experience gained with PISA so…

Evaluating the comparability of a test administered in different languages is a difficult, if not impossible, task. Comparisons are problematic because observed differences in test performance between groups who take different language versions of a test could be due to a difference in difficulty between the tests, to cultural differences in test…

The extensive computer simulation work done in developing the computer adaptive versions of the Graduate Record Examinations (GRE) Board General Test and the College Board Admissions Testing Program (ATP) Scholastic Aptitude Test (SAT) is described in this report. Both the GRE General and SAT computer adaptive tests (CATs), which are fixed length…

The Law School Admission Council (LSAC) is currently investigating the feasibility and advisability of administering a computerized Law School Admission Test (LSAT). In this context, using data from the College Boards 1989 National Advanced Placement (AP) Chemistry Examination for 18,462 test takers and a survey of all AP Chemistry teachers in…

This final report presents findings of a Wyoming research project designed to test the possibility of using interactive technology in the assessment, at a distance, of infants and toddlers in rural or frontier areas. The project compared the quality of reports developed when a transdisciplinary assessment team conducted assessments either in…

This paper demonstrates that an electronic tutoring program can collect data that enables a far more reliable assessment of students' skills than a standard examination. Socratic electronic homework tutor, CyberTutor can integrate effectively instruction and assessment. CyberTutor assessment has about 62 times less variance due to random test…

Presents a general framework for human factors considerations in training and illustrates the relationship between human factors and computer-based training (CBT) research by descriptions of studies dealing with six major aspects of the CBT interface: training administration, management, instructional design and development, testing and…

The accuracy of estimation of the subjects' latent ability maintained by tailoring for each testee the order of item presentation and the border of item dichotomization was compared to the information provided by the original graded test items. (RC)

Thirty-seven college students with learning disabilities were given a reading comprehension task under the following conditions: (1) using an optical character recognition/speech synthesis system; (2) having the text read aloud by a human reader; or (3) reading silently without assistance. Findings indicated that the greater the disability, the…

Describes the nature of recent changes in the International English Language Testing System (IELTS) and provides a rationale for their introduction. Notes that IELTS is widely accepted as a reliable means of assessing whether candidates are ready to study or train in the medium of English. (five references) (Author/CK)

Investigates the interaction between the presence or absence of explicit instruction and the variables complexity and morphology/syntax in the acquisition of four second language (L2) structures. Results from computer-controlled posttests confirm the hypothesis that explicit instruction facilitates the acquisition of L2 grammar. (66 references)…

Describes the use of Accelerated Reader, a computer program that instantly provides scored tests on a variety of books read by high school ESL (English as a Second Language) students as free voluntary reading. Topics include reading improvement programs, including writing assignments; and changes in students' reading habits. (LRW)