The early stages of development of a prototype test of listening comprehension for English-as-a-Second-Language are described, including objective setting, hardware and software considerations for speech storage and generation, general structure, student attitudes in initial field testing, and needed additional research. Proper creation and use of…

Some software packages currently available for item writing and item banking are reviewed. Eleven test-generation and three item-banking packages are listed. Users trained in item response theory can find a great deal of power in a desk-top system. (SLD)

Description of the development of a theoretically based instrument--the Computer Aversion Scale (CAVS)--to measure negative reactions to computers, focuses on the use of microcomputers in the mental health field. Previous efforts to assess computer anxiety are reviewed, and studies testing the reliability and validity of the CAVS are described.…

This article is the first of a research methods series dedicated to getting good results from survey research. In this series, "good results" is a stenographic term used to define surveys that yield accurate and meaningful information decision makers can use with confidence to identify current practices that merit continuation and to create or…

Computer adaptive testing is the study of scoring tests and questions based on assumptions concerning the mathematical relationship between examinees' ability and the examinees' responses. Adaptive student tests, which are based on item response theory (IRT), have many advantages over conventional tests. We use the least square method, a…

This paper discusses a computer-based prototype called TestMaker that enables educators to create computer-based tests. Given the functional needs of faculty, the host of research implications computer technology has for assessment, and current educational perspectives such as constructivism and their impact on testing, the purposes for developing…

Examinee response times from a computerized adaptive test taken by 204 examinees taking a certification examination were analyzed using a hierarchical linear model. Two equations were posed: a within-person model and a between-person model. Variance within persons was eight times greater than variance between persons. Several variables…

This report summarizes the results from two studies. The first assessed the comparability of scores derived from linear computer-based (CBT) and computer adaptive (CAT) versions of the three Graduate Record Examinations (GRE) General Test measures. A verbal CAT was taken by 1,507, a quantitative CAT by 1,354, and an analytical CAT by 995…

There is a considerable interest at Educational Testing Service (ETS) to include performance-based, natural language constructed-response items on standardized tests. Such items can be developed, but the projected time and costs required to have these items scored by human graders would be prohibitive. In order for ETS to include these types of…

This paper reports on existing studies and uses meta analysis to compare and synthesize the results of 20 studies from 8 research reports comparing the ability measure equivalence of computer adaptive tests (CAT) and conventional paper and pencil tests. Using the research synthesis techniques developed by Hedges and Olkin (1985), it is possible to…

Two studies investigated the comparability of scores from paper-and-pencil and computer-administered versions of the College-Level Examination Program (CLEP) General Examinations in mathematics and English composition. The first study used a prototype computer-administered version on each examination for 94 students for mathematics and 116 for…

The purpose of this research was to compare two different forms of a placement test in French as a second language at the post-secondary level, a conventional test and a computerized test. First, expectations regarding a placement test as a measure of general proficiency are discussed and principles of adaptive testing that have been used to…

This paper offers a scenario for how educational assessment might change in response to market forces that affect not only the future of large-scale testing but also society in general. The scenario divides into three generations distinguished by the purpose of testing, test format and content, and the extent to which testing capitalizes on new…

This handbook provides teachers and administrators with strategies to construct, adapt, and use rubrics. A rubric is defined as a tool for assessing instruction and performance according to predetermined expectations and criteria. The chapters in this text contain guidance on formulating, applying, and reviewing the pros and cons of this form of…

The advent of computers in educational and psychological measurement has lead to the need for algorithms for optimal assembly of tests from item banks. This paper reviews the literature on optimal test assembly and introduces the contributions to this report on the topic. Four different approaches to computerized test assembly are discussed:…