The purpose of this study was to evaluate the combined effects of reduced equating sample size and shortened anchor test length on item response theory (IRT)-based linking and equating results. Data from two independent operational forms of a large-scale testing program were used to establish the baseline results for evaluating the results from…

Operational testing programs employing item response theory (IRT) applications benefit from of the property of item parameter invariance whereby item parameter estimates obtained from one sample can be applied to other samples (when the underlying assumptions are satisfied). In theory, this feature allows for applications such as computer-adaptive…

This paper focuses on item design considerations faced by instructional designers and evaluators when using computer videodisc delivery systems as a means of assessing learner comprehension and competencies. Media characteristics of various interactive computer/videodisc training systems are briefly discussed as well as reasons for using such…

Many testing programs include a section of optional questions in addition to mandatory parts of a test. These optional parts of a test are not often truly parallel to one another, and groups of examinees selecting each optional test section are not equivalent to one another. This paper provides a general method based on missing-data methods for…

A solution to reduce the likelihood of one examinee copying another's answers on large scale tests that require all examinees to answer the same set of questions is to use multiple test forms that differ in terms of item ordering. This study was conducted to determine whether varying the sequence in which blocks of items were presented to…

The Madrid Chamber of Commerce examinations and their usefulness for evaluation of business Spanish students are discussed. Eastern Michigan University is the testing center for a five-state area. The written portion of the exam is graded in Madrid, while the oral portion is graded by the university faculty. Testing procedures and contents of the…

This study examined the cross-lingual equating process adopted by a large scale testing system in which target language (TL) forms are equated to the source language (SL) forms using a set of translated items. The focus was on evaluating the degree of error inherent in the routine cross-lingual equating of the Verbal Reasoning subtest of the…

A procedure used to average several Mantel-Haenszel delta difference values for an item is described and evaluated. The differential item functioning (DIF) procedure used by the Educational Testing Service (ETS) is based on the Mantel-Haenszel statistical technique for studying matched groups. It is standard procedure at ETS to analyze test items…

Increased emphasis on public school accountability has resulted in several states including a science component in their elementary and middle school testing program. This component often includes items designed to measure process skill ability. The purpose of this study was to examine the performance of high school students on four types of…

This study investigated the possible impacts of language and curriculum differences on the performance of test items by subpopulations of students. Focusing on Measurement and Geometry items completed by students in French- and English-language schools in Ontario made it possible to explore the differences and to compare the item response theory…

In the summer of 1996, the U.S. Armed Services will implement the computerized adaptive testing version of the Armed Services Vocational Aptitude Battery (CAT-ASVAB). When conversion is completed at the 65 targeted military entrance processing stations, about half the applicants will take this test version. This paper describes the efforts that…

A study of general student performance in England, Wales, and Northern Ireland undertaken in 1975 is described, and efforts toward developing a new system of school-leaving examinations are discussed. The study was designed to assess existing student evaluation instruments, create new evaluation techniques and instruments, promote cooperation…

This survey investigated: (1) the extent that psychometric criteria are used in test selection; (2) the weight given to different types of psychometric information relative to other qualities of the test; and (3) possible reasons for differences among districts. Directors of testing offices, including members of the National Association of Test…

Although few question the positive impacts alternative forms of assessment can have on instruction, concerns about the psychometric quality of data obtained from such assessments are taking their toll. Scoring issues are at the heart of many of these concerns. This paper addresses the causes of these concerns: misinformation about psychometric…

The primary objective of this study was to investigate overall patterns of gender differences and similarities of test performance in mathematics. To achieve that objective, observed test scores on the Delaware standards-based assessment were analyzed to examine: (1) gender differences and similarities across grades 3, 5, 8 and 10 over 2 years;…