Background: Specificity and transfer of learning have been examined in experimental studies. However, their findings may not be relevant to practitioners because of the difference between the experiment conditions and teaching situations. This case study investigates the theoretical issue of specificity vs. transfer of learning by conducting…

The purpose of this study was to compare the scores of students who were allowed unlimited retakes of a multiple-choice test with the scores of students who were limited to only four retakes (five trials) of the same test. The tests were each made up of 20 randomly drawn questions from a large pool of questions about research methods. Three…

This paper presents an overview of the design features that were developed for the Content Analysis Project. The purpose of the project was to examine the congruence between a state's test in eighth-grade mathematics and that used by the National Assessment of Educational Progress. The results of this analysis were then to be used to determine…

Different methodologies for linking tests across languages are reviewed and evaluated, focusing on monolingual item response theory, bilingual group designs, and matched monolingual group designs. These methods, although not without weaknesses, are superior for promoting score comparability than methods that rely on translation or expert judgment…

In this study, simulated and actual Air Force test data were used to compare the different procedures for equating mental tests: conventional (equipercentile and linear), Item Response Theory (IRT), and strong true-score theory (STST); data collection designs used were single-group, equivalent-groups, and anchor test. Equating transformations were…

A context in which existing items may provide a convenient source of questions for questionnaires was explored through a case study making use of existing comparison groups. Two programs at Oak Ridge Associated Universities (ORAU), the Science and Engineering Research Semester (SERS) and the Laboratory Graduate Research Participation (Lab Grad)…