Adaptive measurement of change (AMC) is a psychometric method for measuring intra-individual change on one or more latent traits across testing occasions. Three hypothesis tests--a Z test, likelihood ratio test, and score ratio index--have demonstrated desirable statistical properties in this context, including low false positive rates and high…

This study aimed to investigate the effects of calibration sample size and item bank size on examinee ability estimation in computerized adaptive testing (CAT). For this purpose, a 500-item bank pre-calibrated using the three-parameter logistic model with 10,000 examinees was simulated. Calibration samples of varying sizes (150, 250, 350, 500,…

Most computerized adaptive tests (CATs) have been studied using the framework of unidimensional item response theory. However, many psychological variables are multidimensional and might benefit from using a multidimensional approach to CATs. This study investigated the accuracy, fidelity, and efficiency of a fully multidimensional CAT algorithm…

A substantial amount of research has been conducted over the past 40 years on technical aspects of computerized adaptive testing (CAT), such as item selection algorithms, item exposure controls, and termination criteria. However, there is little literature providing practical guidance on the development of a CAT. This paper seeks to collate some…

Assessing individual change is an important topic in both psychological and educational measurement. An adaptive measurement of change (AMC) method had previously been shown to exhibit greater efficiency in detecting change than conventional nonadaptive methods. However, little work had been done to compare different procedures within the AMC…

Three pyramidal adaptive tests and a conventional peaked test were constructed and administered by computer to two groups of students enrolled in undergraduate psychology courses. Six methods of scoring pyramidal tests were evaluated with respect to score distributions, stability, and the degree of relationship among scoring methods and between…

The effects of immediate knowledge of results (KR) concerning the correctness or incorrectness of each item response on a computer-administered test of verbal ability were investigated. The effects of KR were examined on a 50-item conventional test and a stradaptive ability test and in high- and low-ability groups. The primary dependent variable…

A system of computer programs designed to control the administration of adaptive ability tests was developed and used for over 2500 hours of ability measurement. The system is capable of administering any combination of two kinds of tests to a given individual without interruption. Each test can be based on one of six different testing strategies…

This user manual introduces and explains the Basic Math Mastery Tests (BMMT), a collection of 10 tests of specific mathematics skills. The tests were designed to assess mastery of specific skills required for successful performance in vocational education or in occupations requiring mathematics skills. All 10 tests are administered and scored by…

The effects of providing immediate knowledge of results (KR) and adaptive testing on test anxiety and test-taking motivation were investigated. Also studied was the accuracy of student perceptions of the difficulty of adaptive and conventional tests administered with or without immediate knowledge of results. Testees were 350 college students…

An adaptive testing strategy is described for achievement tests covering multiple content areas. The strategy combines adaptive item selection both within and between the subtests in the multiple-subtest battery. A real-data simulation was conducted to compare the results from adaptive testing and from conventional testing, in terms of test…

The general objective of a research program on adaptive testing was to identify several sources of potential error in test scores, and to study adaptive testing as a means for reducing these errors. Errors can result from the mismatch of item difficulty to the individual's ability; the psychological effects of testing and the test environment; the…

A series of four vocabulary norming tests was used to develop a large, homogeneous pool of vocabulary test items for use in computer-administered adaptive testing research. Five hundred seventy-five unique vocabulary knowledge items were divided among the four norming tests, and administered to separate groups of college undergraduates. Norming…

A two-stage adaptive test and a conventional peaked test were constructed and administered on a time-shared computer system to students in undergraduate psychology courses. (The two-stage adaptive test consisted of a routing test followed by one of a series of measurement tests.) Comparison of the score distributions showed that the two-stage test…

Computerized adaptive testing (CAT) is described and compared with conventional tests, and its advantages summarized. Some item response theory concepts used in CAT are summarized and illustrated. The author describes the potential usefulness of CAT in counseling and education and reviews some current issues in the implementation of CAT.