This paper argues that special procedures for constructing assessment tools containing performance assessment tasks are unnecessary and that current test methodology can easily be generalized to complex performance assessment tasks without destroying the desirable characteristics of those tasks. Reasonable statistical requirements for sound…

This paper explores what a responsible test developer would do to support the consequential validity of a test early in the development process, and how the consequential validity of the program should be monitored and addressed during the life of the program. To illustrate the issues concretely, the validity of the American College Testing…

This paper has shown the advantages of tailored testing over traditional methods, the need for latent trait theory in the application of tailored testing, and some of the results available to show the quality of estimates obtained by tailored testing procedures. Since the tailored testing procedures overcome many of the problems with traditional…

Multidimensional item difficulty (MID) is proposed as a means of describing test items which measure more than one ability. With mathematical story problems, for instance, both mathematical and verbal skills are required to obtain a correct answer. The proposed measure of MID is based upon three general assumptions: (1) the probability of…

Tailored testing procedures for achievement testing were applied in a situation that failed to meet some of the specifications generally considered to be necessary for tailored testing. Discrepancies from the appropriate conditions included the use of small samples for calibrating items, and the use of an item pool that was not designed to be…

The American College Testing Program (ACT) is field testing a portfolio assessment model. The field test is designed to determine whether it is possible to implement a portfolio assessment model on a national level that will result in scores that are of sufficient reliability and validity that they can be used for decisions at the student level.…

In this non-experimental study, a model was developed for portfolio assessment based on definitions and applications in the assessment literature. This model describes portfolio components, scores to be computed, and uses to be made of the scores. The literature was then reviewed to find examples of actual applications that would provide realistic…