Matrix sampling of test items, the division of a set of items into different versions of a test form, is used by several large-scale testing programs. This Digest discusses nine categories of costs associated with matrix sampling. These categories are: (1) development costs; (2) materials costs; (3) administration costs; (4) educational costs; (5)…

This Digest describes matrix sampling of test items as an approach to achieving broad coverage while minimizing testing time per student. Matrix sampling involves developing a complete set of items judged to cover the curriculum, then dividing the items into subsets and administering one subset to each student. Matrix sampling, by limiting the…

This brief overview notes that an adaptive test differs from standardized achievement tests in that it does not consist of a certain set of items that are administered to a group of examinees. Instead, the test is individualized for each examinee. The items administered to the examinee are selected from a large pool of items on the basis of the…

This digest presents a list of recommendations for writing multiple-choice test items, based on psychometrics statistics are typically provided by a measurement, or test scoring, service, where tests are machine-scored or by testing software packages. Test makers can capitalize on the fact that "bad" items can be differentiated from…

Questions are addressed that focus on why lower class and minority group test takers score lower on standardized tests than their middle class Anglo counterparts. The questions include the following: (1) In what ways can dialect differences affect testing? (2) How can dialect differences directly affect a test of language? (3) Shouldn't standard…

Some basic concepts of the one-parameter logistic latent-trait model, or the Rasch model, are presented. This model assumes that the probability of a correct answer to an item is a function of two parameters, one representing the difficulty of the item and one representing the ability of the subject. The purpose of this paper is to explain a…

This digest discusses the advantages and disadvantages of using item banks, and it provides useful information for those who are considering implementing an item banking project in their school districts. The primary advantage of item banking is in test development. Using an item response theory method, such as the Rasch model, items from multiple…

This digest reviews the basic building blocks of a structured interview, points out some of the pitfalls in interviewing, and suggests ways for researchers to avoid these difficulties to produce questions that have the best possibility of generating reliable and accurate data on the topics of interest. The data collection instrument is a document…

This digest introduces three issues to consider when evaluating test items for bias: fairness, bias, and stereotyping. In any bias investigation, the first step is to identify the subgroups of interest. Bias reviews and studies generally focus on differential performance for sex, ethnic, cultural, and religious groups. In preparing an item bias…

In this digest a rationale is given for using open-ended questions in the assessment of student achievement, the use of open-ended questions in reading is discussed, and some implications for the classroom are outlined. Research has helped shift the focus from learning as content knowledge per se to learning as the ability to use and interpret…

Part One of this guide explores issues in English proficiency testing. Tests are discussed in terms of the aspect of language tested, and of different kinds of test tasks. The following kinds of test task defects are treated: (1) tests that required literacy skills, (2) tasks that reduce to a vocabulary test, and (3) errant notions of linguistic…

This digest describes some basics of the construction of multiple-choice tests. As a rule, the test maker should strive for test item stems (introductory questions or incomplete statements at the beginning of each item that are followed by the options) that are clear and parsimonious, answers that are unequivocal and chosen by the students who do…

This digest presents a list of recommendations for writing multiple-choice test items, based on psychometrics and logical deduction. Questions should ask more than mere knowledge of facts and should not contain superfluous information as an introduction to the question. Each question should focus on some specific aspect of the course, and the item…

Biographical inventory is a selection device used as an alternative or supplement to cognitive testing because this measurement method predicts aspects of job performance that are not predicted by cognitive measures. Some of the issues and concerns about using biographical inventories are discussed. The use of biographical inventories (biodata) is…

This report provides an overview of the current applications of computer technology to construct test items and/or to formulate tests according to sound measurement principles. The test items may be computer-generated from strategies programmed by test constructors, or pre-constructed by item writers and stored in computer memory. The tests…