The purpose of this study was, first, to understand the item hierarchy regarding students' understanding of scientific models and modeling (USM). Secondly, this study investigated Taiwanese students' USM progression from 7th to 12th grade, and after participating in a model-based curriculum. The questionnaire items were developed based on 6…

Matrix sampling of test items, the division of a set of items into different versions of a test form, is used by several large-scale testing programs. This Digest discusses nine categories of costs associated with matrix sampling. These categories are: (1) development costs; (2) materials costs; (3) administration costs; (4) educational costs; (5)…

This Digest describes matrix sampling of test items as an approach to achieving broad coverage while minimizing testing time per student. Matrix sampling involves developing a complete set of items judged to cover the curriculum, then dividing the items into subsets and administering one subset to each student. Matrix sampling, by limiting the…

This digest presents a list of recommendations for writing multiple-choice test items, based on psychometrics statistics are typically provided by a measurement, or test scoring, service, where tests are machine-scored or by testing software packages. Test makers can capitalize on the fact that "bad" items can be differentiated from…

This digest discusses the advantages and disadvantages of using item banks, and it provides useful information for those who are considering implementing an item banking project in their school districts. The primary advantage of item banking is in test development. Using an item response theory method, such as the Rasch model, items from multiple…

This digest reviews the basic building blocks of a structured interview, points out some of the pitfalls in interviewing, and suggests ways for researchers to avoid these difficulties to produce questions that have the best possibility of generating reliable and accurate data on the topics of interest. The data collection instrument is a document…

This digest introduces three issues to consider when evaluating test items for bias: fairness, bias, and stereotyping. In any bias investigation, the first step is to identify the subgroups of interest. Bias reviews and studies generally focus on differential performance for sex, ethnic, cultural, and religious groups. In preparing an item bias…

In this digest a rationale is given for using open-ended questions in the assessment of student achievement, the use of open-ended questions in reading is discussed, and some implications for the classroom are outlined. Research has helped shift the focus from learning as content knowledge per se to learning as the ability to use and interpret…

This digest describes some basics of the construction of multiple-choice tests. As a rule, the test maker should strive for test item stems (introductory questions or incomplete statements at the beginning of each item that are followed by the options) that are clear and parsimonious, answers that are unequivocal and chosen by the students who do…

This digest presents a list of recommendations for writing multiple-choice test items, based on psychometrics and logical deduction. Questions should ask more than mere knowledge of facts and should not contain superfluous information as an introduction to the question. Each question should focus on some specific aspect of the course, and the item…

Biographical inventory is a selection device used as an alternative or supplement to cognitive testing because this measurement method predicts aspects of job performance that are not predicted by cognitive measures. Some of the issues and concerns about using biographical inventories are discussed. The use of biographical inventories (biodata) is…

Second language (L2) computer-adaptive testing (CAT) is a technologically advanced method of assessment in which the computer selects and presents test items to examinees according to the estimated level of the examinee's language ability. The basic notion of an adaptive test is to mimic automatically what a wise examiner would normally do.…

Authentic reading assessment is examined, focusing on its implementation within the Michigan Essential Skills Reading Test (MESRT). Authentic reading assessment emerged as a response to research that indicates that reading is not a particular skill but an interaction among reader, text, and the context of the reading situation. Unlike formal…

This digest discusses how well authentic mathematics assessment tests can be expected to meet the needs of mathematics instruction that focuses on conceptual insights and analytical skills. In the new mathematics curriculum, situational lessons or real-life problems attempt to include dimensions of thinking and reasoning, individual or small-group…