This digest introduces ways of responding to the call for criterion-referenced information using Bayes' Theorem, a method that was coupled with criterion-referenced testing in the early 1970s (see R. Hambleton and M. Novick, 1973). To illustrate Bayes' Theorem, an example is given in which the goal is to classify an examinee as being a master or…

This Digest draws from the current literature and the author's experience to identify suggestions for developing performance assessments and their accompanying scoring rubrics. This Digest, part 1, addresses writing goals and objectives and developing performance assessments. Before a performance assessment or scoring rubric is written or…

Matrix sampling of test items, the division of a set of items into different versions of a test form, is used by several large-scale testing programs. This Digest discusses nine categories of costs associated with matrix sampling. These categories are: (1) development costs; (2) materials costs; (3) administration costs; (4) educational costs; (5)…

This Digest provides educators with an overview of some important facets of cognitive science research and suggests implications for classroom assessment. Education researchers study the thinking of experts in various subject areas to understand the concepts and procedures that are the most important to teach and to help determine how to move…

This Digest describes matrix sampling of test items as an approach to achieving broad coverage while minimizing testing time per student. Matrix sampling involves developing a complete set of items judged to cover the curriculum, then dividing the items into subsets and administering one subset to each student. Matrix sampling, by limiting the…

This digest offers tips on designing questionnaires and on avoiding common design errors. The following useful suggestions are offered: (1) keep the questionnaire brief and concise; (2) get feedback on the initial list of questions developed; (3) locate personal or confidential questions at the end of the questionnaire; (4) put categories in…

Criterion-referenced tests (CRTs) are constructed to permit the interpretation of examinee tests performance in relation to a set of well-defined competencies. CRTs are currently used extensively in schools, industry, and the armed services because they provide valuable and different information from norm-referenced tests. Test publishers, school…

Discusses issues in reading assessment, including the concern that tests can not measure the reading process. Concludes that tests will never be more than useful indicators; calls for more research and examination of existing and new types of reading comprehension tests. (MM)

This Digest addresses developing scoring rubrics, administering performance assessments, and scoring, interpreting, and using results. In developing scoring rubrics, the criteria within the scoring rubric should be clearly aligned with the requirements of the task and the state goals and objectives. They should also be expressed in terms of…

This digest presents a list of recommendations for writing multiple-choice test items, based on psychometrics statistics are typically provided by a measurement, or test scoring, service, where tests are machine-scored or by testing software packages. Test makers can capitalize on the fact that "bad" items can be differentiated from…

This digest provides an overview of the concept of alignment and the role it plays in assessment and accountability systems. It also discusses methodological issues affecting the study of alignment and explores the relationship between alignment and test score interpretation. Alignment refers to the degree of match between test content and subject…

This digest presents 11 basic principles to guide the assessment training and professional development of teachers and administrators. These are: (1) assessment is inherently a process of professional judgment; (2) assessment is based on separate but related principles of measurement evidence and evaluation; (3) assessment decision-making is…

This digest discusses the advantages and disadvantages of using item banks, and it provides useful information for those who are considering implementing an item banking project in their school districts. The primary advantage of item banking is in test development. Using an item response theory method, such as the Rasch model, items from multiple…

Pointing out that student testing in literature should take into account each school's philosophy concerning the literature curriculum, this digest explores the broad domain of literature study and looks at specific objectives and outcomes in literature testing. The digest discusses answers to the following questions: (1) Where are the broad…

This digest describes a program used by two New Jersey educators to help teachers improve instruction through a deeper understanding of state standards and test specifications. Understanding how standards-based tests are constructed is the first step in being able to use them to guide and improve instruction. This digest recommends, as the route…