When the basic unit being studied is a grouping of individuals, both students and items can be sampled. When this method is applied to the use of log sheets to measure fidelity of program implementation, the normal limitations of self-reporting are reduced. (BW)

When evaluating the effectiveness of an educational program, multiple matrix sampling is particularly effective and efficient when the goal of the evaluation is estimating group (as opposed to individual) performance. The technique is described in some detail, with its advantages and disadvantages, and examples of its application are given.…

The governance options matrix is provided to offer a way for state and university policymakers to examine the functioning environments of specific university-owned public teaching hospitals. With it, they can consider the benefits and problems involved with different options for governance. The issues related to the environmental factors affecting…

In computer assisted test construction (CATC) systems, the computer is used to perform the mechanical aspects of testing while the teacher retains control over question content. Advantages of CATC systems include question banks, decreased importance of test item security, computer analysis and response to student test answers, item analysis…

This document presents more useful statewide testing as a rationale for a revision to the California Assessment Program (CAP). A brief description of the revision procedures, and an illustrative outline of the skills and concepts covered by CAP are included. Approximately 270 districts and counties participated in the test development process to…

Two different methods for collecting course-specific data on class learning and growth are discussed. The first, Item/Student Sampling, is directly dependent upon assessing class performance both prior to and following instruction. This procedure relies on multiple matrix sampling techniques. The second method, referred to as Self-Report of Course…

This guide begins with a series of questions and answers that introduce Pennsylvania's Educational Quality Assessment (EQA) Inventory as a 188- to 190-item multiple-choice test for grades 5, 8, and 11. Items are selected from a 400-item bank using matrix sampling procedures. Test results are analyzed at the school level; no individual student…

A technology for domain or criterion referenced testing was developed to evaluate the Minnesota Mathematics and Science Teaching Project (MINNEMAST) in grades K-6. The venture was influenced by the low achievement of MINNEMAST students on standardized tests. After instructional objectives were selected and operationally defined, corresponding test…