Multiple matrix sampling of three subscales of the California Psychological Inventory was used to investigate the effects of four variables on error estimates of the mean (EEM) and variance (EEV). The four variables were examinee population size (600, 450, 300, 150, 100, and 75); number of subtests, (2, 3, 4, 5, 6, and 7), hence the number of…

In computer assisted test construction (CATC) systems, the computer is used to perform the mechanical aspects of testing while the teacher retains control over question content. Advantages of CATC systems include question banks, decreased importance of test item security, computer analysis and response to student test answers, item analysis…

Educational testing and measurement on an international basis is viewed from the new quantitative perspective provided by the Comprehensive Achievement Monitoring (CAM) method. The technique of longitudinal testing through item sampling employed in CAM is seen as being of significant value in formulating a systematic measure of achievement across…

As an alternative to a classical test theory basis for criterion-referenced test construction, it is proposed that a strict item-sampling model be used. The computer's role in such a model is outlined. The assumptions of the model are carefully defined and its properties reviewed. The relationship between mastery criteria and such sampling plans…

The post mortem item-examinee sampling investigation described herein explored the feasibility of using item-examinee sampling to estimate scale values denoting degree of affect toward stimuli when measured by the method of paired-comparisons. Results indicate clearly that such scale values can be approximated satisfactorily through item-examinee…

Under given conditions, conventional testing and computer-generated repeatable testing (CGRT) are equally effective for estimating examinee ability; CGRT is more effective for estimating the mean ability level of a group and less effective for estimating ability differences among individuals. These conclusion are drawn from domain-referenced test…

A review of four areas in which the computer has influenced the theory and practice of achievement testing: a) test scoring and item analysis, b) item sampling, c) item generation, and d) the sequencing of items resulting in various types of adaptive testing. Also, reference is made to the impact of computer assisted achievement testing upon the…

A matrix model for the collection, management, and utilization of data was developed at Eastern Iowa Community College District, (Davenport, Iowa) for evaluating institutional effectiveness. The model was examined in relation to various assessment instruments and the evaluation of functional areas and programs. Surveys of six different target…

This report investigates the selection of appropriate texts for C-Tests, a modified form of the cloze test, for assessing second language learning. The procedure for textbook readability first involved the administration of different texts to sample groups to determine the C-test difficulty of individual texts. At the same time, a variety of…

This document presents more useful statewide testing as a rationale for a revision to the California Assessment Program (CAP). A brief description of the revision procedures, and an illustrative outline of the skills and concepts covered by CAP are included. Approximately 270 districts and counties participated in the test development process to…

Empirical evidence is presented related to the effects of using a stratified sampling of items in multiple matrix sampling on the accuracy of estimates of the population mean. Data were obtained from a sample of 600 high school students for a 36-item mathematics test and a 40-item vocabulary test, both subtests of the Iowa Tests of Educational…

Technical considerations associated with item selection and reliability assessment are considered in relation to criterion-referenced tests constructed to provide group information. The purpose is to emphasize test building and the evaluation of test scores in program evaluation studies. It is stressed that an evaluator employ a performance or…

As a new program is developed, information must be collected to identify weaknesses, to guide the staff in the revision process, and to formulate decision-making procedures, i.e., formative evaluation techniques are essential. A set of criteria for the information needed in formative evaluation is set-up and a practical strategy for meeting these…

California Assessment Program's application of matrix sampling and item response curve theory to the scaling and reporting of state assessment data is described. It is designed to express educational outcomes in an efficient and interpretable form that is both immediately informative and suited to analysis over extended periods of time.…

This guide is designed to help college students understand educational states, portfolio assessment, competency matrices, and self-evaluation as it relates to the presentation of technical materials in the engineering sciences. Part 1 discusses definitions of education and learning, the concept of lifelong learning, and educational states…