Reading skills are crucial to students learning and using English as a second language for academic purposes. Teachers can construct valid reading tests if they approach the task with care and focus on the test's ability to measure construct rather than face validity. In reading tests, the crucial elements of test design affecting validity are (1)…

The Rasch model for test score equating was compared with three other equating procedures as methods for implementing the norm referenced method (RMC Model A) of evaluating ESEA Title I projects. The Rasch model and its theoretical limitations were described. The three other equating methods used were: linear observed score equating, linear true…

The National Assessment of Educational Progress (NAEP) has completed two assessments of mathematics, the first conducted in 1972-73 and the second during 1977-78. Each assessment surveyed the mathematics achievement of American 9-, 13-, and 17-year-olds, using a deeply stratified, multi-stage probability sample design. This report documents…

A linear regression model was used to select items from a pool of 700 arithmetic word problems to be used in a computer-assisted mathematics curriculum for elementary school students. The experimental procedure first involved a stepwise linear regression analysis of a student's performance over a set of 25 problems. The probability correct for…

The existence of criterion-referenced (CR) measurement is questioned in this paper. Despite beliefs that differences exist between two alternative forms of measurement, CR and Norm Referenced (NR), an analysis of philosophical and psychological descriptions of measurement, as well as a growing number of empirical studies, reveal that the common…

A new Joint Comprehensive Evaluation System for the assessment of 15 different federal programs has been developed by the U.S. Office of Education. In this system these diverse program services will be thought of as resources available to meet the needs of critical target groups. Using this approach, a set of nine crucial questions that need to be…

Outlines a method to write multiple (four) versions of each examination. Reviews some advantages and disadvantages of multiple-choice and open-ended problems. Considers the writing and grading techniques used. Reports that the examination met the consistency requirement and received a good evaluation from students. (YP)

A review of the literature on a variety of issues related to testing vocabulary knowledge in a second language addresses these topics: problems in estimating vocabulary size, including the related questions of what constitutes a word, how a sample should be selected, and what are the criteria for knowing a word; sampling the basic and specialized…

This guide begins with a series of questions and answers that introduce Pennsylvania's Educational Quality Assessment (EQA) Inventory as a 188- to 190-item multiple-choice test for grades 5, 8, and 11. Items are selected from a 400-item bank using matrix sampling procedures. Test results are analyzed at the school level; no individual student…

In 1982, the Educational Testing Service (ETS) proposed to implement a new, complex design for the National Assessment of Educational Progress (NAEP). The major features of this design are described in "A New Design for a New Era" (Messick, Beaton, and Lord, 1983). The purpose of this document is to describe the actual implementation of…

The central assumption in domain-referenced testing (DRT), as presented in this book, is that a domain may be determined which adequately represents a particular universe of knowledge. After a domain has been established, the technological and practical problem of using domain-referenced testing must be solved. This book contains a collection of…

Thirty-four papers on educational statistics which were presented at the 1971 AERA Conference are summarized. Six major interest areas are covered: (a) general information; (b) non-parametric methods; (c) errors of measurement and correlation techniques; (d) regression theory; (e) univariate and multivariate analysis; (f) factor analysis. (MS)

The effectiveness of multiple matrix sampling was examined in a study of 495 students' attitudes toward a computer education program. A post hoc analysis of variance was used, with the class as the unit of analysis. The Computer Attitude Scale, a 30-item rating scale, was used to measure attitudes toward learning about and working with computers.…

This guide begins with a series of questions and answers which introduce Pennsylvania's Educational Quality Assessment (EQA) Inventory as a 188-to 190-item multiple choice test for fifth, eighth, and eleventh grades. Items are selected from a 400-item bank using matrix sampling procedures. Test results are analyzed at the school level; no…

A central problem for the user of domain-referenced tests in instruction is deciding who has passed and who has failed. Two procedures were presented and discussed. The first, employing classical test theory, was found to be more useful for larger domains and where the passing standard is 70 percent or less. The sampling procedure suggested by…