The "PISA 2009 Technical Report" describes the methodology underlying the PISA 2009 survey. It examines additional features related to the implementation of the project at a level of detail that allows researchers to understand and replicate its analyses. The reader will find a wealth of information on the test and sample design,…

The purpose of this study was to help determine optimum item sampling plans for use in school evaluation projects. (Author)

A single conceptual and theoretical framework for sampling any configuration of data from one or more population matrices is presented, integrating past designs and discussing implications for more general designs. The theory is based upon a generalization of the generalized symmetric mean approach for single matrix samples. (Author/CTM)

The Minnesota Multiphasic Personality Inventory--Adolescent (MMPI-A) and Minnesota Multiphasic Personality Inventory--2 (MMPI-2) True Response Inconsistency (TRIN) scales are measures of acquiescence and nonacquiescence included among the standard validity scales on these instruments. The goals of this study were to evaluate the effectiveness of…

When norming tests, it may be preferable to use the matrix sampling technique. The results from the samples may be used to estimate what the distribution of scores would have been if each subject had taken all the items. This paper compares four methods for making these estimates. The sample size made it possible to compare the techniques in a…

The problem of dimensionality with respect to Raven's Advanced Progressive Matrices (APM) specifically and, more generally, "g" or fluid intelligence, has been a long-standing issue. The present article reports two studies examining the dimensionality of both the original Set II of the APM (n = 506) and a short form (n = 644), using principal…

Representing a set of required readings for those who would keep abreast of developments in the field of educational evaluation, this book presents nine chapters, each written by a recognized scholar on the topic being considered. Several chapters are also available as separate booklets, thereby increasing the flexibility with which the materials…

The National Assessment of Educational Progress (NAEP) has completed two assessments of mathematics, the first conducted in 1972-73 and the second during 1977-78. Each assessment surveyed the mathematics achievement of American 9-, 13-, and 17-year-olds, using a deeply stratified, multi-stage probability sample design. This report documents…

In 1982, the Educational Testing Service (ETS) proposed to implement a new, complex design for the National Assessment of Educational Progress (NAEP). The major features of this design are described in "A New Design for a New Era" (Messick, Beaton, and Lord, 1983). The purpose of this document is to describe the actual implementation of…

The effectiveness of multiple matrix sampling was examined in a study of 495 students' attitudes toward a computer education program. A post hoc analysis of variance was used, with the class as the unit of analysis. The Computer Attitude Scale, a 30-item rating scale, was used to measure attitudes toward learning about and working with computers.…