Short scales are time-efficient for participants and cost-effective in research. However, researchers often mistakenly expect short scales to have the same reliability as long ones without considering the effect of scale length. We argue that applying a universal benchmark for alpha is problematic as the impact of low-quality items is greater on…

The "PISA 2009 Technical Report" describes the methodology underlying the PISA 2009 survey. It examines additional features related to the implementation of the project at a level of detail that allows researchers to understand and replicate its analyses. The reader will find a wealth of information on the test and sample design,…

This article examines the utility of multi-matrix sampling as a technique in health education research that permits collection of large quantities of data without lengthy questionnaires or excessive time demands on respondents. Advantages and limitations of multi-matrix sampling are delineated through a hypothetical example. (Authors/CJ)

The approach to outcome research described here has the double merit of preserving individuality and permitting pooling of data for overall analysis of results. (Author)

The assumption that an examinee's response to an item is independent of the context in which it occurs is tested. (PR)

In a post-mortem study of item sampling, 1,050 examinees were divided into ten groups 50 times. Each time, their papers were scored on four different sets of item samples from a 150-item test of academic aptitude. These samples were selected using (a) unstratified random sampling and stratification on (b) content, (c) difficulty, and (d) both.…

In a project to identify and verify professional competencies for beginning industrial education teachers, researchers found a 173-item questionnaire unwieldy. Using multiple-matrix sampling, they distributed subsets of items to respondents, resulting in adequate returns as well as duplication, postage, and time savings. (SK)

Described is a method to assist developers of mathematics programs to make formative evaluations. The method involves periodic achievement testing via item sampling. Details of item construction, periodic testing, and profile construction are given in a discussion of how this method was applied to modify a sixth-grade mathematics program. (JP)

One solution to the problem of obtaining test scores in order to assess multiple outcomes of educational programs is a basically simple technique called matrix sampling. Matrix sampling is the estimation of total test score statistics by administering random subsets of test items to randomly selected students. This chapter lays out the specific…

The equivalency of item sampling and student sampling of attitudes of college students was investigated. A factor analysis of student-sampled data collected during Spring 1968, was compared with a factor analysis of item-sampled data collected each quarter from Fall 1968, through Winter 1970, at Mankato State College, using the Campus Environment…

The procedure of item sampling was employed to reduce the time expenditure of participants when responding to a questionnaire concerned with the implementation of an innovative elementary school project. Approximately 50 student teachers and 42 regular classroom teachers responded to one of two forms of the questionnaire. There was a total of 103…

In studies involving matrix sampling on items, it is often the case that there are too few responses per individual to use latent trait item response models. A model is formulated wherein individual level variability appears as independent error within the cells of a cross classification of demographic variables. (JKS)

Thirty-four papers on educational statistics which were presented at the 1971 AERA Conference are summarized. Six major interest areas are covered: (a) general information; (b) non-parametric methods; (c) errors of measurement and correlation techniques; (d) regression theory; (e) univariate and multivariate analysis; (f) factor analysis. (MS)