Generalized symmetric means are redefined in a way which allows them to be calculated for any matrix sampling design. It is proved that these sample generalized symmetric means are unbiased estimates of the analogous population generalized symmetric means. Illustrative examples are given. (Author)

The approach to outcome research described here has the double merit of preserving individuality and permitting pooling of data for overall analysis of results. (Author)

This study examined the psychosocial correlates and psychometric properties of the Self-Assessed Wisdom Scale (SAWS) (Webster, 2003a). Seventy-three men and 98 women ranging in age from 17-92 years (Mean age = 42.77) completed an expanded, 40-item version of the SAWS, the Loyola Generativity Scale, and the Experiences in Close Relationships Scale.…

Sternberg (1981) presented correlations based on independent samples of about 25 cases each with a statistical comparison in a population parameter of zero and interpreted his results as if with appropriate tests. He needed to use a nonzero population parameter and compare for the difference between the z transformations. (Author/CM)

Sternberg's reply to paper Humphrey criticizes (see TM 507 045) includes: (1) invited position paper and detailed statistical testing would have been inappropriate; (2) Humphrey commits some of "misdeeds" of which he accuses Sternberg; (3) number of cases in the three nonentrenchment experiments are more than adequate for drawing conclusions; and…

Investigated empirically through post mortem item-examinee samplings were the relative merits of two alternative procedures for allocating items to subtests in multiple matrix sampling and the feasibility of using the jackknife in approximating standard errors of estimate. (Editor)

A single conceptual and theoretical framework for sampling any configuration of data from one or more population matrices is presented, integrating past designs and discussing implications for more general designs. The theory is based upon a generalization of the generalized symmetric mean approach for single matrix samples. (Author/CTM)

Described is a method to assist developers of mathematics programs to make formative evaluations. The method involves periodic achievement testing via item sampling. Details of item construction, periodic testing, and profile construction are given in a discussion of how this method was applied to modify a sixth-grade mathematics program. (JP)

The authors describe 2 efficiency (planned missing data) designs for measurement: the 3-form design and the 2-method measurement design. The 3-form design, a kind of matrix sampling, allows researchers to leverage limited resources to collect data for 33% more survey questions than can be answered by any 1 respondent. Power tables for estimating…

Sixteen item statistics recommended for use in the development of criterion-referenced tests were evaluated. There were two major criteria: (1) practicability in terms of ease of computation and interpretation and (2) meaningfulness in the context of the development process. Most of the statistics were based on a comparison of performance changes…

Multiple matrix sampling of three subscales of the California Psychological Inventory was used to investigate the effects of four variables on error estimates of the mean (EEM) and variance (EEV). The four variables were examinee population size (600, 450, 300, 150, 100, and 75); number of subtests, (2, 3, 4, 5, 6, and 7), hence the number of…

As a new program is developed, information must be collected to identify weaknesses, to guide the staff in the revision process, and to formulate decision-making procedures, i.e., formative evaluation techniques are essential. A set of criteria for the information needed in formative evaluation is set-up and a practical strategy for meeting these…

Representing a set of required readings for those who would keep abreast of developments in the field of educational evaluation, this book presents nine chapters, each written by a recognized scholar on the topic being considered. Several chapters are also available as separate booklets, thereby increasing the flexibility with which the materials…

It is argued in this paper that generalizability theory provides a uniquely useful framework for defining and quantifying the dependability of data for decision making. It does so by requiring careful specification of the conditions of measurement and the anticipated sources of variation in the results of the measurement procedure. A distinction…

A new Joint Comprehensive Evaluation System for the assessment of 15 different federal programs has been developed by the U.S. Office of Education. In this system these diverse program services will be thought of as resources available to meet the needs of critical target groups. Using this approach, a set of nine crucial questions that need to be…