Generalizability theory, which subsumes classical measurement theory as a special case, provides a general model for estimating the reliability of observational rating data by estimating the variance components of the measurement design. Research data from the "Heart Smart" health intervention program were analyzed as a heuristic tool.…

A teaching aid appropriate for a beginning course on experimental design is presented. The aid is a numerical example which illustrates some of the theoretical interrelations among three competing design analysis strategies for estimating treatment effects in random assignment designs. The analysis strategies considered are analysis of variance…

Rules, procedures, and algorithms intended to aid researchers and practitioners in the application of generalizability theory to a broad range of measurement problems are presented. Two examples of measurement research are G studies, which examine the dependability of some general measurement procedure; and D studies, which provide the data for…

The effects of the violation of the assumption of normality coupled with the condition of multicollinearity upon the outcome of testing the hypothesis Beta equals zero in the two-predictor regression equation is investigated. A monte carlo approach was utilized in which three differenct distributions were sampled for two sample sizes over…

A latent trait model, the Rasch, was fitted to a criterion-referenced test. Approximately 90 percent of the items fit the model. Those items which fit the model were then calibrated. Based on the item calibration, individual ability estimates and the standard errors of those estimates were calculated. Using the ability estimates, it was possible,…

In a multiple (or multivariate) regression model where the predictors are subject to errors of measurement with a known variance-covariance structure, two-sample hypotheses are formulated for (i) equality of regressions on true scores and (ii) equality of residual variance (or covariance matrices) after regression on true scores. The hypotheses…

The objective of this study was to review and integrate the various methodologies used in the study of individual growth (especially academic growth). This was accomplished by means of Joreskog's general model for the analysis of covariance structures, i.e., each of the disparate methodologies available from the literature was shown to be a…

In an experiment manipulating artificial data in a factorial design, model misspecification and varying levels of error in measurement and in model structure are shown to have significant effects on LISREL parameter estimates in a modified peer influence model. (Author/LMO)

The National Household Education Survey (NHES) is a data collection system of the National Center for Education Statistics (NCES) designed to address a wide range of education-related issues. It is a telephone survey of the noninstitutionalized civilian population. In 1995, the NHES included a survey of adult education (AE). This report examines…

A 1994 report, "Quality Profile for SASS, Aspects of the Quality of Data in the Schools and Staffing Surveys (SASS)," presented and summarized the available information about the quality of the data from the five surveys that made up the SASS in its first two rounds of data collection (1987-1988 and 1990-1991). This report updates the…

Since 1964, colleges have been sending data to the College Board Validity Study Service in order to determine the degree to which measures used in admissions predict college performance. These studies have allowed for the monitoring of general trends in the relationship of SAT scores and high school grades with freshman grades. Beginning in the…

The first High School and Beyond follow-up survey, conducted in 1982, included sub-samples of 29,737 sophomore cohort and 11,995 senior cohort representatives from the base year survey samples. During the fall of 1982, nearly 18,500 of the sophomore cohort members selected for the first follow-up survey were subsampled for the High School and…

A critical review of the Expressive One-Word Picture Vocabulary Test (Gardner) is offered. The reviewer feels that the instrument cannot be recommended in its present form. Further research concerning the manual, and theoretical issues, (particularly test-retest stability) is strongly recommended. (Author/PN)

Reviews a number of issues relating to the results of evaluation studies: standards of acceptability; clinical vs. statistical significance; fallacies in the use of theory; and program, theory, measurement, and design failure. (Journal availability: Subscription Manager, MOBIUS, University of California Press, Berkeley, CA 94720.) (SK)

Even in an educational tests and measurements classroom it is possible to stimulate student creativity and divergent thinking. Examples of projects and test constructions are given to provide food for thought for the creative teacher. (JN)