This paper is concerned with the construction of effect size standard errors in situations where the effect sizes are independent but the data have likely been sampled from non-normal distributions, and possibly for different studies, from different families of non-normal distributions. Asymptotic distribution-free estimators are provided for two…

Demonstrates the inadequacy of students' rating of classroom speeches: student raters were both unreliable and sources of considerable error. Emphasizes the importance of training to reduce error rate. (PD)

Using three different forms of a 61-item administrator/supervisor questionnaire, the effects of both order and grouping were examined in separate analyses. For low-inference type items, factor structures obtained from survey data appear to be affected by item order, and, to a lesser extent, by grouping items. (Author/PN)

The purpose of this simulation was to assess the improvements in estimates of standard errors that could be expected if students participating in NAEP were pre-assigned to test booklets that were adapted to their level of performance based on their state assessment scores. Students in extreme quartiles would receive one regular NAEP block and…

This paper focuses on methodological issues in applying equipercentile equating methods to pairs of tests that do not meet the assumptions of equating. This situation is referred to as a concordance situation, as opposed to an equating situation, and the end result is a concordance table that gives "comparable" scores between the tests.…

This technical report documents the methodology of the National Education Longitudinal Study of 1988 (NELS:88) base year survey of eighth graders through the 1992 second followup survey of high school students and dropouts. Chapter 1 begins with an overview and history of the NELS:88 and its database, Chapter 2 contains a description of the data…

The validity of various reliability-corrected procedures for adjusting for initial differences between groups in uncontrolled studies is established for subjects exhibiting linear fan-spread growth. The results are then extended to a nonlinear model of growth. (Author)

Procedures are described for studying the reliability of decisions based on specific passing scores with tests made up of discrete items and designed to measure continuous rather than categorical traits. These procedures are based on the estimation of the joint distribution of true scores and observed scores. (CTM)

Design, analysis, and reporting considerations for the application of analysis of covariance (ANCOVA) techniques in educational settings are described. Numerous examples are drawn from the national follow through evaluation, and suggestions for improving reports using ANCOVA-type techniques are presented. (Author/BW)

Discusses the use of linear regression methods to extrapolate experimental data. Describes the method of averages and two weighted least squares. Calculates the error range of each method. (YP)

The phenomenon of scale shrinkage is examined. Focus is on the pattern of decreasing variances in item response theory scale scores from fall to spring within a grade. It is demonstrated that questions concerning population distributions of true ability can be addressed with empirical Bayes techniques. (TJH)

Implications of ignoring correlated error on parameter estimates in some simple structural equation models are examined. It is shown analytically and empirically through simulation that ignoring positive between-construct correlated error overestimates the structural parameter linking the two constructs. Effects become more pronounced with…

Conclusions about peer-group influences on academic achievement often depend on the estimation method used to account for endogeneity of school and neighborhood choice. Using High School and Beyond Longitudinal Survey data, this paper shows that aggregation does not reduce the specification error in estimating peer-group benefits. (Contains 25…

Presents a multidimensional conceptualization of family functioning that is embedded within a family systems framework. Discusses operational issues pertaining to the assessment of family functioning when conceived of as a complex and multidimensional construct, and explores measurement strategies and analytical approaches. (JPS)

Psychometricians continue to develop and evaluate methods for linking test scores, both horizontally and vertically. This article describes a social moderation process for articulating (i.e., linking) performance standards across grade levels for an operational state assessment program. The researchers used generated data to evaluate the likely…