Research designs that include planned missing data are gaining popularity in applied education research. These methods have traditionally relied on introducing missingness into data collections using the missing completely at random (MCAR) mechanism. This study assesses whether planned missingness can also be implemented when data are instead…

Multilevel structural equation modeling (MSEM) allows researchers to model latent factor structures at multiple levels simultaneously by decomposing within- and between-group variation. Yet the extent to which the sampling ratio (i.e., proportion of cases sampled from each group) influences the results of MSEM models remains unknown. This article…

Cluster randomized control trials often incorporate a longitudinal component where, for example, students are followed over time and student outcomes are measured repeatedly. Besides examining how intervention effects induce changes in outcomes, researchers are sometimes also interested in exploring whether intervention effects on outcomes are…

Longitudinal studies are commonly used in the social and behavioral sciences to answer a wide variety of research questions. Longitudinal researchers often collect data anonymously from participants when studying sensitive topics to ensure that accurate information is provided. One difficulty gathering longitudinal anonymous data is that of…

Large-scale experiments that involve nested structures may assign treatment conditions either to subgroups such as classrooms or to individuals such as students within subgroups. Key aspects of the design of such experiments include knowledge of the variance structure in higher levels and the sample sizes necessary to reach sufficient power to…

Researchers often use generalizability theory to estimate relative error variance and reliability in teaching observation measures. They also use it to plan future studies and design the best possible measurement procedures. However, designing the best possible measurement procedure comes at a cost, and researchers must stay within their budget…

Assessments in response formats with ordered categories are ubiquitous in the social and health sciences. Although the assumption that the ordering of the categories is working as intended is central to any interpretation that arises from such assessments, testing that this assumption is valid is not standard in psychometrics. This is surprising…

Field experiments with nested structures assign entire groups such as schools to treatment and control conditions. Key aspects of such cluster randomized experiments include knowledge of the intraclass correlation structure and the sample sizes necessary to achieve adequate power to detect the treatment effect. The units at each level of the…

This study examined the percentage of task-sampling variability in performance assessment via a meta-analysis. In total, 50 studies containing 130 independent data sets were analyzed. Overall results indicate that the percentage of variance for (a) differential difficulty of task was roughly 12% and (b) examinee's differential performance of the…

Further classification is made of Lindquist's dichotomy of interaction effects. The extension hopefully reduces errors or interpretation and provides a simple, accurate means of summarizing interactions obtained. (Author/RL)

Two studies were conducted to compare responses to matrix questionnaires with those to standard questionnaires. In the first study, the matrix format produced significantly fewer returns. A second study comparing matrix and standard questionnaires of equal size found similar response rates but more incomplete returns for the matrix form.…

Some sampling characteristics of three estimators of the intraclass correlation were investigated under a variety of conditions within the context of a one-way analysis of variance. The results promote caution in the use of all three estimators. The three estimators differed very little in their bias or in their standard errors. (Author/JKS)

Subroutines to calculate exact chi square and Fisher's exact probability tests are presented for 3 by 2 cross-classification tables. A nondirectional probability value for each test is computed recursively. (Author/GDC)

A general analysis strategy is proposed such that the universe of inference is increased incrementally. The strategy prevents logically incongruent findings that occasionally result when the conventional analysis strategy is employed. (Author)

A weighted harmonic means analysis is presented that incorporates all of the available data, preserves the planned proportionality of the design, and avoids the problems associated with the replacement of missing data with sample estimates. (Author/BW)