Experiments allow researchers to randomly vary the key manipulation, the instruments of measurement, and the sequences of the measurements and manipulations across participants. To date, however, the advantages of randomized experiments to manipulate both the aspects of interest and the aspects that threaten internal validity have been primarily…

This chapter summarizes ten selected issues and common problems that arise in most assessment research projects. These include: (1) the uses of grades in assessment; (2) institutional review boards; (3) research design as a compromise; (4) standardized testing; (5) self-reported measures; (6) missing data; (7) weighting data; (8) conditional…

Mediation and moderation are two theories for refining and understanding a causal relationship. Empirical investigation of mediators and moderators requires an integrated research design rather than the data analyses driven approach often seen in the literature. This paper described the conceptual foundation, research design, data analysis, as…

Second-generation early intervention research typically involves the specification of multivariate relations between interventions, outcomes, and other variables. Moderation and mediation involve variables or sets of variables that influence relations between interventions and outcomes. Following the framework of Baron and Kenny's (1986) seminal…

Structural equation modeling (SEM) is a data-analytic technique that allows researchers to test complex theoretical models. Most published applications of SEM involve analyses of cross-sectional recursive (i.e., unidirectional) models, but it is possible for researchers to test more complex designs that involve variables observed at multiple…

A structural equation modeling approach to scale reliability evaluation can be employed to estimate generalizability theory indexes in settings where sampling of subjects and conditions is carried out. In one- and two-facet crossed designs, it is demonstrated how this method can be used to obtain estimates of relative generalizability…

The authors describe 2 efficiency (planned missing data) designs for measurement: the 3-form design and the 2-method measurement design. The 3-form design, a kind of matrix sampling, allows researchers to leverage limited resources to collect data for 33% more survey questions than can be answered by any 1 respondent. Power tables for estimating…