Using data from multiple informants has long been considered best practice in education. However, multiple informants often disagree on similar constructs, complicating decision-making. Polynomial regression and response-surface analysis (PRA) is often used to test the congruence effect between multiple informants on an outcome. However, PRA…

Many experimental designs in educational and behavioral research involve at least one level of clustering. Clustering affects the precision of estimators and its impact on statistics in cross-sectional studies is well known. Clustering also occurs in longitudinal designs where students that are initially grouped may be regrouped in the following…

Mixed-effects models can be used to examine the association between a categorical moderator and the magnitude of the effect size. Two approaches are available to estimate the residual between-studies variance, t[superscript 2][subscript res] --namely, separate estimation within each category of the moderator versus pooled estimation across all…

When selecting a multilevel model to fit to a dataset, it is important to choose both a model that best matches characteristics of the data's structure, but also to include the appropriate fixed and random effects parameters. For example, when researchers analyze clustered data (e.g., students nested within schools), the multilevel model can be…

For the two-way factorial design in analysis of variance, the current article explicates and compares three methods for controlling the Type I error rate for all possible simple interaction contrasts following a statistically significant interaction, including a proposed modification to the Bonferroni procedure that increases the power of…

Structured means analysis is a very useful approach for testing hypotheses about population means on latent constructs. In such models, a z test is most commonly used for testing the statistical significance of the relevant parameter estimates or of the differences between parameter estimates, where a z value is computed based on the asymptotic…

Rubric-referenced calibration and the interaction between writing achievement and calibration, a measure of the relationship between one's performance and the accuracy of one's judgments, were investigated. Undergraduate students (N = 596) were assigned to one of three calibration conditions: (a) global, (b) global and general criteria, or (c)…

Multilevel modeling has grown in use over the years as a way to deal with the nonindependent nature of observations found in clustered data. However, other alternatives to multilevel modeling are available that can account for observations nested within clusters, including the use of Taylor series linearization for variance estimation, the design…

To better understand dimensions of text complexity and their effect on the comprehension of adolescents, 103 high school seniors were randomly assigned to 4 groups. Each group read versions of the same 2 informational passages and answered comprehension test items targeting factual recall and inferences of causal content. Group A passages had a…

The authors used a person-centered, longitudinal approach to identify and evaluate naturally occurring combinations of intrinsic and extrinsic motivations among 490 third- through fifth-grade students. Cluster analysis revealed 3 groups, characterized by high levels of both motivations ("high quantity"): high intrinsic motivation but low…

In 3 experiments, undergraduates used their own best method (control) or an "imposed" face-name mnemonic strategy to associate 18 caricatured faces, names, and additional facts. On all immediate tests (prompted by the faces), and on the delayed tests of Experiments 2a and 2b combined, mnemonic students statistically outperformed control students…

The authors tested whether students can be taught to better understand conventional representations in diagrams, photographs, and other visual representations in science textbooks. The authors developed a teacher-delivered, workbook-and-discussion-based classroom instructional method called Conventions of Diagrams (COD). The authors trained 1…

Previous work on statistical power has discussed mainly single-level designs or 2-level balanced designs with random effects. Although balanced experiments are common, in practice balance cannot always be achieved. Work on class size is one example of unbalanced designs. This study provides methods for power analysis in 2-level unbalanced designs…

A procedure is discussed for testing the significance of the difference in two correlated correlation coefficients, using Fisher's Z-Transformation. The procedure is applicable to a wide range of problems involving tests between dependent correlations and has documented mathematical support when its power curves are examined. (MH)

Studied a major problem with null hypothesis significance testing (NHST) and two common misconceptions about NHST and considered how these issues are treated in 12 recent textbooks used in education research methods and statistics classes. Findings show that almost all textbooks do not acknowledge controversies surrounding NHST. (SLD)