High dimensional multivariate data, where the number of variables approaches or exceeds the sample size, is an increasingly common occurrence for social scientists. Several tools exist for dealing with such data in the context of univariate regression, including regularization methods such as Lasso, Elastic net, Ridge Regression, as well as the…

Cluster randomized trials involving participants nested within intact treatment and control groups are commonly performed in various educational, psychological, and biomedical studies. However, recruiting and retaining intact groups present various practical, financial, and logistical challenges to evaluators and often, cluster randomized trials…

Multivariate analysis of variance (MANOVA) is widely used in educational research to compare means on multiple dependent variables across groups. Researchers faced with the problem of missing data often use multiple imputation of values in place of the missing observations. This study compares the performance of 2 methods for combining p values in…

In education research, small samples are common because of financial limitations, logistical challenges, or exploratory studies. With small samples, statistical principles on which researchers rely do not hold, leading to trust issues with model estimates and possible replication issues when scaling up. Researchers are generally aware of such…

Clustered data (e.g., students within schools) are often analyzed in educational research where data are naturally nested. As a consequence, multilevel modeling (MLM) has commonly been used to study the contextual or group-level (e.g., school) effects on individual outcomes. The current study investigates the use of an alternative procedure to…

In some instances, intentionally or not, study designs are such that there is clustering in one group but not in the other. This paper describes methods for computing effect size estimates and their variances when there is clustering in only one group and the analysis has not taken that clustering into account. The authors provide the effect size…

Research pertaining to the distortion of the squared canonical correlation coefficient has traditionally been limited to the effects of sampling error and associated correction formulas. The purpose of this study was to compare the degree of attenuation of the squared canonical correlation coefficient under varying conditions of score reliability.…

This article uses meta-analyses published in "Psychological Bulletin" from 1995 to 2005 to describe meta-analyses in psychology, including examination of statistical power, Type I errors resulting from multiple comparisons, and model choice. Retrospective power estimates indicated that univariate categorical and continuous moderators, individual…

Cluster sampling results in response variable variation both among respondents (i.e., within-cluster or Level 1) and among clusters (i.e., between-cluster or Level 2). Properly modeling within- and between-cluster variation could be of substantive interest in numerous settings, but applied researchers typically test only within-cluster (i.e.,…

A Monte Carlo study involving 1,000 random samples from each of 64 different population matrices investigated bias in both canonical correlation and redundancy coefficients. Results indicate that the Wherry correction provides a reasonable solution to this problem and that canonical results are not as biased as has been believed. (TJH)

Oversampling and cluster sampling must be addressed when analyzing complex sample data. This study: (a) compares parameter estimates when applying weights versus not applying weights; (b) examines subset selection issues; (c) compares results when using standard statistical software (SPSS) versus specialized software (AM); and (d) offers…

Canonical correlation analysis is a powerful statistical method subsuming other parametric significance tests as special cases, and which can often best honor the complex reality to which most researchers wish to generalize. However, it has been suggested that the canonical correlation coefficient is positively biased. A Monte Carlo study…

This technical report presents results of an analysis of unit response rates for the components of the 1993-94 Schools and Staffing Surveys (SASS). The study was motivated by the general need to evaluate and improve the quality of SASS data and to identify potential sources of nonsampling error associated with nonresponse in SASS. As background,…