It has been proposed that the Objective Measure of Ego Identity Status and its scoring criteria should be adjusted to utilize a half standard deviation cutoff. Evidence is provided to support the claim that less stringent criteria will lead to higher numbers classified while arriving at the same research results. This proposal is considered and,…

A comparison is made of the power and actual alpha levels of three tests of homogeneity for independent product-moment correlation coefficients using Monte Carlo methods while selectively studying sample size and varying the number of correlation reliabilities. How robust these are in applied work is discussed. (SLD)

Presents an exercise that gives students a real feeling for experimental errors and demonstrates the importance of frequent repetition and averaging. (JRH)

Application of the bootstrap method to complex psychological analysis is illustrated using a simulation experiment with two populations with small and large samples. The method provides variance estimates, allows testing of nested competing models, and gives a preliminary idea about parameter variability. (SLD)

W. M. K. Trochim and others defend the record of the regression-discontinuity (RD) design and blur the statistical tests for treatment effect. Their Monte Carlo results show the problematic nature of RD and its potential bias. New testing strategies and restrictions for the application of RD are proposed. (SLD)

Multilevel models used to assess and compare school effectiveness, particularly their application to multivariate data, are critiqued. Problems associated with standard errors of measurement and the various components of "school effect" are highlighted in terms of how they could affect incautious application of the models. (TJH)

Four approaches to estimating interrater reliability in early childhood special education research are illustrated and compared: correlation, comparison of means, percentage of agreement, and generalizability theory techniques. Generalizability theory techniques are proposed as a method for estimating the amount of variance attributable to…

Pseudo-Maximum Likelihood (p-ML) and Asymptotically Distribution Free (ADF) estimation methods for estimating dynamic factor model parameters within a covariance structure framework were compared through a Monte Carlo simulation. Both methods appear to give consistent model parameter estimates, but only ADF gives standard errors and chi-square…

Presents a general discussion of the conceptual and operational limitations found within the existing efforts to assess constructs central to the study of parents. The discussion is followed by a review and critique of measures designed to assess concepts central to research on parents. Includes recommendations to improve the quality of measures.…

Empirical studies demonstrated Type-I error (TIE) inflation (especially for highly discriminating easy items) of the Mantel-Haenszel chi-square test for differential item functioning (DIF), when data conformed to item response theory (IRT) models more complex than Rasch, and when IRT proficiency distributions differed only in means. However, no…

Objectives: To evaluate whether or not the original six-factor structure of the Child Abuse Potential (CAP) Inventory suggested by [Milner, J. S. (1986). "The Child Abuse Potential Inventory: Manual" (2nd ed.). DeKalb, IL: Psytec. Inc.] can be confirmed with data from a group of Chinese mothers in Hong Kong. Method: Eight hundred and…

Two Monte Carlo studies were conducted to explore the Type I error rates in moderated multiple regression (MMR) of observed scores and estimated latent trait scores from a two-parameter logistic item response theory (IRT) model. The results of both studies showed that MMR Type I error rates were substantially higher than the nominal alpha levels…

Test-retest reliability of the Test of Variables of Attention (T.O.V.A.) was investigated in two studies using two different time intervals: 90 min and 1 week (plus or minus 2 days). To investigate the 90-min reliability, 31 school-age children (M = 10 years, SD = 2.66) were administered the T.O.V.A. then read ministered the test 90 min afterward.…

The purpose of this study was to evaluate the criterion-related validity of a 3-min step test using 3 stepping cadences. Chinese children (N = 50; age = 8.92 plus or minus 1.64 years) performed three 3-min bouts of a bench stepping exercise on a 12-in.-high (30.5 cm) bench. Stepping cadences for the 3 step tests were 22, 26, and 30 steps per…

A simulation study was conducted to examine the effect of item parceling on confirmatory factor analysis parameter estimates and their standard errors at different levels of sample size, number of indicators per factor, size of factor structure/pattern coefficients, magnitude of interfactor correlations, and variations in item-level data…