One of the most important effect sizes used in meta-analysis is the standardized mean difference (SMD). In this article, the conditions under which SMD effect sizes based on different measures of the same construct are directly comparable are investigated. The results show that SMD effect sizes from different measures of the same construct are…

The term "gifted" implies a permanent superiority. However, the majority of children who score in the top few percentiles on ability and achievement tests in 1 grade do not retain their status for more than a year or 2. The tendency of those with high scores on one occasion to obtain somewhat lower scores on a later occasion is one…

This study investigates item parameter recovery, standard error estimates, and fit statistics yielded by the WINSTEPS program under the Rasch model and the rating scale model through Monte Carlo simulations. The independent variables were item response model, test length, and sample size. WINSTEPS yielded practically unbiased estimates for the…

As item response theory (IRT) becomes popular in educational and psychological testing, there is a need of reporting IRT-based effect size measures. In this study, we show how the standardized mean difference can be generalized into such a measure. A disattenuation procedure based on the IRT test reliability is proposed to correct the attenuation…

Intraindividual variability in positive and negative affect was assessed by the positive affect (Contentment, Joy, Vigor, Love, and Excitement) and negative affect (Depression, Hostility, Anxiety, Agitation, and Social Anxiety) subscales of the state version of the Comprehensive Personality and Affect Scales (COPAS) during a 3-week period. Using…

As part of No Child Left Behind (NCLB) legislation, many states are using confidence intervals to determine a range of scores for evaluating a school system. More specifically, the states are employing confidence intervals to help minimize measurement error in determining a school system's performance. The methodology and techniques employed in…

There are usually many testing activities going on in a school, with different tests serving different purposes, thus organization and planning are key in creating an efficient system in assessing the most important educational objectives. In the ideal case, an assessment system will be able to inform on student learning, instruction and…

In this technical report, the authors describe the development and piloting of reading comprehension measures as part of a comprehensive progress monitoring literacy assessment system developed in 2006 for use with students in Kindergarten through fifth grade. They begin with a brief overview of the two conceptual frameworks underlying the…

The AP Course Audit utilizes a criterion-based professional judgment method of analysis within a nested multi-step review process. The overall goal of the methodology is to yield a final judgment on each syllabus that is ultimately valid. While reviewer consistency is an important consideration, the most important goal is to reach a final judgment…

Research in structured equation modeling (SEM) suggests that nonnormal data will invalidate chi-square tests and produce erroneous standard errors. However, much remains unknown about the extent to which, and the conditions under which nonnormal data can affect SEM application, especially when excessive skewness and kurtosis are present in data.…

School-effectiveness research has not yet been able to identify the factors of effective and noneffective schools, the real contribution of the significant factors, the true sizes of school effects, and the generalizability of school-effectiveness results. This paper presents findings of a meta analysis, the Dutch PSO programme, that was used to…

This report provides an overview of a selection of measurement error studies conducted on National Center for Education Statistics (NCES) surveys. Its intent is not to offer new analyses of program data, but to summarize information from internal memoranda, working papers, and adjudicated reports about errors of measurement that occur during five…

Technical aspects of the first followup survey for the National Education Longitudinal Study of 1988 (NELS:88) are documented and summarized. Some information overlaps materials in the users' manuals for this followup, such as the overview and general descriptions of data collection, sampling, weighting, variance estimation, nonresponse patterns,…

Large sample standard errors of linear equating for the single-group design are derived without making the normality assumption. Two general methods based on the delta method of M. Kendall and A. Stuart (1977) are described. One method uses the exact partial derivatives, and the other uses numerical derivatives. Simulation using the beta-binomial…

Some specific computer-based tools for collecting and examining audit trails, i.e., data that describe a learner's path through a computer-based instruction (CBI) lesson, are detailed. Data analysis and measurement issues related to audit trails are also discussed. A particular set of embedded computer-based tools currently being used at San Diego…