In this paper, a data perturbation method for minimizing the possibility of disclosure of participants' identities on a survey is described in the context of the National Assessment of Educational Progress (NAEP). The method distinguishes itself from most approaches because of the presence of cognitive tasks. Hence, a data edit should have minimal…

Most research in the area of higher education is plagued by the problem of endogeneity or self-selection bias. Unlike ordinary least squares (OLS) regression, propensity score matching addresses the issue of self-selection bias and allows for a decomposition of treatment effects on outcomes. Using panel data from a national survey of bachelor's…

The present study investigates whether the Early Development Instrument (Offord & Janus, 1999) measures school readiness similarly across different groups of children. We employ ordinal logistic regression to investigate differential item functioning, a method of examining measurement bias. For 40,000 children, our analysis compares groups…

The purpose of this investigation was to test the age-related measurement invariance and temporal stability of the 13-item version of Antonovsky's Sense of Coherence Scale (SOC). Multigroup structural equation modeling of longitudinal data from the Canadian National Population Health Survey was used to examine the measurement invariance across 3…

The question of how to analyze unbalanced hierarchical data generated from structural equation models has been a common problem for researchers and analysts. Among difficulties plaguing statistical modeling are estimation bias due to measurement error and the estimation of the effects of the individual's hierarchical social milieu. This paper…

The Reflective Judgment Model and associated interview (RJI) (Kitchener and King, 1981) measure the ability of individuals to reason about ill-structured problems. It has gained popularity as a measure of college outcomes associated with postsecondary education. This study examines general claims for the model made from existing data from 15 of 25…

Unlike many instruments used to measure the attitudes and practices of college composition teachers, the Survey of Attitudes and Practices of Teachers of Freshman Composition (SAPTFC) is based on a generalized theory of teaching at the college level, classifying instruction into three groups: didactic, heuristic, and philetic. In composition…

Validity generalization meta-analysis (VG) examines the extent to which the validity of an instrument can be transported across settings. VG offers correction and summarization procedures designed in part to remove the effects of statistical artifacts on estimates of association between criterion and predictor. By employing a random effects model,…

An attempt was made to determine which item response theory (IRT) equating method results in the least amount of equating error or "scale drift" when equating scores across one or more test forms. An internal anchor test design was employed with five different test forms, each consisting of 30 items, 10 in common with the base test and 5…

The Type I error and power properties of the 2x2x2 analysis of variance (ANOVA) and tests developed by McSweeney (1967), Bradley (1979), Harwell-Serlin (1989; Harwell, 1991), and Blair-Sawilowsky (1990) were compared using Monte Carlo methods. The ANOVA was superior under the Gaussian and uniform distributions. The Blair-Sawilowsky test was…

The wide availability of large amounts of inexpensive computing power has encouraged statisticians to explore many approaches to a basis for inference. This paper presents one such "computer-intensive" approach: the bootstrap of Bradley Efron. This methodology fits between the cases where it is assumed that the form of the distribution…

Describes an activity designed to introduce concepts of randomness and standard deviation. (CP)

Weighting and variance estimation are two statistical issues involved in survey data analysis for large-scale assessment programs such as the Higher Education Information and Communication Technology (ICT) Literacy Assessment. Because survey data are always acquired by probability sampling, to draw unbiased or almost unbiased inferences for the…

Parametric analysis of covariance was compared to analysis of covariance with data transformed using ranks. Using a computer simulation approach the two strategies were compared in terms of the proportion of Type I errors made and statistical power when the conditional distribution of errors were: (1) normal and homoscedastic, (2) normal and…

BRRVAR, which uses the Balanced Repeated Replication approach, was designed for use with the Statistical Analysis System (SAS). It was created for the National Center for Education Statistics, to enlarge their capacity to estimate and analyze sampling errors for statistics generated from educational surveys with complex sampling designs. BRRVAR…