Test reliability is a concept central to classical test theory and it is commonly stated as a requirement that a test attain a certain level of reliability before it be considered of sufficient quality for practical use. This article discusses the role of reliability in item response theory, and in particular the role of reliability in contexts…

There has been relatively little discussion in the field of child language acquisition about how best to sample from children's spontaneous speech, particularly with regard to quantitative issues. Here we provide quantitative information designed to help researchers make decisions about how best to sample children's speech for particular research…

Using longitudinal data from the National Survey on Child and Adolescent Well-Being (NSCAW), this study investigates entry into intensive or restrictive settings during a 36-month study period. Specifically, this analysis examines entry into treatment foster care, group homes, residential treatment, and inpatient psychiatric care for youth placed…

Data from the 1999-2000 Annual Survey of Deaf and Hard of Hearing Children and Youth (GRI Annual Survey; Gallaudet Research Institute, 2000) are systematically compared with those summarized by the U.S. Department of Education (2001, 2002) in the Annual Report to Congress on the Implementation of the Individuals With Disabilities Education Act…

This article presents propensity score matching as a method to implement randomized conditions to analyze service effects using nonexperimental data. Most social work research is challenged to implement randomized clinical trials, whereas administrative and survey data are often available and can provide valuable information about services…

Background: The Thinking Styles Inventory--developed by Sternberg and Wagner based on Sternberg's (1988, 1997) earlier theory of mental self-government--was selected for the research in order to assess thinking styles of student teachers. Another reason is that the theoretical constructs, as well as the inventory generated from the theory, have…

Monitoring the Future is a long-term program of research being conducted at the University of Michigan's Institute for Social Research under a series of investigator-initiated research grants from the National Institute on Drug Abuse. Now in its 34th year, the study is comprised of several ongoing series of annual surveys of nationally…

This technical report documents the procedures used to collect and summarize data from the 2005 High School Transcript Study (HSTS 2005). The transcript studies serve as a barometer for changes in high school graduates' course-taking patterns; these patterns provide information about the rigor of high school curricula followed across the nation.…

In 1982, the Educational Testing Service (ETS) proposed to implement a new, complex design for the National Assessment of Educational Progress (NAEP). The major features of this design are described in "A New Design for a New Era" (Messick, Beaton, and Lord, 1983). The purpose of this document is to describe the actual implementation of…

Thirty-four papers on educational statistics which were presented at the 1971 AERA Conference are summarized. Six major interest areas are covered: (a) general information; (b) non-parametric methods; (c) errors of measurement and correlation techniques; (d) regression theory; (e) univariate and multivariate analysis; (f) factor analysis. (MS)

Researchers persist in using stepwise regression in spite of problems with this approach. As noted by B. Thompson (1995), three problems accompany the use of stepwise applications. The first is that computer packages may use incorrect degrees of freedom in their computations, resulting in a greater likelihood of obtaining a spurious statistical…

The National Household Education Survey (NHES) is a data collection system of the National Center for Education Statistics. The NHES is a telephone survey of the noninstitutionalized civilian population using households selected using random digit dialing methods. Approximately 60,000 households are screened for each administration, and people who…

As part of a high-risk youth grant from the Center for Substance Abuse Prevention, the Southwest Regional Laboratory developed and implemented a survey of alcohol sales establishments. The purpose was to assess the availability of alcohol in the community and changes in availability over time that may have an impact on findings related to project…

The zeitgeist for reform in education precipitated a number of changes in assessment. Among these are performance assessments, sometimes linked to "high stakes" accountability decisions. In some instances, the trustworthiness of these decisions is based on variance components and error variances derived through generalizability theory.…

In a complex sampling scheme it is desirable to select the primary sampling units (PSUs) without replacement to prevent duplications in the sample. Since the estimation of the sampling variances is more complicated when the PSUs are selected without replacement, L. Kish (1965) recommends that the variance be calculated using the formulas…