This article proposes that sampling design effects have potentially huge unrecognized impacts on the results reported by large-scale district and state assessments in the United States. When design effects are unrecognized and unaccounted for they lead to underestimating the sampling error in item and test statistics. Underestimating the sampling…

Background: Many university departments use students' evaluations of teaching (SET) to compare and rank courses. However, absenteeism from class is often nonrandom and, therefore, SET for different courses might not be comparable. Objective: The present study aims to answer two questions. Are SET positively biased due to absenteeism? Do…

This technical report is designed to provide researchers with an overview of the design and implementation of the Teaching and Learning International Survey (TALIS) 2013. This information is meant to supplement that presented in OECD publications by describing those aspects of TALIS 2013 that are unique to the United States. Chapter 2 provides…

Piagetian tasks have more to do with the child's ability to inhibit interference than they do with the ability to grasp their underlying logic. Here we used a chronometric paradigm with 11-year-olds, who succeed in Piaget's conservation-of-weight task, to test the role of cognitive inhibition in a priming version of this classical task. The…

Factor scale scores are sometimes used as weights to create composite variables representing the variables included in a factor analysis. If these composite variables are then used to predict some dependent variable, serious theoretical and methodological problems arise. This paper explores these problems and suggests strategies for circumventing…

In this article, the author analyzes the intertemporal consistency of high school grades as predictors of the academic performance of business administration students over a 2-year period by using data from a university in Germany. This study shows how students' average high school grades and a range of other factors are regressed on the students'…

The first High School and Beyond follow-up survey, conducted in 1982, included sub-samples of 29,737 sophomore cohort and 11,995 senior cohort representatives from the base year survey samples. During the fall of 1982, nearly 18,500 of the sophomore cohort members selected for the first follow-up survey were subsampled for the High School and…

Because analyses of reaction-time data are sensitive to aberrant observations and violations of statistical assumptions, a new approach is suggested. In this empirical approach, one applies the same criteria to the problem of selecting a statistical method as one uses to select among alternative experimental procedures. Six criteria are presented…

This memorandum demonstrates a variance components methodology for partitioning the overall design effect (D) for a ratio mean into stratification (S), unequal weighting (W), and clustering (C) effects, so that D = WSC. In section 2, a sample selection scheme modeled after the National Longitudinal Study of the High School Class of 1972 (NKS)…

The report traces the activities which led to the development of the adjusted weights--beginning with the basic National Longitudinal Study design, the base-year weight calculations, and the resurvey procedures. Next, the report describes the first follow-up weight calculations (including unadjusted student weights), nonresponse adjustment…

This report is the methodology report for the National Longitudinal Study of the High School Class of 1972 follow-up in 1986. The fifth follow-up survey of the National Longitudinal Study of the High School Class of 1972 (NLS-72) took place during spring and summer of 1986. A mail questionnaire was sent to a subsample of 14,489 members of the…

Chapter 1 of this report and user's manual describes design and implementation of the 1992 National Adult Literacy Survey (NALS). Chapter 2 reviews stages of sampling for national and state survey components; presents weighted and unweighted response rates for the household component; and describes non-incentive and prison sample designs. Chapter…

Activities involved in the collection and assembling of data for computer processing from the first followup survey of the National Longitudinal Study of the High School Class of 1972 (NLS) are briefly described. Included are an overview of the NLS; the sample design and survey participation; the development of the first followup survey…