This article proposes that sampling design effects have potentially huge unrecognized impacts on the results reported by large-scale district and state assessments in the United States. When design effects are unrecognized and unaccounted for they lead to underestimating the sampling error in item and test statistics. Underestimating the sampling…

Background: Many university departments use students' evaluations of teaching (SET) to compare and rank courses. However, absenteeism from class is often nonrandom and, therefore, SET for different courses might not be comparable. Objective: The present study aims to answer two questions. Are SET positively biased due to absenteeism? Do…

This manual has been produced to familiarize data users with the design, and the procedures followed for data collection and processing, in the base year and first follow-up of the High School Longitudinal Study of 2009 (HSLS:09), with emphasis on the first follow-up. It also provides the necessary documentation for use of the public-use data…

The manual that accompanies these appendices was produced to familiarize data users with the design, and the procedures followed for data collection and processing, in the base year and first follow-up of the High School Longitudinal Study of 2009 (HSLS:09), with emphasis on the first follow-up. It also provides the necessary documentation for use…

This technical report is designed to provide researchers with an overview of the design and implementation of the Teaching and Learning International Survey (TALIS) 2013. This information is meant to supplement that presented in OECD publications by describing those aspects of TALIS 2013 that are unique to the United States. Chapter 2 provides…

This chapter summarizes ten selected issues and common problems that arise in most assessment research projects. These include: (1) the uses of grades in assessment; (2) institutional review boards; (3) research design as a compromise; (4) standardized testing; (5) self-reported measures; (6) missing data; (7) weighting data; (8) conditional…

The Programme for International Assessment of Adult Competencies (PIAAC) will establish technical standards and guidelines to ensure that the survey design and implementation processes of PIAAC yield high-quality and internationally comparable data. This document provides a revised version of the technical standards and guidelines originally…

Piagetian tasks have more to do with the child's ability to inhibit interference than they do with the ability to grasp their underlying logic. Here we used a chronometric paradigm with 11-year-olds, who succeed in Piaget's conservation-of-weight task, to test the role of cognitive inhibition in a priming version of this classical task. The…

In this article, the author analyzes the intertemporal consistency of high school grades as predictors of the academic performance of business administration students over a 2-year period by using data from a university in Germany. This study shows how students' average high school grades and a range of other factors are regressed on the students'…