The Program for the International Assessment of Adult Competencies (PIAAC) is a multicycle survey of adult skills and competencies sponsored by the Organization for Economic Cooperation and Development (OECD). The survey examines a range of basic skills in the information age and assesses these adult skills consistently across participating…

The commenter's proposal may be a reasonable method for addressing uncertainty in predictive modeling, where the goal is to predict "y." In a treatment effects framework, where the goal is causal inference by conditioning-on-observables, the commenter's proposal is deeply flawed. The proposal (1) ignores the definition of…

Identifying mediators in variable chains as part of a causal mediation analysis can shed light on issues of causation, assessment, and intervention. However, coefficients and effect sizes in a causal mediation analysis are nearly always small. This can lead those less familiar with the approach to reject the results of causal mediation analysis.…

Survival is difficult to estimate when observation periods of individuals differ in length. Students imagine sailing the Titanic and then recording whether they "live" or "die." A clever algorithm is performed which results in the Kaplan-Meier estimate of survival.

The purpose of this report is to analyze the stability of students' reliable integrated trend scores (RITS) over time and to determine which elementary school factors predict RITS at the secondary level.

The purpose of this study is to review the literature on the most accurate indicators of students at risk of dropping out of high school. We used Relative Operating Characteristic (ROC) analysis to compare the sensitivity and specificity of 110 dropout flags across 36 studies. Our results indicate that 1) ROC analysis provides a means to compare…

The focus of this paper is assessing the impact of measurement errors on the prediction error of an observed-score regression. Measures are presented and described for decomposing the linear regression's prediction error variance into parts attributable to the true score variance and the error variances of the dependent variable and the predictor…

The problem of factor score indeterminacy implies that the factor and the error scores cannot be completely disentangled in the factor model. It is therefore proposed to compute Harman's factor score predictor that contains an additive combination of factor and error variance. This additive combination is discussed in the framework of classical…

Background music has been found to have beneficial, detrimental, or no effect on a variety of behavioral and psychological outcome measures. This article reports a meta-analysis that attempts to summarize the impact of background music. A global analysis shows a null effect, but a detailed examination of the studies that allow the calculation of…

Despite questions about validity and reliability, the use of value-added estimation methods has moved beyond academic research into state accountability systems for teachers, schools, and teacher preparation programs (TPPs). Prior studies of value-added measurement for TPPs test the validity of researcher-designed models and find that measuring…

Common source bias has been the focus of much attention. To minimize the problem, researchers have sometimes been advised to take measurements of predictors from one observer and measurements of outcomes from another observer or to use separate occasions of measurement. We propose that these efforts to eliminate biases due to common source…

We find the correlation of two jointly distributed random variables connected with a coin tossing experiment. The marginal distributions are binomial and negative binomial.

In this chapter, the authors discuss the issue of research design in conducting inquiry on college impact and demonstrate the importance of longitudinal pretest-posttest designs in maximizing the internal validity of findings. They begin by discussing the strengths and weaknesses of different types of research design in the college impact…

This paper employs conditional second moments to identify the impact of education in wage regressions where education is treated as endogenous. This approach avoids the use of instrumental variables in a setting where instruments are frequently not available. We employ this methodology to estimate the returns to schooling for a sample of…

The 2003 National Assessment of Adult Literacy (NAAL) assessed the English literacy skills of a nationally representative sample of 18,500 U.S. adults (age 16 and older) residing in private households. NAAL is the first national assessment of adult literacy since the 1992 National Adult Literacy Survey (NALS). The NAAL and NALS produced direct…