Analyzes simulated performance ratings on a six-point scale by two independent raters to account for nonsystematic error in performance ratings. Results suggest that rater agreement or covariance is not always a dependable estimate of score reliability and that the practice of seeking additional raters for adjudication of discrepant ratings is not…

The construct and predictive validities of many administrator performance-assessment systems used for diagnosis, certification, and selection are questionable. The present study investigated both types of validity for one system, the Administrator Diagnostic Inventory (ADI). Results from assessing 316 individuals suggest that caution and…

It is well-known that for normally distributed errors parametric tests are optimal statistically, but perhaps less well-known is that when normality does not hold, nonparametric tests frequently possess greater statistical power than parametric tests, while controlling Type I error rate. However, the use of nonparametric procedures has been…

Whether hierarchical logistic regression can reduce the sample size requirement for estimating optimal cutoff scores in a course placement service where predictive validity is measured by a threshold utility function is explored. Data from courses with varying class size were randomly partitioned into two halves per course. Nonhierarchical and…

To examine the predictive utility of three scales provided in the released database of the Third International Mathematics and Science Study (TIMSS) (international plausible values, standardized percent correct score, and national Rasch score), information was obtained on the performance in state examinations in mathematics and science in 1996…

Exact nonparametric procedures have been used to identify the level of differential item functioning (DIF) in binary items. This study explored the use of exact DIF procedures with items scored on a Likert scale. The results from an attitude survey suggest that the large-sample Cochran-Mantel-Haenszel (CMH) procedure identifies more items as…

This article describes the formulation and execution of the Rainbow Project, Phase I, funded by the College Board. Past data suggest that the SAT is a good predictor of performance in college. But in terms of the amount of variance explained by the SAT, there is room for improvement, as there would be for virtually any single test battery. Phase I…

In three samples consisting of community and undergraduate men and women and incarcerated men, we examined the criterion validity of two distinct factors of psychopathy embodied in the Psychopathic Personality Inventory (PPI) as indexed by primary trait scales from the Multidimensional Personality Questionnaire (MPQ). Consistent with the PPI…

Following a review of important factors and considerations among youths displaying behavior problems, this study examined the predictive validity of the Santa Barbara Assets and Risks Assessment (SB ARA) with a population of European American and Mexican American high-risk adolescents (n = 566). The results of this study provide evidence that the…

Approximately seven years after completing a photographic essay about the self, 44 adults were surveyed about their lives, current creative activities, and their work values. In accord with prediction, those who devised richer, more multidimensional and creative photo essays--the more individualistic--were engaged in more creative lifestyles as…

Investigations that focus on children's hand gestures often conclude that gesture production arises as a result of having multiple representations. To date, the predictive validity of this notion has not been tested. In this study, we compared the gestures of 82 five-year-old children holding either a single or a dual representation. The children…

Researchers and educators continue to try to understand and predict premature post-secondary institutional departure. According to social cognitive theory, self-efficacy beliefs are the gateway to understanding why individuals initiate behavior, the effort they expend in engaging in behavior, and their persistence in the face of obstacles. College…

Narrative reviews have raised several questions regarding the predictive validity of the Hare Psychopathy Checklist-Revised (PCL-R; R. D. Hare, 2003) and related scales in institutional settings. In this meta-analysis, the authors coded 273 effect sizes to investigate the association between the Hare scales and a hierarchy of increasingly specific…

The underlying mechanism of search asymmetry is still unknown. Many computational models postulate top-down selection of target-defining features as a crucial factor. This feature selection account implies, and other theories implicitly assume, that predefined target identity is necessary for search asymmetry. The authors tested the validity of…

Development and validation of the 14-item Teacher-Student Relationship Inventory (TSRI) is described. The TSRI is a self-report measure assessing teacher perceptions of the quality of their relationship with students from Grade 4 through junior high school. In Study 1, findings from exploratory factor analysis provided evidence for a 3-factor…