The Scylla and Charybdis in this discussion of teacher evaluation are standardized achievement test data on the one hand, and classroom observational systems on the other. These are the two most common methods used to judge teachers' competency. Both have serious flaws: the former primarily with validity, the latter primarily with reliability. At…

The purpose of this article is to describe and analyze the edTPA, a performance assessment created by the Stanford Center for Assessment, Learning, and Equity (SCALE) and administered by Pearson, Inc., to assess the professional readiness of student teachers. We challenge claims made in support of using this assessment, specifically within the…

This article examines a government attempt to impose testing of 4-year-olds as a baseline against which to "hold primary schools accountable" for children's subsequent progress. It examines the various forms of baseline testing in this experiment and analyses the misleading claims made for the "predictive validity" of baseline…

Cognitive ability tests are widely used in organizations around the world because they have high predictive validity in selection contexts. Although these tests typically measure several subdomains, testing is usually carried out for a single subdomain at a time. This can be ineffective when the subdomains assessed are highly correlated. This…

This study presents a case for applying a transformation (Box and Cox, 1964) of the criterion used in predictive validity studies. The goals of the transformation were to better meet the assumptions of the linear regression model and to reduce the residual variance of fitted (i.e., predicted) values. Using data for the 2008 cohort of first-time,…

Sackett, Borneman, and Connelly argued that several common criticisms of cognitively laden tests are not well supported by the literature. The authors' systematic exploration of research surrounding seven specific criticisms is laudable, and we do not find fault with their conclusions as presented. In evaluating the seven concerns, however, the…

We are pleased that our article prompted this series of four commentaries and that we have this opportunity to respond. We address each in turn. Duckworth and Kaufman and Agars discussed, respectively, two broad issues concerning the validity of selection systems, namely, the expansion of the predictor domain to include noncognitive predictors of…

The Texas Projection Measure (TPM) has grown out of the state's need to meet the requirements of No Child Left Behind (NCLB). An examination of the state's method of predicting 8th grade mathematics scores reveals that several factors have been ignored in the process of developing the model, including assumptions in its underlying statistical…

The formula is simple: Highly effective teachers equal student academic success. Yet, the physics of American education is anything but. Thus, the question facing education reformers is how can teacher effectiveness be accurately measured in order to improve the teacher workforce? Given the demand for objective, quantitative measures of teacher…

The utility of value-added estimates of teachers' effects on student test scores depends on whether they can distinguish between high- and low-productivity teachers and predict future teacher performance. This article studies the year-to-year variability in value-added measures for elementary and middle school mathematics teachers from five large…

In fall 1993, Golden West College (GWC), in California, participated in a large-scale study coordinated by Computerized Assessment and Placement Programs (CAPP) to gather evidence supportive of the College Board Assessment and Placement Services (APS) tests. The study focused on gathering instructor ratings of student preparedness levels in a…

This descriptive research study examined the validity of an adaptation of the Learning and Study Strategies Inventory (LASSI) that uses a videotape with questions in American Sign Language with a special group of hearing-impaired college students, assuming that LASSI is still reliable for this group. The study was limited to prelingually deaf…

Admissions committees and researchers around the globe have used diligence and imagination to develop and implement various screening measures with the ultimate goal of predicting future clinical and professional performance. What works for predicting future job performance in the human resources world and in most of the academic world may not,…

The current study examines the views of experts in the science of mental abilities about the primacy and uniqueness of "g" and the social implications of ability testing, and compares their responses to the views of a group of non-expert psychologists. Results indicate expert consensus that "g" is an important, non-trivial determinant (or at least…

Teacher preparation programs have continued to see the ever-increasing control of teacher candidates by policymakers. To control means to regulate. The problem, according to these authors, is that there are currently at least three regulating measurement and assessment obstacles faced by teacher candidates in teacher preparation programs. The…