This paper reports an investigation into the psychometric properties of the COR-Advantage1.5 (COR-Adv1.5) assessment tool, a criterion-referenced observation-based instrument designed to assess the developmental abilities of children from birth through kindergarten. Using data from 8534 children participating in a state-funded preschool program…

The primary goal of this dissertation is to develop and provide preliminary validation for a new measure of culturally responsive practice. This instrument, which is called the Culturally Responsive Practice Scale (CRPS), includes items that reflect ways that teachers teach multicultural students in their classrooms. To accomplish the goal, three…

We used meta-analysis to examine the criterion validity of four scoring procedures used in curriculum-based measurement of written language. A total of 22 articles representing 21 studies (N = 21) met the inclusion criteria. Results indicated that two scoring procedures, correct word sequences and correct minus incorrect sequences, have acceptable…

We examined the criterion validity and diagnostic efficiency of oral reading fluency (ORF), word reading accuracy, and reading comprehension (RC) for students in Grades 7 and 8 taking into account form effects of ORF, time of assessment, and individual differences, including student designations of limited English proficiency and special education…

Curriculum-based measures (CBMs) are necessary for educators to quickly assess student skill levels and monitor progress. This study examined the use of the alphabet writing fluency task, a CBM of writing, to assess handwriting fluency--that is, how well children access, retrieve, and write letter forms automatically. In the current study, the…

Curriculum-based measures (CBMs) are necessary for educators to quickly assess student skill levels and monitor progress. This study examined the use of the alphabet writing fluency task, a CBM of writing, to assess handwriting fluency--that is, how well children access, retrieve, and write letter forms automatically. In the current study, the…

Criterion-referenced measures, such as those used in the assessment of crime and violence, prioritize predictive accuracy (discrimination) at the expense of construct validity. In this article, we compared the discrimination and incremental validity of three commonly used criterion-referenced measures for sex offenders (Rapid Risk Assessment for…

Two studies using similar methods in two states investigated the long-term predictive utility of two single-skill early numeracy Curriculum Based Measures (CBMs) and the degree to which they can adequately predict high-stakes test scores. Data were drawn from kindergarten and first-grade students. State standardized assessment data from the…

Reading comprehension is a critical aspect of the reading process. Children who experience significant problems in reading comprehension are at risk for long-term academic and social problems. High-quality measures are needed for early, efficient, and effective identification of children in need of remediation in reading comprehension. Substantial…

Universal screening measures are an integral component of any tiered system of instructional delivery. Recent studies of screening measures have often excluded examinations of bias in predictive validity. The present study examined a common screening instrument for evidence of bias in predictive validity across the four disaggregation categories…

Formative assessment measures are commonly used in schools to assess reading and to design instruction accordingly. The purpose of this research was to investigate the incremental and concurrent validity of formative assessment measures of reading comprehension. It was hypothesized that formative measures of reading comprehension would contribute…

This study addresses the predictive validity of results from a screening system of academic enablers, with a sample of Australian elementary school students, when the criterion variable is end-of-year achievement. The investigation included (a) comparing the predictive validity of a brief criterion-referenced nomination system with more…

We are pleased that our article prompted this series of four commentaries and that we have this opportunity to respond. We address each in turn. Duckworth and Kaufman and Agars discussed, respectively, two broad issues concerning the validity of selection systems, namely, the expansion of the predictor domain to include noncognitive predictors of…

Virtually all states require teachers to undergo licensure testing before participation in the public school labor market. This article analyzes the information these tests provide about teacher effectiveness. The authors find that licensure tests have different predicative validity for student achievement by teacher race. They also find that…

Current empirical evidence indicates poor learning trajectories for students with early literacy skill deficits. As such, reliable and valid detection of at-risk students through regular screening and progress monitoring is imperative. This study investigated the predictive validity of scores on the Dynamic Indicators of Basic Early Literacy…