Test development is a complicated process that demands examining various factors, one of them being writing items of varying difficulty. It is important to use items of a different range of difficulty to ensure that the test results accurately indicate the test-taker's abilities. Therefore, the factors affecting item difficulty should be defined,…

Prior work has documented a substantial penalty associated with taking the Partnership for Assessment of Readiness for College and Careers (PARCC) online relative to on paper (Backes & Cowan, 2019). However, this penalty does not necessarily make online tests less useful. For example, it could be the case that computer literacy skills are…

Admission criteria can be used to predict Saudi student performance in college, but significant differences across several studies exists. This study explores the predictive power of admission criteria for college assignment using King Saud bin Abdulaziz University for Health Sciences as a model. Scores from high school and standardized tests were…

This technical report is an addendum to a study we initially reported on in 2014 (Wray, Lai, Saez, Alonzo, & Tindal, 2014). In response to a request for additional analyses, in particular reporting confidence intervals around the results, we re-analyzed the data from the Wray et al study. This supplementary report presents the results of the…

The Scylla and Charybdis in this discussion of teacher evaluation are standardized achievement test data on the one hand, and classroom observational systems on the other. These are the two most common methods used to judge teachers' competency. Both have serious flaws: the former primarily with validity, the latter primarily with reliability. At…

The purpose of this quantitative correlational research was to investigate to what extent 2007 performance of third grade students who had been retained in 2006 for failing to attain proficiency on the Reading and Mathematics Florida Comprehensive Assessment Test (FCAT) predicted their performance in 2010 on the sixth grade Reading and Mathematics…

The amount of research evaluating the technical merits of general outcome measures of science and social studies achievement is growing. This study targeted criterion validity for critical content monitoring. Questions addressed the concurrent criterion validity of alternate presentation formats of critical content monitoring and the measure's…

This study examined the predictive validity and classification accuracy of two commonly used universal screening measures relative to a statewide achievement test. Results indicated that second-grade performance on oral reading fluency and the Measures of Academic Progress (MAP), together with special education status, explained 68% of the…

This study examined the predictive validity and classification accuracy of individual- and group-administered screening measures relative to student performance on a year-end state reading assessment in two states. A sample of 321 students was assessed in the areas of word-level and text fluency, as well as reading comprehension in the fall of…

This study examined the predictive validity and classification accuracy of individual and group-administered screening measures relative to student performance on a year-end state reading assessment in two states. A sample of 321 students were assessed in the areas of word-level and text fluency, as well as reading comprehension in the fall of…

Relational reasoning is the foundational cognitive ability to discern meaningful patterns within an informational stream, but its reliable and valid measurement remains problematic. In this investigation, the measurement of relational reasoning unfolded in three stages. Stage 1 entailed the establishment of a research-based conceptualization of…

A review of the literature pertaining to the effect and influence of commercially-prepared interim assessments in mathematics and language arts literacy reveals a lack of quantitative data to determine the value of these products for school reform. This study examined the ability of commercially-prepared interim pretest and posttest assessments in…

This study examined the predictive validity of curriculum-based measures in reading for Spanish-speaking English learners (ELs) at various levels of English proficiency. Third-grade Spanish-speaking EL students were screened during the fall using DIBELS Oral Reading Fluency (DORF) and Daze. Predictive validity was examined in relation to spring…

This paper investigates engagement (E), alignment (A), and rigor (R) as vital signs of high-quality teacher instruction as measured by the EAR Classroom Visit Protocol, designed by the Institute for Research and Reform in Education (IRRE). Findings indicated that both school leaders and outside raters could learn to score the protocol with…

With increased emphasis on accountability, the use of low-stakes test data to make high-stakes decisions about program effectiveness is on the rise. In order to make valid inferences about what students know and can do, it is crucial to understand the consequences of low and high stakes in testing contexts. As a result, with a sample comprised of…