The Comprehensive Test of Phonological Processing, 2nd Edition (CTOPP-2; Wagner et al., 2013) is commonly used in k-12 public schools to assess basic cognitive processing skills foundational for reading achievement. Psychometric support for its use with dual language learners (DLLs), a group representing over 10% of the school-aged population in…

This study assesses the reliability of two observation rubrics, one in math and the other in science, and documents how the rubric data were used to inform a teacher education program. Classroom observations are typically considered essential for assessing teaching practice, yet many popular observation frameworks, while comprehensive in aim, do…

Research Findings: Public policy has increasingly focused on expansion of preschool access for underserved students and systematic evaluation of preschool quality and students' readiness for school. However, such evaluation is limited by a lack of thoroughly validated assessments for use with preschool populations. The present study examined the…

Developing indicators that reflect important aspects of school and classroom environments has become central in a nationwide effort to develop comprehensive programs that measure teacher quality and effectiveness. Formulating teacher evaluation policy necessitates accurate and reliable methods for measuring these environmental variables. This…

As educational practitioners and policymakers expand the range of student outcomes they assess, student perception surveys--particularly those targeting social-emotional learning--have grown in popularity. Despite excitement around the potential for measuring a wider array of important student outcomes, concerns about the validity of the…

Measures of school-level growth in student outcomes are common tools used to assess the impacts of schools. The vast majority of these measures are based on standardized tests, even though emerging evidence demonstrates the importance of social-emotional skills (SEL). This paper uses the first large-scale panel surveys of students on SEL to…

Measuring school and classroom environments has become central in a nation-wide effort to develop comprehensive programs that measure teacher quality and teacher effectiveness. Formulating successful programs necessitates accurate and reliable methods for measuring these environmental variables. This paper uses a generalizability theory framework…

Research has shown that many educators do not understand the terminology or displays used in test score reports and that measurement error is a particularly challenging concept. We investigated graphical and verbal methods of representing measurement error associated with individual student scores. We created four alternative score reports, each…

Many classroom climate studies suffer from 2 critical problems: They (a) treat climate as a student-level (L1) variable in single-level analyses instead of a classroom-level (L2) construct in multilevel analyses; and (b) rely on manifest-variable models rather than on latent-variable models that control measurement error at L1 and L2, and sampling…

The researchers examined how speech-language pathologists (SLPs) in a small northern California school district assessed Spanish speaking English learning (EL) Latino children suspected of language impairments. Specifically we sought to (1) determine whether SLPs adhered to federal, state, and professional guidelines during initial assessments and…

There is extensive research on the benefits of making data-informed decisions to improve learning, but these benefits rely on the data being effectively interpreted. Despite educators' above-average intellect and education levels, there is evidence many educators routinely misinterpret student data. Data analysis problems persist even at districts…

The purpose of this study was to examine the validity of the Smarthealth watch (Salutron, Inc., Fremont, California, USA), a heart rate monitor that includes a wristwatch without an accompanying chest strap. Twenty-five individuals participated in 3-min periods of standing, 2.0 mph walking, 3.5 mph walking, 4.5 mph jogging, and 6.0 mph running.…

After decades of disinterest, evaluation of the performance of elementary and secondary teachers in the United States has become an important educational policy issue. As U.S. states and districts have tried to upgrade their evaluation processes, one of the models that has been increasingly used is the Framework for Teaching. This paper summarizes…

This study uses Monte Carlo simulations to demonstrate that regression-discontinuity designs arrive at biased estimates when attributes related to outcomes predict heaping in the running variable. After showing that our usual diagnostics are poorly suited to identifying this type of problem, we provide alternatives. We also demonstrate how the…

This report, which has been prepared by Abt Associates for the Institute of Education Sciences' National Center for Education Evaluation and Regional Assistance, takes an important first step in sorting out the implications of relying on state tests for general, student-level measures of reading and math achievement in evaluations of educational…