The purpose of this study was to establish construct validity of a college and career readiness measure using a sample of youth with (n = 356) and without (n = 1,599) disabilities from five high schools across three U.S. states. We established content validity through expert item review, structural validity through initial field-testing, and…

Research Findings: This study provides psychometric validation of the Classroom Engagement Scale (CES), a 14-item, teacher-report, formative assessment of behavioral engagement. It is currently used for all kindergarten children in a large, urban school district where it is embedded in the report card. Multi-level factor analysis revealed two…

The Pennsylvania Department of Education's (PDE's) Office for Safe Schools partnered with REL Mid-Atlantic to conduct a study using data from PDE's school climate survey. This survey, which is available on a voluntary basis to any school in the state, provides a way to track school climate and identify schools that need additional support to…

These are the appendixes for the full report, "Changes in School Climate during COVID-19 in a Sample of Pennsylvania Schools." The REL study analyzed changes in scores from a pre-pandemic year (2018/19) to the 2020/21 and 2021/22 school years, both of which were affected by COVID-19 and related policy changes. These technical appendixes…

States and districts need ways of measuring principal performance that correctly identify effective principals. Unfortunately, existing research offers little guidance to policymakers on which types of performance measures provide valid information about principals' contributions to student achievement. States have therefore had to develop…

The Student Experience in the Research University is an online survey instrument that serves to assess institutional functions of research universities in the U.S. and understand students' behaviour, satisfaction, and achievement. The present study explored measurement models describing two primary domains (i.e., Academic Engagement and…

This study examines the accuracy of performance ratings from the Framework for Leadership (FFL), Pennsylvania's tool for evaluating the leadership practices of principals and assistant principals. The study analyzed four key properties of the FFL: score variation, internal consistency, year-to-year stability, and concurrent validity. Score…

This "Stated Briefly" report is a companion piece that summarizes the results of another report of the same name. This study examines the accuracy of performance ratings from the Framework for Leadership (FFL), Pennsylvania's tool for evaluating the leadership practices of principals and assistant principals. The study analyzed four key…

This study examines the accuracy of performance ratings from the Framework for Leadership (FFL), Pennsylvania's tool for evaluating the leadership practices of principals and assistant principals. The study analyzed three key properties of the FFL: internal consistency, score variation, and concurrent validity. To measure the internal consistency…

A new study analyzed data from the 2012/13 pilot of the Framework for Leadership (FFL), Pennsylvania's tool for evaluating the leadership practices of principals and assistant principals. Based on the FFL scores of 336 principals and 69 assistant principals evaluated by their supervisors in the 2012/13 school year, this interim report found that…

We have conducted an investigation into how well students in introductory science classes (both physics and chemistry) are able to predict which questions they will or will not be able to answer correctly on an upcoming assessment. An examination of the data at the level of students' overall scores reveals results consistent with the…

This study provides initial evidence supporting intended score interpretations for the purpose of assessing opportunity to learn (OTL) via an online teacher log. MyiLOGS yields 5 scores related to instructional time, content, and quality. Based on data from 46 middle school classes, the evidence indicated that (a) MyiLOGS has high usability, (b)…

In this article, we explain how overly prescriptive, rigid state statutory and regulatory policy frameworks regarding teacher evaluation, tenure and employment decisions outstrip the statistical reliability and validity of proposed measures of teaching effectiveness. We begin with a discussion of the emergence of highly prescriptive state…

In recent years, the construct of character has received substantial attention among developmental scientists, but no consensus exists about the content and structure of character, especially among children and early adolescents. In a study of positive development among racially diverse Cub Scouts in the greater Philadelphia area, we assessed the…

Motivated by the multiple-measures clause of recent federal policy regarding student eligibility for alternate assessments based on modified academic achievement standards (AA-MASs), this study examined how scores or combinations of scores from a diverse set of assessments predicted students' end-of-year proficiency status on statewide achievement…