This three-paper dissertation systematically investigates the methodology issues related to using observational systems to observe, analyze, and interpret teachers' reformed teaching practices within the K-12 classroom context. Each paper contributes a distinct perspective to evaluate instructional practices accurately, consistently, and…

Deep science understanding is reflected in students' ability to use content and skills when making sense of the world. Assessing deep understanding requires measuring complex constructs that combine elements of content and skills. To develop valid measures of complex constructs, we need to understand how their theoretical dimensionality, reflected…

School-wide positive behavior interventions and supports (SWPBIS) relies on the implementation efforts of frontline service providers such as teachers, administrators, and staff. The full version of the positive behavior interventions and supports--action and commitment tool (PBIS-ACT Full) measures the individual implementer variable of…

Designing and validating a college readiness test addresses the absence of standardized Philippine-based College Readiness Test (CRT) congruent with the College Readiness Standards (CRS) set by the Philippine Commission on Higher Education (CHED). It also resolves the varied and arbitrary indices used by Higher Education Institutions (HEIs) to…

International large-scale assessments (ILSAs) have become an important part of the Swedish evaluation system. It is therefore of crucial importance to validate national measures of Swedish students' achievement with their ILSA test scores. Here, we offer results from such a validation study based on Swedish students' test scores in IEA's Trends in…

The District of Columbia Public Schools (DCPS) has prioritized efforts to support students' social and emotional learning (SEL) competencies, such as perseverance and social awareness. To measure students' SEL competencies and the school experiences that promote SEL competencies (school climate), DCPS began administering annual surveys to…

In 2018, 26 states administered a college admissions test to all public school juniors. Nearly half of those states proposed to use those scores as their academic achievement indicators for federal accountability under the Every Student Succeeds Act (ESSA); many others are planning to use those scores for other accountability purposes.…

There is growing interest in improving and assessing teachers' use of culturally responsive practices (CRP) in the classroom, yet relatively few research-based approaches exist to address these measurement gaps. This article presents findings on the psychometric properties of a newly developed classroom observation measure of CRP, called the CARES…

The number of students in the United States choosing science, technology, engineering or mathematics careers is declining at a time when demand for these occupations is rapidly increasing. Numerous efforts have been undertaken to reverse this trend, yet results are uncertain. One's attitude is key to many choices one makes, and this includes, for…

This article exemplifies how assessment design might be grounded in theory, thereby helping to strengthen validity claims. Spanning work across multiple related projects, the article first briefly summarizes an assessment system model for the elementary and secondary levels. Next the article describes how cognitive-domain theory and principles are…

This study examines the accuracy of performance ratings from the Framework for Leadership (FFL), Pennsylvania's tool for evaluating the leadership practices of principals and assistant principals. The study analyzed four key properties of the FFL: score variation, internal consistency, year-to-year stability, and concurrent validity. Score…

This "Stated Briefly" report is a companion piece that summarizes the results of another report of the same name. This study examines the accuracy of performance ratings from the Framework for Leadership (FFL), Pennsylvania's tool for evaluating the leadership practices of principals and assistant principals. The study analyzed four key…

States are establishing high stakes assessments to serve as measurement tools of students' academic abilities. This study essentially compares Maryland's and Florida's mathematics and science assessments for similarities and differences. Building from 5-10 years of student level quantitative data (secondary data) and critical analyses of the…

The purpose of this study was to develop a valid and reliable scale for preferences of teachers in regard of their curriculum design orientations. Because there was no scale development study similar to this one in Turkey, it was considered as an urgent need to develop such a scale in the study. The sample of the research consisted of 300…

The Jackson Career Explorer (JCE) is a short form and continuous version of the Jackson Vocational Interest Survey (JVIS). The 34 scales of the JCE were investigated in relation to the Career Directions Inventory (CDI). Participants (N = 282) aged 14-57 years were volunteers from local high schools and colleges and completed both measures. The…