Regression discontinuity (RD) designs are commonly used for program evaluation with continuous treatment assignment variables. But in practice, treatment assignment is frequently based on ordinal variables. In this study, we propose an RD design with an ordinal running variable to assess the effects of extended time accommodations (ETA) for…

This paper introduces an approach that uses latent class analysis to identify cut scores (LCA-CS) and categorize respondents based on context scales derived from largescale assessments like PIRLS, TIMSS, and NAEP. Context scales use Likert scale items to measure latent constructs of interest and classify respondents into meaningful ordered…

In this paper we describe content focused, practical procedures to establish benchmarked performance standards for educational and other tests. To implement our procedures, we identify one or more external benchmark (e.g., NAEP or PISA performance levels, college and career readiness benchmarks); link to the external benchmarks to locate those…

Background/Context: Regression discontinuity (RD) designs are used for policy and program evaluation where subjects' eligibility into a program or policy is determined by whether an assignment variable (i.e., running variable) exceeds a pre-defined cutoff. Under a standard RD design with a continuous assignment variable, the average treatment…

In this essay, we describe the construction and use of the Cut-Score Operating Function in aiding standard setting decisions. The Cut-Score Operating Function shows the relation between the cut-score chosen and the consequent error rate. It allows error rates to be defined by multiple loss functions and will show the behavior of each loss…

This study investigates how different rounding rules and ways of providing Angoff standard-setting judgments affect cut-scores. A simulation design based on data from the National Assessment of Education Progress was used to investigate how rounding judgments to the nearest whole number (e.g., 0, 1, 2, etc.), nearest 0.05, or nearest two decimal…

This study discusses and presents an example of a use of spline functions to establish and report test scores using a moderated system of any number of cut scores. Our main goals include studying the need for and establishing moderated standards and creating a reporting scale that is referenced to all the standards. Our secondary goals are to make…

In this work, we explored the relationship of the Common Core State Standards in Mathematics (CCSSM) to student achievement. Building on techniques developed for the Third International Mathematics and Science Study (TIMSS), we found a very high degree of similarity between CCSSM and the standards of the highest-achieving nations on the 1995…

This project compared annual mandated assessment results for an urban charter school, two comparable urban schools and the encompassing urban district. Scores in grades three through eight in the target school were analyzed to determine the percentage of students scoring at proficiency levels three and four (scores of one and two are considered…

Assessments matter in education. Testing is nothing new; tests have been around as long as school itself. However, over the last 15 years, state assessments have grown to be an increasingly central, and often controversial, part of schooling. As states raise their standards, it is more important than ever to ask: What is a high-quality assessment?…

This monograph has grown out of a series of discussions and a six-month period of reading and reflecting on the literature which were initiated by Fritz Mosher's suggestions to the National Assessment of Educational Progress (NAEP) to examine the "standards" question. Conversations with Mosher himself and the staff of NAEP have been most…

The National Assessment Governing Board (NAGB) oversees and sets policy for the National Assessment of Educational Progress (NAEP). Since 1969, NAEP has provided information to the public on the achievement of the nation's elementary and secondary students at grades 4, 8, and 12. As the only continuing measure of student achievement at grade 12,…

The Common Core State Standards (CCSS) were created in response to the shortcomings of No Child Left Behind era standards and assessments. Among those failings were the poor quality of content standards and assessments and the variability in content expectations and proficiency targets across states, as well as concerns related to the economic…

An honest look at public education in Michigan reveals both hopeful and dismal news. While their state has taken a few bold steps in the past year to improve their education system, their students still lag far behind their peers nationally, and the performance gaps between them -- across income level and race -- are both alarming and persistent.…

The Arizona English Language Learners Assessment (AZELLA) is used by the Arizona Department of Education to determine which children should receive English support services. AZELLA results are used to determine if children are either proficient in English or have English language skills in one of four pre-proficient categories (pre-emergent,…