The study reported on here contributes to the growing body of knowledge on the use of standard setting methods for improving the reporting and utility value of assessment results in South Africa as well as for addressing the conceptual shortcomings of the Curriculum and Assessment Policy Statement (CAPS) reporting framework. Using data from the…

This paper introduces an approach that uses latent class analysis to identify cut scores (LCA-CS) and categorize respondents based on context scales derived from largescale assessments like PIRLS, TIMSS, and NAEP. Context scales use Likert scale items to measure latent constructs of interest and classify respondents into meaningful ordered…

Curriculum-based measurements (CBM) are used in schools to screen students for academic difficulties. Oral reading fluency curriculum-based measures (CBM-R) are the most popular, yet several studies have identified predictive bias in CBM-Rs in relation to key variables (e.g., race, sex). Despite a massive increase in the use of these measures as…

This brief report presents an analog test of the relative classification validity of three cutoff values (CVs; 16, 18, and 20) derived from responses to the self-report version of the Strengths and Difficulties Questionnaire: Total Difficulties Scale. Results from Bayesian t-tests, using several school-specific subjective well-being indicators as…

Approximately, 283 sixth-grade students completed four randomly generated Math Curriculum-Based Measures (M-CBMs) from interventioncentral.org twice during a fall semester. These M-CBMs measured foundational skills in addition, subtraction, multiplication, and division. We found that using mean fluency or accuracy scores from four M-CBMs produced…

Background/Context: Regression discontinuity (RD) designs are used for policy and program evaluation where subjects' eligibility into a program or policy is determined by whether an assignment variable (i.e., running variable) exceeds a pre-defined cutoff. Under a standard RD design with a continuous assignment variable, the average treatment…

This article proposes the use of a standards-based approach to reporting results from large-scale assessment surveys in South Africa. The use of this approach is intended to address the key shortcomings observed in the current reporting framework prescribed in the national curriculum documents. Using the Angoff method and data from the Annual…

This article describes a novel variation of the Body of Work method that uses construct maps to overcome problems of transparency, rater inconsistency, and scores gaps commonly occurring with the Body of Work method. The Body of Work method with construct maps was implemented to set cut-scores for two separate K-12 assessment programs in a large…

We use a regression-discontinuity design to study the effects of double blocking sixth-grade students in reading and mathematics on their achievement across three years of middle school. To identify the effect of the intervention, we use sharp cutoffs in the test scores used to assign students to double blocking. We find large, positive, and…

When New York state released the first results of the exams under the Common Core State Standards, many wrongly believed that the results showed dramatic declines in student achievement. A closer look at the results showed that student achievement may have increased. Another lesson from the exams is that states need to closely coordinate new data…

On August 7th, 2013, the New York State Education Commissioner, John King, announced the initial results of the state's new assessment, which was designed to measure college and career readiness relative to the Common Core Learning Standards. Commissioner King noted that the proficiency rates on these assessments were significantly lower than…

The purpose of this study is to utilize Score Equity Assessment (SEA) to examine measurement comparability and equity in reported scores on a statewide fifth-grade science assessment with respect to groups of students defined by disability status, English Language Learner status and use of test accommodations. Benefits of SEA include a focus on…

Northwest Evaluation Association™ (NWEA™) is committed to providing partners with useful tools to help make inferences from the Measures of Academic Progress® (MAP®) interim assessment scores. One important tool is the concordance table between MAP and state summative assessments. Concordance tables have been used for decades to relate scores on…

Northwest Evaluation Association™ (NWEA™) is committed to providing partners with useful tools to help make inferences from the Measures of Academic Progress® (MAP®) interim assessment scores. One important tool is the concordance table between MAP and state summative assessments. Concordance tables have been used for decades to relate scores on…

Northwest Evaluation Association™ (NWEA™) is committed to providing partners with useful tools to help make inferences from the Measures of Academic Progress® (MAP®) interim assessment scores. Recently, NWEA completed a concordance study to connect the scales of the Virginia Standards of Learning (SOL) reading and math tests with those of the MAP…