This dissertation aims to bridge the gap between validity theory and the practice of validation. The dissertation employs a three-article approach. Following the introduction in Chapter I, three independent manuscripts representing three empirical studies are presented (i.e., Chapters II - IV). Each chapter is a stand-alone publishable manuscript,…

This report contains the proceedings of a forum held on June 28, 2023 in New Orleans, Louisiana, to discuss issues surrounding meaningful accessibility of assessments. The forum was a post-session to the Council of Chief State School Officers (CCSSO) National Conference on Student Assessment (NCSA) and was a collaboration of the "Assessment,…

Testing programs are often classified as high or low stakes to indicate how stringently they need to be evaluated. However, in practice, this classification falls short. A high-stakes label is taken to imply that all indicators of measurement quality must meet high standards; whereas a low-stakes label is taken to imply the opposite. This approach…

This three-paper dissertation explores item cluster-based assessments, first in general as it relates to modeling, and then, specific issues surrounding a particular item cluster-based assessment designed. There should be a reasonable analogy between the structure of a psychometric model and the cognitive theory that the assessment is based upon.…

This hearing of the Committee on Health, Education, Labor, and Pensions examines No Child Left Behind, focusing on testing and accountability. At the center of the debate about how to fix No Child Left Behind is what to do about the Federal requirement that states, each year, administer 17 standardized tests with high stakes consequences.…

In 2018, 26 states administered a college admissions test to all public school juniors. Nearly half of those states proposed to use those scores as their academic achievement indicators for federal accountability under the Every Student Succeeds Act (ESSA); many others are planning to use those scores for other accountability purposes.…

With new state assessments kicking into full swing across the country, schools are seeing more and more parents wanting to opt out their children. Determining whether states allow assessment opt-outs can be complex and is constantly evolving. In some states the answer is clear: State policies either allow or prohibit state assessment opt-outs, or…

Historically, school leaders have occupied a somewhat ambiguous position within networks of power. On the one hand, they appear to be celebrated as what Ball (2003) has termed the "new hero of educational reform"; on the other, they are often "held to account" through those same performative processes and technologies. These…

In Shepard's (1997) discussion on the importance of test use and consequences in a validity argument for educational assessments, she reflected on Cronbach and Meehl's (1955) perspective on the role of test developers in providing consequential evidence. In the following year, a special issue in "Educational Measurement: Issues and Practice"…

Haertel's argument is that one must "expand the scope of test validation to include indirect testing effects" because these effects are often the "rationale for the entire testing program." The author strongly agrees that this is essential. However, he maintains that Haertel's argument does not go far enough and that there are two additional…

In the context of using tests for educational improvement, Haertel's article--"How Is Testing Supposed to Improve Schooling?"--highlights how the measurement field falls short on validation efforts and demonstrates how by posing the question of how testing is supposed to improve schooling one may start testing different hypotheses about the…

History, when taught properly, and by instructors who are well grounded in the subject matter, is engaging and enlightening. Presently, through insipid curriculum and lack of class time, generations of students are being deprived of a grasp of American history that gives meaning and depth to the concept of citizenship. This article discusses the…

The PPIC Statewide Survey delivers nonpartisan, objective, advocacy-free information on the perceptions, opinions, and public policy preferences of California residents. PPIC invites input, comments, and suggestions from policy and public opinion experts and from its own advisory committee, but survey methods, questions, and content are determined…

At the outset of his thoughtful and thought-provoking article, Haertel (this issue) clearly identifies the issue with which he will be dealing: The disjunct, or gap, in current approaches to evaluating the merits of a given test, between the intended uses of that test and the validity of its score-based interpretations. The author thinks that…

Emerging technology and research on learning have the potential to dramatically improve assessments, if educators and policymakers take a more balanced approach to using them. That's the conclusion of two years of analysis by the Gordon Commission on the Future of Assessment in Education, a panel of top education research and policy experts that…