The robustness of qualitative comparative analysis (QCA) results features high on the agenda of methodologists and practitioners. This article aims at advancing this debate on several fronts. First, in line with the extant literature, we take a comprehensive view on robustness arguing that decisions on calibration, consistency, and frequency…

Big international assessment organisations like Cambridge Assessment have long held considerable amounts of data. When text is produced digitally, we can do more with it. Surprisingly to many, there have been examples of automatic scoring of extended writing for around 20 years, though what works well in one context may not be applicable in all…

Accrediting agencies for English language programs, such as the Commission on English Language Program Accreditation (CEA), require a plan in writing for monitoring and reviewing assessment practices. Nonetheless, web-search queries such as "assessing assessment," "how to assess assessment," "assessing assessment…

In March 2020, the National Center for Special Education Research (NCSER) virtually convened a group of experts to discuss gaps in research on eighth grade mathematics for students with disabilities (SWD) that could be addressed with the NAEP process data and data science techniques for this research. Invited experts also provided recommendations…

This chapter identifies some of the challenges surrounding data collection and analysis regarding development students, including testing and identifying academic needs, placement determination, and measuring student outcomes.

A primary goal of assessment is to deliver truthful and clear information that can be used to inform and improve outcomes. Although there are multiple ways to achieve this goal, common approaches can be broken down into two major categories: (1) direct assessment; and (2) indirect assessment. Indirect assessment typically relies on general…

The purpose of this report is to describe the technical qualities of the 2018-2019 operational administration of the English language arts/literacy (ELA/L) and mathematics summative assessments in grades 3 through 8 and high school. The ELA/L assessments focus on reading and comprehending a range of sufficiently complex texts independently and…

The purpose of this report is to describe the technical qualities of the 2018-2019 operational administration of the English language arts/literacy (ELA/L) and mathematics assessments in grades 3 through 8 and high school. New Meridian, in coordination with multiple states and vendors, developed an alternate form of the summative assessment to…

The purpose of this article is to introduce a 12-step approach for an abbreviated research project to promote research writing in an undergraduate measurement course. This 12-step approach assumes a 14-week semester schedule that is common among many colleges and universities. The steps for the proposed research project include selecting a topic,…

Developments in school education in Australia over the past decade have witnessed the rise of national efforts to reform curriculum, assessment and reporting. Constitutionally the power to decide on curriculum matters still resides with the States. Higher stakes in assessment, brought about by national testing and international comparative…

This article discusses issues associated with statistical testing conducted with data from clustered school samples. Empirical researchers often conduct tests of statistical inference on sample data to ascertain the extent to which differences exist within groups in the population. Typically, much school-related data are collected from students.…

In this classic introduction to educational and psychological measurement, Thorndike and Thorndike-Christ provide all of the pertinent information future professionals need to know in order to develop the skills to use test information wisely. Incorporating standard measurement concepts as they apply to both educational and psychological…

The purpose of this article is to describe and demonstrate a three-step process of using differential distractor functioning (DDF) in a post hoc analysis to understand sources of differential item functioning (DIF) in multiple-choice testing. The process is demonstrated on two multiple-choice tests that used complex alternatives (e.g., "No…

Presented herein is a statement of George A. Scott, Director Education, Workforce, and Income Security. The author discusses the extent to which the Department of Education's policies and procedures for monitoring eligibility requirements for federal aid at proprietary schools protect students and the investment of Title IV funds. This testimony…

This article examines data from nine statewide administrations of the Idaho Comprehensive Literacy Assessment (ICLA) over three-years. The ICLA measures pre-service teachers' knowledge of research-based content and pedagogy related to reading instruction and assessment. The purpose of this article was first to examine pre-service candidates'…