Even when raters demonstrate agreement in the use of a measure, limited score variability or violation of often-ignored statistical assumptions can result in lower reliability estimates than intuitively expected. This article uses data drawn from two randomized controlled trials of schema therapy and cognitive behavioral therapy for the treatment…

This study explores the direction and magnitude of racial disparities on three advanced placement (AP) computer science (CS) exams, namely AP CS Principles, AP CS A, and AP CS AB, based on the test scores of more than one million students who have taken AP CS exams between 1997 and 2020. Using Mann-Kendall test and Sen's slope procedures we found…

Fuzzy sets have experienced multiple expansions since their conception to enhance their capacity to convey complex information. Intuitionistic fuzzy sets, image fuzzy sets, q-rung orthopair fuzzy sets, and neutrosophic sets are a few of these extensions. Researchers and academics have acquired a lot of information about their theories and methods…

This report is part of a series that aims to provide a definitive account of the best available evidence on how the COVID-19 pandemic has affected America's students. The series is part of a broader effort, the Evidence Project, which brings together researchers and policymakers to advance solutions-oriented analysis of the K-12 response to the…

Measurement invariance is crucial for making valid comparisons across different groups (Kline, 2016; Vandenberg, 2002). To address the challenges associated with invariance testing such as large sample size requirements, the complexity of the model, etc., applied researchers have incorporated parcels. Parcels have been shown to alleviate skewness,…

Diploma and degree completion have become the fundamental standard for judging the performance of secondary and postsecondary educational institutions. Increasingly, leaders of education and workforce policy and programs assume that these measures of attainment effectively serve as indicators of adequate levels of essential literacy and numeracy…

With more than 3 million participants per year, the Advanced Placement (AP) program is one of the most popular programs in the United States for exposing high-achieving high school students to advanced academic content. Sponsored by the College Board, the AP program provides a framework in which high school teachers can teach introductory…

Survival analysis is an advanced statistical method to investigate the occurrence and the timing of an important event such as school access, dropout, and graduation in a longitudinal framework. The aim of our study is to provide practical guidelines for empirical researchers in choosing an appropriate survival analysis model. For this goal, this…

Launched in 2012, The Big Lift is a collective impact initiative extending from preschool to third grade that aims to boost children's reading proficiency in San Mateo County, California, through four different types of activities, called "pillars": (1) High-Quality Preschool, (2) Summer Learning, (3) School Attendance, and (4) Family…

Black girls represent a unique subpopulation of science learners. Black girls are unique because they consistently outperform Black boys in science. Despite this trend, Black girls often face dual marginalization in STEM classrooms and professions. Racial and gender marginalization can inhibit the success of Black girls in science if researchers,…

In this article, we consolidate and present in one place what is known about quality indicators for setting standards so that stakeholders may be able to recognize the signs of standard-setting quality. We use the context of setting standards to associate English language test scores with language proficiency descriptions such as those presented…

This book is relevant for language testers, listening researchers, and oral proficiency teachers, in that it explores four broad themes related to the assessment of L2 listening ability: the use of authentic, real-world spoken texts; the effects of different speech varieties of listening inputs; the use of audio-visual texts; and assessing…

Districts now have access to a wealth of new information that can help target students with appropriate supports and bring focus and coherence to college readiness efforts. However, the abundance of data has brought its own challenges. Schools and school systems are often overwhelmed with the amount of data available. The capacity of districts to…

Background: Youth programs often rely on self-reported data without clear evidence as to the accuracy of these reports. Although the validity of self-reporting has been confirmed among some high school and college age students, one area that is absent from extant literature is a serious investigation among younger children. Moreover, there is…

This guide offers educators, program managers, administrators, and researchers a resource for building capacity for monitoring program outcomes. It provides concise definitions of program monitoring components and a framework for assessing program progress. Examples demonstrate the relationships among program components: outcomes, indicators,…