Purpose: The purpose of this research is to address the need for a robust system to accurately determine a cutoff score by using the Angoff method and leveraging the Rasch infit and outfit statistics of item response theory by detecting and removing misfitting items in a test. Design/methodology/approach: Researchers in educational evaluation…

The Autism Mental Status exam (AMSE) has demonstrated excellent sensitivity and specificity in Western high-risk population with suspected autism spectrum disorder (ASD). This study aimed to evaluate the psychometric properties of the AMSE in a sample of high-risk Chinese children, and to determine the optimal cutoff score of the Chinese version…

Universal screening to predict students' risk for reading problems is a foundational component of the Multi-Tiered Systems of Support framework and is required by law in many US states. School or district administrators are tasked with selecting screening assessments that are both technically adequate and feasible given the resources of their…

Universal screening to predict students' risk for reading problems is a foundational component of the Multi-Tiered Systems of Support framework and is required by law in many US states. School or district administrators are tasked with selecting screening assessments that are both technically adequate and feasible given the resources of their…

In 2006-2007, California revised its English language proficiency (ELP) assessment, the California English Language Development Test (CELDT), which resulted in more stringent criteria and higher cut scores for meeting proficiency. Using regression discontinuity designs and a difference-in-differences approach, this study examines the effects of…

Early identification of at-risk students is a critical element of Response to Intervention (RTI) but there are few validated universal screeners for high school mathematics. This study evaluated the effectiveness of the screening system currently in use at one urban Texas public high school and compared its effectiveness to alternate screening…

College and university admissions officers are the gatekeepers who decide which individuals may join the "country club" of higher education. As such, the decisions they make have a significant impact on the lives of individuals, especially those who are willing to travel across the globe and risk living in an unfamiliar country in order…

One common modification to the Angoff standard-setting method is to have panelists round their ratings to the nearest 0.05 or 0.10 instead of 0.01. Several reasons have been offered as to why it may make sense to have panelists round their ratings to the nearest 0.05 or 0.10. In this article, we examine one reason that has been suggested, which is…

The use of the Quality Rating and Improvement System (QRIS) to improve early childhood education program quality is based in part on assumptions that the quality of programs can be measured and that quality ratings are associated with meaningful differences in learning outcomes for children. This report reviews all of the state QRIS validation…

Background/Context: Regression discontinuity (RD) designs are used for policy and program evaluation where subjects' eligibility into a program or policy is determined by whether an assignment variable (i.e., running variable) exceeds a pre-defined cutoff. Under a standard RD design with a continuous assignment variable, the average treatment…

This article examines the validity of IQ-achievement discrepancy and low achievement as criteria for the identification of disabilities in Spanish-speaking English-language learners (ELs) and the factors that moderate the validity of these approaches as bases for identification. While there has been a long history of examining the validity of…

This article examines the validity of IQ-achievement discrepancy and low-achievement as criteria for the identification of disabilities in Spanish-speaking ELs and the factors that moderate the validity of these approaches as bases for identification. While there has been a long history of examining the validity of different approaches to…

Navigating academic demands in middle and high school may be particularly challenging for youth experiencing emotional and behavioral difficulties, and screening practices are a necessary first step in identifying youth in need of services. The goal of this study was to inform efficient universal screening practices in secondary schools by…

In the formation education that is carried out within the scope of undergraduate and non-thesis graduate programs within the same university, different criteria are used to evaluate students' success. In this study, classification accuracy of letter grades that are generated to evaluate students' success using relative and absolute criteria and…

This study examined optimal guidelines to assess treatment response and remission for anxiety in youth with autism spectrum disorders (ASD) using the Pediatric Anxiety Rating Scale (PARS). Data was collected for 108 children aged 7-16 years with comorbid anxiety and ASD before and after receiving cognitive behavior therapy. Optimal cut-offs on the…