ERIC Number: ED667615
Record Type: Non-Journal
Publication Date: 2021
Pages: 139
Abstractor: As Provided
ISBN: 979-8-5346-6934-3
ISSN: N/A
EISSN: N/A
Available Date: 0000-00-00
Validating and Refining a Locally Developed Universal Screening System in High School Mathematics
Sarah Stevens
ProQuest LLC, Ed.D. Dissertation, University of Kansas
Early identification of at-risk students is a critical element of Response to Intervention (RTI) but there are few validated universal screeners for high school mathematics. This study evaluated the effectiveness of the screening system currently in use at one urban Texas public high school and compared its effectiveness to alternate screening systems that used the same resources but with different cut scores. The goal for the screener was to accurately identify students who would Meet grade level proficiency on the state of Texas' Algebra 1 End of Course exam. The current screening system used a multi-gating procedure that included the performance levels on the past state achievement test and on a beginning of year computer adaptive screening exam. Alternate systems were investigated using the assessments individually by exploring three different cut scores to determine if any were more effective. The study used the publisher's cut score, the optimal cut score, and the cut score with a sensitivity of 0.94 (the same as the current system). The evaluation compared the overall accuracy, sensitivity, specificity, positive post-test probabilities, and negative post-test probabilities. No alternate system improved the effectiveness of the current system; however, none of the evaluated screening systems were able to adequately distinguish between at-risk and non-at-risk students. The threshold model is an identification model that excludes students with a low probability of failure from intervention, includes students with a high probability of failure in intervention, and requires additional information for those with no clear risk category. The use of a threshold model might result in a large number of unclassified students but could help identify those with the highest and lowest risk of failure. This study determined that a threshold model might support the development of a screening system in a school using an assessment with poor classification ability. [The dissertation citations contained here are published with the permission of ProQuest LLC. Further reproduction is prohibited without permission. Copies of dissertations may be obtained by Telephone (800) 1-800-521-0600. Web page: http://www.proquest.com/en-US/products/dissertations/individuals.shtml.]
Descriptors: Urban Schools, Public Schools, High School Students, At Risk Students, Mathematics Education, Screening Tests, Ability Identification, Response to Intervention, Test Validity, Test Construction, Cutting Scores, Comparative Testing, Evaluation Criteria
ProQuest LLC. 789 East Eisenhower Parkway, P.O. Box 1346, Ann Arbor, MI 48106. Tel: 800-521-0600; Web site: http://www.proquest.com/en-US/products/dissertations/individuals.shtml
Publication Type: Dissertations/Theses - Doctoral Dissertations
Education Level: High Schools; Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Texas
Grant or Contract Numbers: N/A
Author Affiliations: N/A