Individual Placement and Support (IPS), an evidence-based supported employment model for working-age adults with serious mental illness, also serves transition age adults (TAY; ages 16-24). The IPS-Y is a new IPS fidelity scale tailored to this younger population. Although adopted worldwide, it lacks research on the psychometric properties of its…

As evidence-based interventions are scaled, fidelity of implementation, and thus effectiveness, often wanes. Validated fidelity measures can improve researchers' ability to attribute outcomes to the intervention and help practitioners feel more confident in implementing the intervention as intended. We aim to provide a model for the validation of…

Pragmatic measures of evidence-based practice (EBP) implementation can support and evaluate implementation efforts. We examined the predictive validity of therapist reports of EBP strategy delivery for children's mental health outcomes. Data were obtained from 1,380 sessions with 248 children delivered by 76 therapists in two county systems.…

This brief provides a summary of the validity of Istation ISIP Early Reading scores in predicting students' performance levels on the Idaho Standards Achievement Test (ISAT) in English language arts (ELA). This correlational study analyzed how well third grade students' winter performance on the ISIP Early Reading test predicted their spring…

Teacher candidate performance assessments represent a promising source of data for evidence-based program improvement. However, teacher preparation programs (TPPs) interested in reform face a crucial question: how to identify actionable evidence in performance-assessment data. To address this concern, we propose a two-pronged empirical framework…

The purpose of this study was to evaluate the construct and predictive validity of scores on a measure of social acceptability of class-wide and individual student intervention, the School Intervention Rating Form (SIRF), with high school teachers. Utilizing scores from 158 teachers, exploratory factor analysis revealed a three-factor (i.e.,…

Medical schools with a diverse student body face the challenge of ensuring that all students succeed academically. Many medical schools have implemented prematriculation programs to prepare students from diverse backgrounds; however, evidence on their impact is largely lacking. In this study, we analyzed participants' demographics as well as the…

The widespread concern about mathematics achievement has drawn extensive research attention to what skills predict later academic achievement. There is clear and consistent evidence that math achievement at school entry is the strongest predictor of later school success and educational attainment. Early childhood math achievement can thus have…

Augustine and Hemenover (2013) were right to state that meta-analyses should be accurate and generalizable. However, we disagree that our meta-analysis of emotion regulation strategies (Webb, Miles, & Sheeran, 2012) fell short in these respects. Augustine and Hemenover's concerns appear to have accrued from misunderstandings of our inclusion…

This study analyzed data from four evaluation designs incorporating the retrospective pretest (i.e., thentest), analyzing the effects of self-report pretesting and post-program survey format on a set of self-report measures. Validity of self-report data was assessed by comparing the criterion validity of then ratings to established benchmarks and…

Out-of-school time (OST) youth programs are inherently difficult to assess. They are often very dynamic: Many youth interact with one another and with staff members in various physical environments. Despite the challenge, measuring quality is critical to help program directors and policy makers identify where to improve and how to support those…

This study examines how GRE scores can be used to better understand Education doctoral candidates' methodology choices for the dissertation as well as their persistence behaviors. Candidates' of one online doctoral education program were examined. Results of a MANOVA suggested that there is no difference in GRE scores based on doctoral candidates'…

The objective of this study was to validate a scale for assessment of academic projects. As a complement, we examined its predictive ability by comparing the scores of advised/corrected projects based on the model and the final scores awarded to the work by an examining panel (approximately 10 months after the project design). Results of…

Objective: Application of the Transtheoretical Model (TTM) to Supplemental Nutrition Assistance Program Education (SNAP-Ed) evaluation and development and validation of an evaluation tool used to measure TTM constructs is described. Methods: Surveys were collected from parents of children receiving food at Summer Food Service Program sites prior…

This article focuses on the research being conducted by Cambridge International Examinations (Cambridge) to ensure that its international assessments prepare students as well as other acceleration programs for continued study in U.S. colleges and universities. The study, which builds on previous freshman GPA data modeling work using data supplied…