As evidence-based interventions are scaled, fidelity of implementation, and thus effectiveness, often wanes. Validated fidelity measures can improve researchers' ability to attribute outcomes to the intervention and help practitioners feel more confident in implementing the intervention as intended. We aim to provide a model for the validation of…

In-service training is a critical and frequently utilized implementation strategy to support the adoption and delivery of evidence-based practice (EBP) across service settings, but is characteristically ineffective in producing provider behavior changes, particularly when delivered in single exposure didactic events. EBP trainers are in a…

The Additive Factor Model (AFM) is a cognitive diagnostic model that can be used to predict student performance on items in a context that allows for student learning. Within AFM, "skills" have a learning rate, and student acquisition of a skill depends only on the number of opportunities a student has had to exercise that skill and the…

Recruiting and retaining excellent teachers remains a pressing policy issue in education systems worldwide. According to UNESCO estimates, 68.8 million teachers will need to be recruited globally to meet Sustainable Development Goal 4. However, simply recruiting more teachers will not be enough to meet this challenge: we need to recruit…

Gargani and Strong claim to have developed and validated an observation system that requires only 4 hr of training, but one that can identify effective teachers using just 20 min of one video-taped lesson. They further contend that their six-item inventory requires little judgment from those who use it. They describe their instrument, the Rapid…

Medical schools with a diverse student body face the challenge of ensuring that all students succeed academically. Many medical schools have implemented prematriculation programs to prepare students from diverse backgrounds; however, evidence on their impact is largely lacking. In this study, we analyzed participants' demographics as well as the…

The objectives of this study were to identify the effectiveness of the panel admission interview as a selection tool for the medical program and identify improvements in the selection tools battery. Data from 1024 students, representing four cohorts of students were used in this study. Exploratory factor analysis using principal component analysis…

The widespread concern about mathematics achievement has drawn extensive research attention to what skills predict later academic achievement. There is clear and consistent evidence that math achievement at school entry is the strongest predictor of later school success and educational attainment. Early childhood math achievement can thus have…

Citizen science programs provide opportunities for students to help professional scientists while fostering science achievement and motivation. Instruments which measure the effects of this type of programs on student motivational beliefs are limited. The purpose of this study was to describe the process of examining the reliability and validity…

Augustine and Hemenover (2013) were right to state that meta-analyses should be accurate and generalizable. However, we disagree that our meta-analysis of emotion regulation strategies (Webb, Miles, & Sheeran, 2012) fell short in these respects. Augustine and Hemenover's concerns appear to have accrued from misunderstandings of our inclusion…

This study analyzed data from four evaluation designs incorporating the retrospective pretest (i.e., thentest), analyzing the effects of self-report pretesting and post-program survey format on a set of self-report measures. Validity of self-report data was assessed by comparing the criterion validity of then ratings to established benchmarks and…

This mixed methods study explored the nature of a benchmark assessment program and how well the benchmark assessments predicted End-of-Grade (EOG) and End-of-Course (EOC) test scores in an American Indian school district. Five major themes were identified and used to develop a Dimensions of Benchmark Assessment Program Effectiveness model:…

Out-of-school time (OST) youth programs are inherently difficult to assess. They are often very dynamic: Many youth interact with one another and with staff members in various physical environments. Despite the challenge, measuring quality is critical to help program directors and policy makers identify where to improve and how to support those…

A greater understanding of implicit cognition can provide important information regarding the etiology and maintenance of psychological disorders. The current study sought to determine the utility of the Implicit Relational Assessment Procedure (IRAP) as a measure of implicit aversive bias toward spiders in two groups of known variation, high fear…

Background: Current theories of self-regulated learning predict a positive link between student monitoring accuracy and performance: students who more accurately monitor their knowledge of a particular set of materials are expected to more effectively regulate their subsequent study of those materials, which in turn should lead to higher test…