Increasing concerns about the trustworthiness of research have prompted calls to scrutinise studies' Individual Participant Data (IPD), but guidance on how to do this was lacking. To address this, we developed the IPD Integrity Tool to screen randomised controlled trials (RCTs) for integrity issues. Development of the tool involved a literature…

Evaluation competency frameworks across the globe regard evaluation approaches as important to know and use in practice. Prior classifications have been developed to aid in understanding important differences among varying approaches. Nevertheless, there is an opportunity for a new classification of evaluation approaches, in particular one that is…

Systematic reviews (SRs) have an important role in the healthcare decision-making practice. Assessing the overall confidence in the results of SRs using quality assessment tools, such as "A MeaSurement Tool to Assess Systematic Reviews 2" (AMSTAR 2), is crucial since not all SRs are conducted using the most rigorous methods. In this…

Post-secondary institutions are required to complete a variety of quality assurance activities including external program review, a process of inviting external reviewers from outside the institution to provide constructive feedback on all aspects of an academic program. While external program reviews have been completed for decades, there has…

Fidelity is defined as doing what is intended. The purpose of measuring fidelity is to assist with supporting implementation. Collecting fidelity data provides an opportunity to problem-solve throughout the process versus waiting for outcome data. More often than not, purchased programs and curriculum materials are missing a research-validated…

This article builds upon a proiminent definition of construct validity that focuses on variation in attributes causing variation in measurement outcomes. This article synthesizes the defintion and uses Rasch measurement modeling to explicate a modified conceptualization of construct validity for assessments of developmental attributes. If…

Educational games help reinforce educational concepts. They help students learn through hypothesizing, probing, and reflecting upon the game environment. Understanding the impact of a game is important before deploying it in a class. Recent studies in learning analysis describe methodologies and approaches for analyzing educational games. However,…

Premised on the idea that evaluators should be familiar with a range of approaches to program modifications, I review several existing approaches and then describe another, less well-recognized option. In this newer option, evaluators work with others to identify potentially needed adaptations for select program aspects "in advance." In…

Decision consistency (DC) is the reliability of a classification decision based on a test score. In professional credentialing, the decision is often a high-stakes pass/fail decision. The current methods for estimating DC are computationally complex. The purpose of this research is to provide a computationally and conceptually simple method for…

The collection of student data through screening and progress monitoring of social and emotional learning (SEL) skills is just as important as the implementation of curriculum and practices. Monitoring skill acquisition allows teachers to identify effective practices, provide intervention, and intensify support for students who need it. In this…

Background: Rapid reviews involve a streamlined approach to knowledge synthesis. They are used to identify high-quality evidence for the purpose of informing decisions and initiatives, completed over relatively short timeframes, and have been found to reach conclusions that do not differ extensively from full systematic reviews. Although common in…

Evidence-based assessment (EBA) requires that investigators employ scientific theories and research findings to guide decisions about what domains to measure, how and when to measure them, and how to make decisions and interpret results. To implement EBA, investigators need high-quality assessment tools along with evidence-based processes. We…

This is a protocol for a Campbell Review following JBI scoping review methodology. The objectives are to answer the following questions: What has been reported in the literature about collaborative learner-educator design, implementation, or evaluation of learner assessment in health professional education? (1) Where is learner-educator…

This paper briefly discusses Peter Senge's Continuous Assessment Learning Organization Model for Quality Improvement, and describes how it is implemented in improving the quality of education by Christian Religious Colleges in Indonesia. The main conclusion of this paper is that Christian Religious Colleges in Indonesia must develop an…

Data from high-quality State assessments can inform instruction and help school leaders drive resources to the schools and students that need them the most. This dear colleague letter from the U.S. Secretary of Education reminds all who report and interpret student outcomes this year that assessment data has always been meant to be used…