Evidence-based programs and grassroots programs are often adapted during implementation. Adaptations are often hidden, ignored, or punished. Although some adaptations stem from lack of organizational capacity, evaluators report other adaptations happen in good faith or are efforts to better fit the local context. Program implementers, facilitators…

Evaluations are considered of key importance for a well-functioning democracy. Against this background, it is vital to assess whether and how evaluation models approach the role of citizens. This paper is the first in presenting a review of citizen involvement in the main evaluation models which are commonly distinguished in the field. We present…

In the learning design community, there has been an increasing recognition of the value of positioning teaching as a design science, in which teachers craft and test effective learning conditions through a goal-oriented and evidence-based procedure. However, the existing models and tools supporting teachers' design practice focus primarily on…

This article explores the models and frameworks developed on "research impact'. We aim to provide a comprehensive overview of related literature through scoping study method. The present research investigates the nature, objectives, approaches, and other main attributes of the research impact models. It examines to analyze and classify models…

The Cross-Classified Mixed Effects Model (CCMEM) has been demonstrated to be a flexible framework for evaluating reliability by measurement specialists. Reliability can be estimated based on the variance components of the test scores. Built upon their accomplishment, this study extends the CCMEM to be used for evaluating validity evidence.…

Evidence-based assessment (EBA) requires that investigators employ scientific theories and research findings to guide decisions about what domains to measure, how and when to measure them, and how to make decisions and interpret results. To implement EBA, investigators need high-quality assessment tools along with evidence-based processes. We…

The adversary evaluation model emerged in a context that favored democratic debate. It was successfully used in a variety of sectors following its inception, but it was abandoned once neo-liberal thinking and goal achievement approaches became dominant. It is time to give it a second chance. The judicial evaluation model (JEM) relies on human…

The evidence continuum is a five-domain model for building evidence through needs assessment, program theory, process evaluation, outcomes and impact evaluation, and optimization studies. In this conceptual article, the first two domains of the evidence continuum are used to design a learner centered course on advanced research methods, and…

Recently, machine learning (ML) has evolved and finds its application in higher education (HE) for various data analysis. Studies have shown that such an emerging field in educational technology provides meaningful insights into several dimensions of educational quality. An in-depth analysis of the application of ML could have a positive impact on…

The higher education sector is under increasing pressure to deliver more and to evidence the fruits of its contribution to society. There is a particular focus on the enhanced engagement of students in order to maximise success, and for this engagement to be achieved equitably across the student body, regardless of demographic backgrounds. This…

The Comprehensive Assessment System (CAS) Framework presents a vision for a system of assessments for English Learners in secondary grades that brings assessment closer to the classroom and fully involves teachers in assessment development and validation. The CAS Framework is intended to signal a new and equitable direction and to provoke…

Designs combining different types of data are increasingly used in educational evaluation, to provide both evidence of impact and an explanation of the processes by which impacts are created. Logic models are visual representations of how an intervention leads via a set of steps from resources and inputs to outputs and then sets of outcomes. Their…

Problem solving plays an essential role in all scientific disciplines, and solving problems can reveal essential concepts that underlie those disciplines. Thus, problem solving serves both as a common tool and desired outcome in many science classes. Research on teaching problem solving offers principles for instruction that are guided by learning…

In the context of the major influence that 'effectiveness' is having internationally, paper studies the contemporary methodological perspectives in educational research when considering teachers' practice. It shows that current trends can be boiled down to: (1) naturalistic methodology, (2) descriptive methodology, and (3) the nonmethodological…

This paper argues that the dominant framework for conceptualizing validation evidence and analysis--the "five sources" framework from the 1999 "Standards"--is seriously limited. Its limitation raises a significant barrier to understanding the nature of comprehensive validation, and this presents a significant threat to…