The use of complexity-based evaluation methods remains relatively underexplored in the field of evaluation. While increasingly employed to assess complex interventions, Contribution Analysis (CA) continues to suffer from a lack of operationalization. In this article, we propose enhancing the implementation of CA by leveraging Participatory Systems…

This study aimed to assess the methods and outcomes of The Measurement Tool to Assess systematic Reviews (AMSTAR) 2 appraisals in overviews of reviews (overviews) of interventions in the cardiovascular field and identify factors that are associated with these outcomes. MEDLINE, Scopus, and the Cochrane Database of Systematic Reviews were searched…

This dissertation used synthetic datasets, semi-synthetic datasets, and a real-world dataset from an educational intervention to compare the performance of 15 machine learning and multiple imputation methods to estimate the individual treatment effect (ITE). In addition, it examined the performance of five evaluation metrics that can be used to…

The theoretical defensibility of applied linguistic intervention design provides the rationale for such designs, demonstrating how they are supported by theory, constructs, and analysis. Though founded upon science, imaginative design has its leading technical function as guiding lodestar. A scientific rationale for a plan underwrites the design,…

Measures of learning speed (i.e., the amount of learning/cumulative time learner spends engaged in an intervention) are rarely included in research designed to evaluate and compare academic interventions. We build a case that includes analyses of learning speed metrics in academic intervention research can provide more useful information for…

The number of real-world laboratories (RwLs) as research settings to address sustainability problems by using collaborative and experimental approaches has been growing steadily over the past years. RwLs are widely considered promising settings for the production of action-orientated knowledge in order to contribute solving wicked real-world…

When teachers work with students exhibiting academic failure, they may look to factors outside of instruction such as a student's home life or perceived disability as explanations. Placing the locus of control outside of the instructional context becomes a convenient way to escape culpability for unsatisfactory outcomes. A more functional approach…

Computational Thinking (CT) is considered a core 21st century digital skill. The aspect of assessment is crucial and knowing what, who, when, how, and where to assess is important for assessment design. In this study, we conducted an umbrella review to gain insights regarding CT assessment in higher education. In total, we analyzed 11 reviews,…

Background: With the right support, people with learning disabilities can be 'good enough' parents (Coren et al., 2011; Murphy & Feldman, 2002). Parenting programmes exist to support parents and are made accessible for people with learning disabilities who are expecting a baby, but evaluation of the benefit of these interventions is poor due…

The visual analysis of data presented in time-series graphs are common in single-case design (SCD) research and applied practice in school psychology. A growing body of research suggests that visual analysts' ratings are often influenced by construct-irrelevant features including Y-axis truncation and compression of the number of data points per…

The tools charts are some of the most frequently visited resources on the NCII website. Furthermore, current and prior federal legislation and increasingly state legislation, emphasizes the use of educational programs, interventions, and assessments that have an evidence base supporting their effectiveness. State education agencies (SEAs) play an…

This article, located in the discipline of academic literacy studies, draws upon the fields of critical realism, design research, and evaluation studies. It reports on the validation of a flexible evaluation design for assessing the impact of academic literacy interventions. The design was validated in two ways. Firstly, through a process of…

Traditional efforts around improving assessment often center on the teacher as the evaluator of work rather than the students. These assessment efforts typically focus on measuring learning rather than stimulating, promoting, or producing learning in students. This paper summarizes a study of a large sample of undergraduate students (n = 550) in…

Many university students, including first-year business education students (FYBES) in Ghana, struggle to adjust to academic demands and university life, leading to low engagement and satisfaction with academic experiences. Despite efforts to improve student engagement and satisfaction, the extent to which gender influence this relationship remains…

In this scoping review on 34 studies, we examined the use of immersive virtual reality (IVR) in neurodevelopmental disorders (NDD). IVR was mostly used in connection with autism spectrum disorder (ASD) for assessment of and intervention in social skills, and in attention deficit hyperactivity disorder (ADHD) for assessment of executive…