The evidence continuum is a five-domain model for building evidence through needs assessment, program theory, process evaluation, outcomes and impact evaluation, and optimization studies. In this conceptual article, the first two domains of the evidence continuum are used to design a learner centered course on advanced research methods, and…

Traditionally, cluster randomized controlled trials are analyzed with the average intervention effect of interest. However, in populations that contain higher degrees of heterogeneity or variation may differ across different values of a covariate, which may not be optimal. Within education and social science contexts, exploring the variation in…

Background: Stealth assessment is a learning analytics method, which leverages the collection and analysis of learners' interaction data to make real-time inferences about their learning. Employed in digital learning environments, stealth assessment helps researchers, educators, and teachers evaluate learners' competencies and customize the…

Virtual laboratories are transformative tools in science education, yet comprehensive reviews of their prospects are limited. This study addresses this gap through a bibliometric analysis of 218 articles published between 2013 and 2023. Key findings included: (1) research has evolved from initial exploration to rapid expansion; (2) virtual labs…

Internationally, the political appetite for educational measurement capable of capturing a metric of value for money and effectiveness has momentum. While most would agree with the need to assess costs relevant to quality to help support better governmental policy decisions about public spending, poorly understood measurement comes with unintended…

This paper describes the long-term re-development of an introductory graduate research methods course. The initial design is presented, followed by the two re-design phases. Phase 2 introduced additional inquiry-based strategies such as concept mapping and multiple levels of peer collaboration. Phase 3 incorporated competency-based techniques as…

This paper presents a step-by-step conversion of a face-to-face (F2F) entry level social work research methods course to a computer-mediated format. An overview of teaching practices and the important pedagogical foundations associated with this curricular effort are discussed followed by an introduction to the electronic platform utilized in the…

Our research examines the effectiveness of intake variables used by a Canadian post-degree teacher education program over the period of 3 years to select candidates for entry into the program. Using a mixed-methods approach, we compared intake variables (grade point average, written response, work experience, reference letters, academic…

This article provides an evaluation of the redesign of a research methods course intended to enhance students' learning for understanding and transfer. Drawing on principles of formative assessment from the existing academic literature, the instructor introduced a number of increasingly complex low-stakes assignments for students to complete prior…

Drawing on the experience of training graduate students and researchers in qualitative and mixed-methods analysis since the mid-1990s, the authors reflect on the evolution of a multidisciplinary graduate course developed in a Canadian university since 2007. The hands-on/hands-off course design based on the use of NVivo was developed in parallel…

This document presents the technical appendices that accompany the full report, "Determining College Readiness in California's Community Colleges: A Survey of Assessment and Placement Policies." The appendices include: (1) Survey Design and Administration; and (2) Survey Instrument. [This report was written with research support from…

Failure forms an important dimension of art and design and is inherent in creative endeavours. This article explores current literature on failure in the art and design context and offers a contribution through qualitative research drawing upon interviews with lecturing staff in a UK art school. The findings from this research emphasise the…

Data visualization is the term used to describe the methods and technologies used to allow the exploration and communication of quantitative information graphically. Data visualization is a rapidly growing and evolving discipline, and visualizations are widely used to cover politics. Yet, while popular and scholarly publications widely use…

Design-based research (DBR) is a core methodology of the Learning Sciences. Historically rooted as a movement away from the methods of experimental psychology, it is a means to develop "humble" theory that takes into account numerous contextual effects for understanding how and why a design supported learning. DBR involves iterative…

This quasi-experimental study reports on the effectiveness of three assessment strategies for students' performance. The primary goal was to determine whether there are any improvements in students' conceptual learning when a frequent (weekly) quiz is used for grading purposes compared to using midterm and final examinations only. Another goal was…