Research on computing in higher education research has been dominated by studies on "things that work" (or not). While useful, the field now needs more research on authentic tech-related problems of practice and viable solutions that resolve them. This article describes one such approach: Educational Design Research (EDR). It begins with…

The purpose of this paper is to elaborate and comment on some themes related to construct validity, construct choice, and construct respecification in the Campbellian validity system. It is argued that Reichardt's [(2008, November). An alternative to the Campbellian conceptualization of validity. (Paper presentation). Evaluation 2008 Conference,…

There is growing interest in incorporating multiple voices and ways of knowing into assessment efforts. Attention to incorporating multiple approaches to measuring student learning increases equity in assessment (Montenegro and Jankowski 2017) and promotes engagement with a variety of stakeholders with diverse perspectives on knowledge. However,…

Single-case research design is a useful methodology to investigate counseling treatment effects through a time-series graph. A systematic review of 42 counseling journals was conducted, yielding 50 studies, including 272 graphs. Most graphs did not meet recommended guidelines. How graphs impact visual analysis and suggestions to enhance…

This paper considers notions of spaces and relations in research design for critical education researchers, based on Freirean principles of empowerment education. Three reflective 'narratives of praxis' from community-based research are explored. The first narrative takes a community arts approach to research and is situated in an urban…

Purpose: Recent reports by the National Academy of Sciences, Engineering, and Medicine have ignited a new wave of discourse regarding the future of education research and reinvigorated calls for education research to be more relevant to practice. An emerging research paradigm, continuous improvement research (CIR), responds to that debate by…

Egocentric networks represent a popular research design for network research. However, to what extent and under what conditions egocentric network centrality can serve as reasonable substitutes for their sociocentric counterparts are important questions to study. The answers to these questions are uncertain simply because of the large variety of…

It has been over 60 years since interpreter and translator trainers began to generate and disseminate knowledge in the 1950s. Although there have been reviews of 10 to 15 years of research, no attempts have been made to review the literature published over the past six decades for an overall landscape of knowledge creation in T&I education.…

Using a sample of 70,399 published p-values from 192 meta-analyses, we empirically estimate the counterfactual distribution of p-values in the absence of any biases. Comparing observed p-values with counterfactually expected p-values allows us to estimate how many p-values are published as being statistically significant when they should have been…

This article reviews the origins and use of the terms quasi-experiment and natural experiment. It demonstrates how the terms conflate whether variation in the independent variable of interest falls short of random with whether researchers find, rather than intervene to create, that variation. Using the lens of assignment--the process driving…

Within educational research, qualitative data offers unique opportunities to contextualize findings that arise from large-scale quantitative data collection processes. Still, to date, most educational research is based on researchers' determination of what is important, not the participants'. Participatory Rank Methodology (PRM) is a…

Single-case design (SCD) is a quantitative experimental technique in which participants serve as their own control. The use of an effect size in SCD allows evaluation of outcomes as well as comparison of outcomes via meta-analyses. Characteristics of SCD research make the selection of an appropriate effect size complicated. Additionally, there are…

Until now, the conventional approach using two distinct groups, experimental and control, continues to dominate research, especially education research. Researchers, particularly those who are active in this domain, readily recognise this pattern when surveying literature. This article explores the use of the Solomon four-group design as a…

A key aspect of metacognition is metacognitive accuracy, i.e., the degree to which confidence judgments differentiate between correct and incorrect trials. To quantify metacognitive accuracy, researchers are faced with an increasing number of different methods. The present study investigated false positive rates associated with various measures of…

Optimizing collaborative behavior is crucial in educational activities, directly improving academic performance, social skills, and social-emotional learning for both teachers and students. In an effort to decipher the mechanisms underlying the effectiveness of collaborative learning, educators and neuroscientists have initiated the collection and…