Methodologist. Methodologist. Methodologist. Methodologist. Saying a word enough times in rapid-fire succession can make it lose its meaning. Your focus shifts from understanding of the word and its multiple signifiers, to the sounds you make when you say it, the movement of your lips and the shape of your mouth, the touch of your tongue on your…

In the 2018 meta-analysis of "Educational Psychology Review" entitled "Null effects of perceptual disfluency on learning outcomes in a text-based educational context" by Xie, Zhou, and Liu, we identify some errors and inconsistencies in both the methodological approach and the reported results regarding coding and effect sizes.…

In this commentary, I identify some common themes in the six articles in this special issue, including the importance of aligning research methods with research questions and embracing the complexity of educational phenomena. Then, I reflect on some differences in how authors responded to the request to discuss the role of their inquiry world view…

Young and Holsteen (YH) introduce a number of tools for evaluating model uncertainty. In so doing, they are careful to differentiate their method from existing forms of model averaging. The fundamental difference lies in the way in which the underlying estimates are weighted. Whereas standard approaches to model averaging assign higher weight to…

In this article, I comment on the prospect of integrating an intersectionality perspective into the developmental sciences. I do this by sharing impressions, insights, and questions that have emerged whilst attempting to look at and to look through an intersectionality lens. My comments focus on three main topics. First, I speculate what forms…

Across our combined 15 years of experience as methodologists and research methodology instructors, we have found that the concept of 'failure' is only a small portion of methodological literature and is similarly missing from scholarship on teaching and learning social science research methodology. We define failure in terms of our inability as…

The author comments on Noel Entwistle's paper "Contributions of Educational Psychology to Understanding Student Learning: What Has Been Discovered -- What More Could Be Done?" He begins the article by expressing his delight because he feels Entwistle's work has been a beacon in the understanding of student learning and his contributions…

In this special issue response paper, we pick up from prior discussions to suggest areas where we think policy sociology can benefit from further conversation and research. In particular, we bring together our respective readings and work on policy mobilities, in conversation with the contributions of this special issue, to think further about…

The commenter's proposal may be a reasonable method for addressing uncertainty in predictive modeling, where the goal is to predict "y." In a treatment effects framework, where the goal is causal inference by conditioning-on-observables, the commenter's proposal is deeply flawed. The proposal (1) ignores the definition of…

Studies examining the influence of alcohol intoxication have reported mixed findings on whether it impairs eyewitness memory. Although the studies in this Special Issue investigated different questions and tested different variables, the findings of these studies collectively provide insight into mechanisms and methodological issues that may…

Despite recognition that database search alone is inadequate even within the health sciences, it appears that reviewers in fields that have adopted systematic review are choosing to rely primarily, or only, on database search for information retrieval. This commentary reminds readers of factors that call into question the appropriateness of…

Randomized controlled trials are a special case of designs using an unbiased instrument to take care of confounders even if they are unmeasured or unknown. Another example of studies using instrumental variables is the Mendelian experiment and Directed Acyclic Graphs show the power of such designs to enhance the internal validity. It is argued…

This article examines the main ideas presented in Newell's groundbreaking article, published in "Issues in Integrative Studies" in 2001, "A Theory of Interdisciplinary Studies": that complexity is a precondition for interdisciplinary research, that interdisciplinary research utilizes disciplinary perspectives, and that…

Dowd and Bartlett (2019) tested the reading competencies of second graders attending Save the Children programs in 11 countries. They used sixty-word passages and comprehension questions without time limits and analyzed data of students reading more than 10 words per minute. They found wide disparities in speed among those who showed high…

In his detailed response to our paper on sample size in qualitative research, Norman Blaikie raises important issues concerning conceptual definitions and taxonomy. In particular, he points out the problems associated with a loose, generic application of adjectives such as 'qualitative' or 'inductive'. We endorse this concern, though we suggest…