Background: For decades, education researchers have relied on the work of Campbell, Cook, and Shadish to help guide their thinking about valid impact estimates in the social sciences (Campbell & Stanley, 1963; Shadish et al., 2002). The foundation of this work is the "validity typology" and its associated "threats to…

Apart from providing a bird's eye view of a given domain of inquiry (Ioannidis et al., 2015), systematic reviews such as methodological syntheses offer a magnifying glass on prevalent existing problems in primary research and furnish empirically grounded solutions to rectify these issues (Page et al., 2021). As survey research in second language…

Conceptual replications have received increased coverage in the educational research agenda. This article argues for clarity in, and justification of, the definition, scope, and boundaries of a conceptual replication and what it can and cannot do. It argues for clear justifications when changing components from those of the original study. The…

Discrimination is associated with numerous psychological health outcomes over the life course. The nine-item Everyday Discrimination Scale (EDS) is one of the most widely used measures of discrimination; however, this nine-item measure may not be feasible in large-scale population health surveys where a shortened discrimination measure would be…

We offer a new conceptualization and measurement models for constructs at the group-level of analysis in small group research. The conceptualization starts with classical notions of group behavior proposed by Tönnies, Simmel, and Weber and then draws upon plural subject theory by philosophers Gilbert and Tuomela to frame a new perspective…

An increased focus on transparency and replication in science has stimulated reform in research practices and dissemination. As a result, the research culture is changing: the use of preregistration is on the rise, access to data and materials is increasing, and large-scale replication studies are more common. In this article, I discuss two…

This dissertation is composed of projects on three aspects of gathering and learning from data in the social sciences: drawing representative samples, taking valid measurement, and making warranted inductive inferences. Chapter one studies the challenge of drawing representative human samples. It is well documented that most samples used by…

The purpose of this study is to use Indigenous data collection to present construct validity of an instrument designed to test the American Indian/Alaska Native Millennium Falcon Postsecondary Persistence Model (Lopez, 2018). In the following, I describe an alternative sampling technique based on an Indigenous quantitative methodology to examine…

This case study is based on a research project the first author conducted for his master's thesis under the guidance and supervision of the second author, his academic adviser. In this case study, we highlight some of the most important aspects of the project. Specifically, we explain how our research was prompted by the lack of empirical testing…

This book explores the Capability Approach (CA) as an alternative critical lens through which to regard early childhood education (ECE) curricula. The CA framework is a counter narrative to the narrow instrumentalism that reduces education to a mere process of academic skills acquisition for a future workplace. Primarily the book draws on the…

Proactive preliminary minimum sample size determination can be useful for the early planning stages of a latent variable modeling study to set a realistic scope, long before the model and population are finalized. This study examined existing methods and proposed a new method for proactive preliminary minimum sample size determination.

The authors of this article use data produced in a collaborative community arts group in BC Canada as a way to think about validation in arts-based educational research (ABER). As Lather attempted to find middle ground between "rampant subjectivity" and "pointless precision" in research, she (1986) suggested that studies with…

Context: Instrument validation is an important facet of survey research methods and athletic trainers must be aware of the important underlying principles. Objective: To discuss the process of survey development and validation, specifically the process of construct validation. Background: Athletic training researchers frequently employ the use of…

Due to the nature of collaborative learning, realising perfectly controlled experiments often requires an unreasonable amount of resources and sometimes it is not possible at all. Against this background, I propose to augment as good as feasible experimental design with a nomological net of relations between instructional support (intervention),…

Monte Carlo methods can be used in data analytic situations (e.g., validity studies) to make decisions about sample size and to estimate power. The purpose of using Monte Carlo methods in a validity study is to improve the methodological approach within a study where the primary focus is on construct validity issues and not on advancing…