Conceptual replications have received increased coverage in the educational research agenda. This article argues for clarity in, and justification of, the definition, scope, and boundaries of a conceptual replication and what it can and cannot do. It argues for clear justifications when changing components from those of the original study. The…

Discrimination is associated with numerous psychological health outcomes over the life course. The nine-item Everyday Discrimination Scale (EDS) is one of the most widely used measures of discrimination; however, this nine-item measure may not be feasible in large-scale population health surveys where a shortened discrimination measure would be…

Background: For decades, education researchers have relied on the work of Campbell, Cook, and Shadish to help guide their thinking about valid impact estimates in the social sciences (Campbell & Stanley, 1963; Shadish et al., 2002). The foundation of this work is the "validity typology" and its associated "threats to…

An increased focus on transparency and replication in science has stimulated reform in research practices and dissemination. As a result, the research culture is changing: the use of preregistration is on the rise, access to data and materials is increasing, and large-scale replication studies are more common. In this article, I discuss two…

This dissertation is composed of projects on three aspects of gathering and learning from data in the social sciences: drawing representative samples, taking valid measurement, and making warranted inductive inferences. Chapter one studies the challenge of drawing representative human samples. It is well documented that most samples used by…

Apart from providing a bird's eye view of a given domain of inquiry (Ioannidis et al., 2015), systematic reviews such as methodological syntheses offer a magnifying glass on prevalent existing problems in primary research and furnish empirically grounded solutions to rectify these issues (Page et al., 2021). As survey research in second language…

The purpose of this study is to use Indigenous data collection to present construct validity of an instrument designed to test the American Indian/Alaska Native Millennium Falcon Postsecondary Persistence Model (Lopez, 2018). In the following, I describe an alternative sampling technique based on an Indigenous quantitative methodology to examine…

We offer a new conceptualization and measurement models for constructs at the group-level of analysis in small group research. The conceptualization starts with classical notions of group behavior proposed by Tönnies, Simmel, and Weber and then draws upon plural subject theory by philosophers Gilbert and Tuomela to frame a new perspective…

This case study is based on a research project the first author conducted for his master's thesis under the guidance and supervision of the second author, his academic adviser. In this case study, we highlight some of the most important aspects of the project. Specifically, we explain how our research was prompted by the lack of empirical testing…

Proactive preliminary minimum sample size determination can be useful for the early planning stages of a latent variable modeling study to set a realistic scope, long before the model and population are finalized. This study examined existing methods and proposed a new method for proactive preliminary minimum sample size determination.

The authors of this article use data produced in a collaborative community arts group in BC Canada as a way to think about validation in arts-based educational research (ABER). As Lather attempted to find middle ground between "rampant subjectivity" and "pointless precision" in research, she (1986) suggested that studies with…

Due to the nature of collaborative learning, realising perfectly controlled experiments often requires an unreasonable amount of resources and sometimes it is not possible at all. Against this background, I propose to augment as good as feasible experimental design with a nomological net of relations between instructional support (intervention),…

Twenty-eight studies of grades, over a century, were reviewed using the argument-based approach to validity suggested by Kane as a theoretical framework. The review draws conclusions about the meaning of graded achievement, its relation to tested achievement, and changes in the construct of graded achievement over time. "Graded…

Evaluating the level of degree programmes became crucial with the Bologna Agreement in 1999 when European ministers agreed to implement common bachelor's and master's degree programmes and a common system of quality assurance. The European Quality Assurance system demands evaluation of the degree programme level based on valid and reliable…

The incidence of work accidents in the construction industry particularly in Indonesia and generally internationally shows an increasingly worrying trend given that either quantitatively or qualitatively the number of work accidents is very large compared to that of other industrial sectors. The main causing factors are mostly due to the workers'…