The Campbellian validity typology has been used as a foundation for outcome evaluation and for developing evidence-based interventions for decades. As such, randomized control trials were preferred for outcome evaluation. However, some evaluators disagree with the validity typology's argument that randomized controlled trials as the best design…

We examine how the politics of knowledge production limit research on the relationship between immigration status and social inequality. We centre the practices of methodological nationalism in Canada, a traditional country of permanent immigration in which temporary migration has become a core feature of the immigration system. In this case,…

In the mixed methods research (MMR) literature, the term paradigm is used in a number of ways to support very different accounts. This article aims to contribute to the ongoing dialogue about the relationship between MMR and paradigms by analyzing two main claims discussed in the literature: (a) MMR is a new paradigm and (b) MMR mixes different…

This paper, of theoretical nature, explores the levels of approach and abstraction of research in the field of education policy: description, analysis and understanding. Such categories were developed based on concepts of Bourdieu's theory and on the grounds of epistemological studies focused on education policy and meta-research. This paper…

This article challenges the idea that mixed methods research (MMR) constitutes a coherent research paradigm and explores how different research paradigms exist within MMR. Tracing paradigmatic differences at the level of methods, ontology, and epistemology, two MMR strategies are discussed: nested analysis, recently presented by the American…

The motivation for this paper is the authors' recent work on several randomized control trials in which they found the primary result, which averaged across subgroups or sites, to be moderated by demographic or site characteristics. They are led to examine a distinction that the Institute of Education Sciences (IES) makes between "confirmatory"…

Concomitant with the rise of rationalizing accountability in higher education has been an increase in theoretical reflection about the forms accountability has taken and the ones it should take. The literature is now peppered by a wide array of distinctions (e.g. internal/external, inward/outward, vertical/horizontal, upward/downward,…

Publication patterns of articles in "Adultspan" from 1999 to 2009 were reviewed. Author characteristics and article content were analyzed to determine trends over time. Research articles were analyzed specifically for type of research design, classification, sampling method, types of participants, sample size, types of statistics used, and…

This empirical study explored the impression management techniques and standardized performances college students use on their Facebook profiles to ensure their peers believe they are fully participating in the undergraduate experience. Employing an ethnographic research design and data collected using participant-observation and interview…

The resource typologies proposed in the new standard, "Resource Description and Access" (RDA), are evaluated in the context of a particular university library catalogue through two card-sort exercises. Although it was found that end-users recognised the content and carrier aspects of the resource types as listed in RDA, they did not…

A new line of research has emerged that examines the prevalence rates of mixed methods within disciplines in the social/behavioral sciences. Research presented in this article is unique in that it examines prevalence rates across multiple disciplines using an established cross-disciplinary classification scheme. Results indicate that there are…

Models of a psychological process can be difficult to discriminate experimentally because it is not easy to determine the values of the critical design variables (e.g., presentation schedule, stimulus structure) that will be most informative in differentiating them. Recent developments in sampling-based search methods in statistics make it…

This article addresses the characterization and circumvention of E. H. Simpson's paradox in designs involving two ordered variables and illustrates the recommended procedure using a two-sample application involving estimation of correlation and a single-subject application involving the estimation of lag(1) autocorrelation. (Author/SLD)

lllustrates a link between the multiple-rater kappa of J. Fleiss (1971) or other analogues and the generalizability (G) coefficient for a single facet design, and discusses the use and interpretation of G theory in the study of interrater agreement when data are measured on a nominal scale. (SLD)

Higher education institutions (HEIs) have experienced increasing pressures to provide accountability data and consumer information on the quality of teaching and learning. Existing ratings and rankings of HEIs tend to neglect information on student learning outcomes. Instead, they focus on inputs, activities and research outputs, such as resources…