Randomized A/B tests allow causal estimation without confounding but are often under-powered. This paper uses a new dataset, including over 250 randomized comparisons conducted in an online learning platform, to illustrate a method combining data from A/B tests with log data from users who were not in the experiment. Inference remains exact and…

The arc of quantitative educational research should not be etched in stone but should adapt and change over time. In this article, I argue that it is time for a reshaping by offering my personal view of the past, present and future of our field. Educational research--and research in the social and life sciences--is at a crossroads. There are many…

In this article, we note the many ontological, epistemological, and methodological similarities between how Campbell and Rubin conceptualize causation. We then explore 3 differences in their written emphases about individual case matching in observational studies. We contend that (a) Campbell places greater emphasis than Rubin on the special role…

The purpose of this paper is to discuss the development of research questions in mixed methods studies. First, we discuss the ways that the goal of the study, the research objective(s), and the research purpose shape the formation of research questions. Second, we compare and contrast quantitative research questions and qualitative research…

Education researchers, practitioners, and policymakers alike are committed to identifying interventions that teach students more effectively. Increased emphasis on evaluation and accountability has increased desire for sound evaluations of these interventions; and at the same time, school-level data have become increasingly available. This article…

Structural equation models merge multiple regression, path analysis, and factor analysis techniques into a single data analytic framework. Measurement models are developed to define latent variables, and structural equations are then established among the latent variables. Explains the development of these models. (KS)

Using college transcripts, we separate the effects of remedial coursework from high school preparation. For two-year colleges, taking remedial classes was "not" associated with less academic success. In four-year colleges, there "are" negative effects of remedial coursework, but many minority students who complete a bachelor's…

Abuses and misuses of statistics are frequent. This digest attempts to warn against these in three broad classes of pitfalls: sources of bias, errors of methodology, and misinterpretation of results. Sources of bias are conditions or circumstances that affect the external validity of statistical results. In order for a researcher to make…

This overview of nonexperimental causal research methods focuses on latent variable structural equation modeling using the LISREL computer program. An extended example in special education is used to present LISREL as an extension of structural equations analysis (path analysis) and as a method of reducing the effects of error in research.…

The 7th International Conference on Education Data Mining held on July 4th-7th, 2014, at the Institute of Education, London, UK is the leading international forum for high-quality research that mines large data sets in order to answer educational research questions that shed light on the learning process. These data sets may come from the traces…

The IADIS CELDA 2012 Conference intention was to address the main issues concerned with evolving learning processes and supporting pedagogies and applications in the digital age. There had been advances in both cognitive psychology and computing that have affected the educational arena. The convergence of these two disciplines is increasing at a…