Most existing solutions to the current replication crisis in science address only the factors stemming from specific poor research practices. We introduce a novel mechanism that leverages the experts' predictive abilities to analyze the root causes of replication failures. It is backed by the principle that the most accurate predictor is the most…

The purpose of this article is to illustrate the dynamic process involved in developing and utilizing a theoretical model in a mixed methods study. Specifically, I illustrate how the theoretical model can serve as the starting point in framing the study, as a lens for guiding the data collection and analysis, and as the end point in explaining the…

The product Bayes factor (PBF) synthesizes evidence for an informative hypothesis across heterogeneous replication studies. It can be used when fixed- or random effects meta-analysis fall short. For example, when effect sizes are incomparable and cannot be pooled, or when studies diverge significantly in the populations, study designs, and…

There has been an ongoing debate of which physical labs or virtual labs are better. To resolve this issue, a remote lab provides an online lab that can do real experiments to obtain real data from a distant physical lab. Instead of relying on a remote lab, this article suggests that students collect experimental data locally with low-cost data…

This article introduces ethnographic upscaling, an innovative procedure to explore and test hypotheses drawn from in-depth ethnographic findings in spatially continuous cases. The approach combines the strength of localized ethnographic descriptions with questionnaire-based regional surveys to study the distribution of ethnographic findings across…

How do scientists generate and weight candidate queries for hypothesis testing, and how does learning from observations or experimental data impact query selection? Field sciences offer a compelling context to ask these questions because query selection and adaptation involves consideration of the spatiotemporal arrangement of data, and therefore…

A bottleneck in gathering big data about learning is instrumentation designed to record data about processes students use to learn and information on which those processes operate. The software system nStudy fills this gap. nStudy is an extension to the Chrome web browser plus a server side database for logged trace data plus peripheral modules…

Hypothesis generation is an important but difficult process for students. This study investigated the effects of providing students with support for hypothesis generation, with regard to the testability and complexity of the generated hypotheses, the quality of the subsequent inquiry learning processes and knowledge acquisition. Fifty-two…

The ubiquity of data in various forms has fueled the need for advanced data-mining techniques within organizations. The advent of data mining methods used to uncover hidden nuggets of information buried within large data sets has also fueled the need for determining how these unique projects can be successful. There are many challenges associated…

Programs that improve teaching effectiveness represent a core strategy to improve student educational outcomes and close student achievement gaps. This article compiles empirical values of intraclass correlations for designing effective and efficient experimental studies evaluating the effects of these programs. The Early Childhood Longitudinal…

The benefits of undergraduate research are well documented, and many colleges and universities include a senior research requirement for graduation. In addition, most science curricula attempt to include discoverystyle, laboratory components to prepare students for their research experiences and to expose them to research methods in different…

This research explored the knowledge, skills, and strategies early childhood teachers possess related to implementing curriculum and authentic assessment. Research suggests that early educators rate their knowledge of curriculum and authentic assessment and their implementation of both as excellent. Despite these self-reported, high levels of…

Previous research shows that interviewers to some extent fail to expend the effort that is needed to collect high-quality survey data. We extend the idea of interviewer satisficing to a related task, in which the interviewers themselves answer survey questions. We hypothesize that interviewers who self-administer the questionnaire in a careless…

This paper examines the implementation of Education for Sustainable Development (ESD) in Germany and explores the possibilities of Social Network Analysis (SNA) for uncovering influential actors in educational policy innovation processes. From the theoretical perspective, an actor's influence is inferred from its relative position within…

Online education is rapidly becoming a significant method of course delivery in higher education. Consequently, instructors analyze student performance in an attempt to better scaffold student learning. Learning analytics can provide insight into online students' course behaviors. Archival data from 167 graduate level education students enrolled…