In the early months of the COVID-19 pandemic, many research funding organizations were faced with the choice of suspending their peer review panels, or else continuing their decision-making processes virtually. Although seen part of a longer drive to make peer review more cost and time efficient as well as to combat climate and sustainability…

Imputation or likelihood-based approaches to handle missing data assume the data are missing completely at random (MCAR) or missing at random (MAR). However, little research has examined the missingness pattern before using these imputation/likelihood methods. Three missingness mechanisms -- MCAR, MAR, and not missing at random (NMAR) -- can be…

While methodologies are often presented as standardised procedures which, under specified conditions, should lead to the same conclusions, this case study presents the complex and deeply personal process of research (Addey and Piattoeva 2022). We analyse our application of network ethnography -- an approach presented by Ball (2016) -- to the study…

School psychology contributes to the science of human behavior and utilizes this science to inform an evidence-based practice. The usefulness of this science is dependent on scientists making good faith efforts to minimize bias in their research. Nonetheless, implicit biases can still influence scientists' decisions and, hence, the outcomes of…

Research on input processing and processing instruction has often employed a scoring method known as trials to criterion to observe the effects of instruction that emerge during training. Despite its common use in this research (see Fernández, 2021) this metric has never been evaluated critically. The present study first discusses several…

Education policy makers must make decisions under uncertainty. Thus, how they think about risks has important implications for resource allocation, interventions, innovation, and the information that is provided to the public. In this policy brief we illustrate how the standard of evidence for making decisions can be quite inconsistently applied,…

Retractions have traditionally been reserved for correcting the scientific record and discouraging research misconduct. Nonetheless, the potential for actual societal harm resulting from accurately reported published scientific findings, so-called information hazards, has been the subject of several recent article retractions. As these instances…

This paper contrasts mixed methods design with strategic research design. Mixed methods research both advocates for itself as always better than singular research methods, while also seemingly allowing a wide variety of researchers to count their work under the very large umbrella of mixed methods. We argue for strategic research design as a set…

The puzzle of how to connect research with policy and practice is a vital area for scientific inquiry. The William T. Grant Foundation believes that attempts to improve the use of research evidence in policy and practice should be subject to rigorous theory building and empirical analysis. The stakes are high for the research community: If we do…

This paper presents the main methodological issues met with during the research on adolescent everyday life information behavior in the context of making informed decisions, which was carried out in Croatia from 2018 to 2020. It does not focus on the research results, but rather on the methodological issues and concerns that had occurred stemming…

In undergraduate research settings, students are likely to encounter anomalous data, that is, data that do not meet their expectations. Most of the research that directly or indirectly captures the role of anomalous data in research settings uses post-hoc reflective interviews or surveys. These data collection approaches focus on recall of past…

The need to administrate experiments online is rising due to the COVID-19 pandemic, which brings both challenges and opportunities. However, the field of online experimental research design is still in its infancy. This case study elaborates on the experiences and decision-making process that guided an online experimental research project. First,…

States' commitments to tackling long standing inequities have been stifled by missing data, long delays, insufficient data-analysis tools, and the excessive reporting burden placed on states and institutions. If states hope to achieve their completion and equity goals, they need access to data that does not leave them guessing--so they can…

The content of research methods courses in tertiary education, as revealed by popular textbooks, tends to focus largely on procedural aspects of research investigations. Although following proper procedures is essential for reaching valid and reliable outcomes, there is another attribute of good quality research that is often missing from research…

The preregistration of research plans and hypotheses may prevent publication bias and questionable research practices. We incorporated a modified version of the preregistration process into an undergraduate capstone research course. Students completed a standard preregistration form during the planning stages of their research projects as well as…