Planning longitudinal studies can be challenging as various design decisions need to be made. Often, researchers are in search for the optimal design that maximizes statistical power to test certain parameters of the employed model. We provide a user-friendly Shiny app OptDynMo available at https://shiny.psychologie.hu-berlin.de/optdynmo that…

Beginning with debates about the effects of smoking on lung cancer, sensitivity analyses characterizing the hypothetical unobserved conditions that can alter statistical inferences have had profound impacts on public policy. One of the most ascendant techniques for sensitivity analysis is Oster's (2019) coefficient of proportionality, which…

Social scientists seeking to inform policy or public action must carefully consider how to identify effects and express inferences because actions based on invalid inferences will not yield the intended results. Recognizing the complexities and uncertainties of social science, we seek to inform inevitable debates about causal inferences by…

Conducting and publishing rigorous empirical research based on original data is essential for advancing and sustaining high-quality counseling practice. The purpose of this article is to provide a one-stop-shop for writing a rigorous quantitative Methods section in counseling and related fields. The importance of judiciously planning,…

In today's data-driven and data-informed educational landscape, leaders face increasing pressure to make decisions and present results based on what appear to be comprehensive statistical analyses. However, the ethical implications of these responsibilities can be complex, particularly when statistical results carry the potential to be…

The present study illustrates how select data can be organized to guide researchers to HSIs proficient at graduating Hispanics with STEM bachelor's degrees to investigate best practices that less proficient HSIs can adopt for program improvement. The Integrated Postsecondary Education Data System (IPEDS) from the National Center for Education…

Introduction: The replication crisis in the behavioral and social sciences spawned a credibility revolution, calling for new open science research practices that ensure greater transparency, including preregistrations, open data and code, and open access. Statement of the Problem: Replications of published research are an important element in this…

Clustered observational studies (COSs) are a critical analytic tool for educational effectiveness research. We present a design framework for the development and critique of COSs. The framework is built on the counterfactual model for causal inference and promotes the concept of designing COSs that emulate the targeted randomized trial that would…

Clustered observational studies (COSs) are a critical analytic tool for educational effectiveness research. We present a design framework for the development and critique of COSs. The framework is built on the counterfactual model for causal inference and promotes the concept of designing COSs that emulate the targeted randomized trial that would…

Scale pretests analyze the suitability of individual scale items for further analysis, whether through judging their face validity, wording concerns, and/or other aspects. The current article reviews scale pretests, separated by qualitative and quantitative methods, in order to identify the differences, similarities, and even existence of the…

Background and context: The variables that researchers measure and how they measure them are central in any area of research, including computing education. Which research questions can be asked and how they are answered depends on measurement. Objective: To summarize the commonly used variables and measurements in computing education and to…

Understanding the unique health needs of college students and establishing best practices to address them depend, heavily, on the inherent quality and contribution of the research identifying these needs. College health-focused publications currently exemplify less than ideal statistical reporting practices. Specifically, college health…

Librarians are committed to supporting teaching, learning, and research. They are equally committed to supporting student success and retention. Demonstrating the impact that learning management system (LMS) embedded librarians make on student learning has been difficult to correlate, however. Studies that assess this connection, using qualitative…

Researchers have become increasingly interested in conducting analyses on meta-analytic correlation matrices. Methodologists have provided guidance and recommended practices for the application of this technique. The purpose of this article is to review current practices regarding analyzing meta-analytic correlation matrices, to identify the gaps…

Asbury and Wai ("Journal of School Choice," 2019) perform a valuable service by summarizing much available behavior--genetic research on academic achievement. However they consider that no specific policies stem from the research body at this time. Here we do propose a policy based on some of our research using twins, namely that…