This article introduces the concept of the carrying capacity of data (CCD), defined as an integrated, evaluative judgment of the credibility of specific data-based inferences, informed by quantitative and qualitative analyses, leavened by experience. The sequential process of evaluating the CCD is represented schematically by a framework that can…

How researchers use statistical analyses shapes their research toward or away from an anti-racist agenda. In this article, we demonstrate how developmental scientists can use the QuantCrit framework to critically examine the process of conducting quantitative analyses. In particular, we focus on mixture modeling to clearly demonstrate how the…

Several programs of research have sought to assess the replicability of scientific findings in different fields, including economics and psychology. These programs attempt to replicate several findings and use the results to say something about large-scale patterns of replicability in a field. However, little work has been done to understand the…

The authors of the focus article describe an important issue related to the use and interpretation of causal indicators within the context of structural equation modeling (SEM). In the focus article, the authors illustrate with simulated data the effects of omitting a causal indicator. Since SEMs are used extensively in the social and behavioral…

Building on the work of Bollen (2007) and Bollen & Bauldry (2011), Bainter and Bollen (this issue) clarifies several points of confusion in the literature regarding causal indicator models. This author would certainly agree that the effect indicator (reflective) measurement model is inappropriate for some indicators (such as the social…

Purpose: The purpose of this paper is to examine current approaches to interpretation of student evaluation data and present an innovative approach to developing benchmark targets for the effective and efficient use of these data. Design/Methodology/Approach: This article discusses traditional approaches to gathering and using student feedback…

Data are becoming increasingly important in science and society, and thus data literacy is a vital asset to students as they prepare for careers in and outside science, technology, engineering, and mathematics and go on to lead productive lives. In this paper, we discuss why the strongest learning experiences surrounding data literacy may arise…

Overlap-based measures are increasingly applied in the synthesis of single-subject research. This article considers two criticisms of overlap-based metrics, specifically that they do not measure magnitude of effect and do not adequately correspond with visual analysis. It is argued that these criticisms are based on fundamental misconceptions…

In several subdomains of the social, behavioral, health, and human sciences, research questions are increasingly answered through mixed methods studies, combining qualitative and quantitative evidence and research elements. Accordingly, the importance of including those primary mixed methods research articles in systematic reviews grows. It is…

The growth in the availability of longitudinal data--data collected over time on the same individuals--as part of program evaluations has opened up exciting possibilities for evaluators to ask more nuanced questions about how individuals' outcomes change over time. However, in order to leverage longitudinal data to glean these important insights,…

The Journal of Agricultural Education (JAE) requires authors to follow the guidelines stated in the Publication Manual of the American Psychological Association [APA] (2009) in preparing research manuscripts, and to utilize accepted research and statistical methods in conducting quantitative research studies. The APA recommends the reporting of…

Null hypothesis significance testing has dominated quantitative research in education and psychology. However, the statistical significance of a test as indicated by a p-value does not speak to the practical significance of the study. Thus, reporting effect size to supplement p-value is highly recommended by scholars, journal editors, and academic…

A high school principal and faculty celebrated after hearing that their students in each of the quartiles had improved in both reading and mathematics on the state accountability assessment. Because of the percent of increases in achievement levels on the test, the Florida Department of Education awarded the school an A for 2011. Shortly…

On the basis of taxometric analyses of data sets that they created to pose interpretive challenges, S. R. H. Beach, N. Amir, and J. J. Bau (2005) cautioned that using comparison data simulated by J. Ruscio's programs can lead to inaccurate conclusions. Careful examination of S. R. H. Beach et al.'s methods and results plus reanalysis of their data…

Using student achievement data from British Columbia, Canada, this study is an exploration of the differences that lie within the private school sector using hierarchical linear modeling to analyze the data. The analysis showed that when controlling for language, parents' level of educational attainment, and prior achievement, the private school…