A procedure for evaluating the average R-squared index for a given set of observed variables in an exploratory factor analysis model is discussed. The method can be used as an effective aid in the process of model choice with respect to the number of factors underlying the interrelationships among studied measures. The approach is developed within…

Although agent-based models (ABMs) have been increasingly accepted in social sciences as a valid tool to formalize theory, propose mechanisms able to recreate regularities, and guide empirical research, we are not aware of any research using ABMs to assess the robustness of our statistical methods. We argue that ABMs can be extremely helpful to…

Traditional statistical model evaluation typically relies on goodness-of-fit testing and quantifying model complexity by counting parameters. Both of these practices may result in overfitting and have thereby contributed to the generalizability crisis. The information-theoretic principle of minimum description length addresses both of these…

Prospective registration of study protocols in clinical trial registries is a useful way to minimize the risk of publication bias in meta-analysis, and several clinical trial registries are available nowadays. However, they are mainly used as a tool for searching studies and information submitted to the registries has not been utilized as…

Background: Allen, Fielding, East, et al. demonstrated experimentally that structural awareness, or the ability to disregard a research problem's topic and instead focus on its structural features, can be trained using StatHand (https://stathand.net). Most training benefits persisted for 1 week. Objective: The objective was to assess the…

In this paper is proposed a straightforward model selection approach that indicates the most suitable count regression model based on relevant data characteristics. The proposed selection approach includes four of the most popular count regression models (i.e. Poisson, negative binomial, and respective zero-inflated frameworks). Moreover, it…

Researchers face many choices when conducting large-scale multisite individually randomized control trials. One of the most common quantities of interest in multisite RCTs is the overall average effect. Even this quantity is non-trivial to define and estimate. The researcher can target the average effect across individuals or sites. Furthermore,…

Conventional approaches for selecting a reference indicator (RI) could lead to misleading results in testing for measurement invariance (MI). Several newer quantitative methods have been available for more rigorous RI selection. However, it is still unknown how well these methods perform in terms of correctly identifying a truly invariant item to…

Log-linear models for contingency tables are a key tool for the study of categorical inequalities in sociology. However, the conventional approach to model selection and specification suffers from at least two limitations: reliance on oftentimes equivocal diagnostics yielded by fit statistics, and the inability to identify patterns of association…

Practice tests provide large mnemonic benefits over restudying, but learners judge practice tests as less effective than restudying. Consequently, learners infrequently utilize testing when controlling their study and often choose to be tested only on well-learned items. In 5 experiments, we examined whether learners' choices about testing and…

In the United States with the Next Generation Science Standards (NGSS)'s emphasis on learning science while doing science, laboratory activities in the secondary school chemistry continues to be an important component of a strong curriculum. Laboratory equipment and consumable materials create a unique expense which chemistry teachers and schools…

Utilizing Critical Race Theory (CRT) as a conceptual framework, this study examines student perception of faculty of color in academia from student professor preference. Using an experimental design to test the effect of race on selection of faculty with whom to take a course, we showed student participants two types of pairings of faculty: first,…

Situation selection--choosing to enter or avoid situations based on how they will likely make you feel--is theorized to be a useful emotion regulation strategy, especially in older age. However, research on the use of situation selection for emotion regulation is limited, and the existing findings about age differences are mixed, with some studies…

Selection bias is a persistent, and often hidden, problem in educational research. It is the primary obstacle standing in between increasingly available large education datasets and the ability to make valid causal inferences to inform policymaking, research, and practice (Stuart, 2010). This article provides an accessible discussion on the…

Postgraduate scholarship programmes are increasingly important for supporting gifted students from diverse backgrounds. Systems and processes in the application, determination and delivery of scholarships must be robust, transparent, accountable and equitable. However, they are rarely evaluated. One of the most prestigious scholarships in New…