In this article, we interrogate the concept of methodological 'failures' as they arise during fieldwork, in the process of collecting empirical data. We highlight how the techniques of validity horizon matrices and power analysis can be used as methodological tools to illustrate moments in the fieldwork process where these 'failures' occur and to…

In this article, I provide answers to the questions posed by Will Shadish about the history and development of the Schmidt-Hunter methods of meta-analysis. In the 1970s, I headed a research program on personnel selection at the US Office of Personnel Management (OPM). After our research showed that validity studies have low statistical power, OPM…

Background and context: The variables that researchers measure and how they measure them are central in any area of research, including computing education. Which research questions can be asked and how they are answered depends on measurement. Objective: To summarize the commonly used variables and measurements in computing education and to…

Critically examining common statistical approaches and their strengths and weaknesses is an important step in advancing recreation and leisure sciences. To continue this critical examination and to inform methodological decision making, this study compared three approaches to determine how alternative approaches may result in contradictory…

The primary purpose of this book is to offer a broad-based examination into the role of scientific inquiry in contemporary special education. As with the first two editions, which were published in 2001 and 2011, the goal is to provide a comprehensive overview of the philosophical, ethical, methodological, and analytical fundamentals of social…

The Research Methods Skills Assessment (RMSA) was created to measure psychology majors' statistics knowledge and skills. The American Psychological Association's Guidelines for the Undergraduate Major in Psychology (APA, 2007, 2013) served as a framework for development. Results from a Rasch analysis with data from n = 330 undergraduates showed…

Early childhood education and care (ECEC) remains a priority area for public policy, internationally and in Australia. However, an analysis of empirical research published internationally up to 2008 has identified a bias toward positivist methodologies within a "scientific/psychological' rather than educational perspective and with a focus on…

Proactive preliminary minimum sample size determination can be useful for the early planning stages of a latent variable modeling study to set a realistic scope, long before the model and population are finalized. This study examined existing methods and proposed a new method for proactive preliminary minimum sample size determination.

In empirical applied linguistics research it is essential that the key variables are operationalized in a valid and reliable way, and that the scores are treated appropriately, allowing for a proper testing of the hypotheses under investigation. The current article addresses several theoretical and practical issues regarding the use of measurement…

Structural equation modeling (SEM) is one of the most popular multivariate statistical techniques in Turkish educational research. This study elaborates the SEM procedures employed by 75 educational research articles which were published from 2010 to 2015 in Turkey. After documenting and coding 75 academic papers, categorical frequencies and…

This case study uses structural equation modeling to examine the predictive validity of the Read Aloud Profile-Together, a measure of the distinct behaviors of parents and children during shared book reading, in relation to preschool children's early reading competency. Using secondary data analysis, this case study includes 800 parent-child pairs…

Despite increases in the number of articles published in higher education journals using structural equation modelling (SEM), research addressing their statistical sufficiency, methodological appropriateness and quantitative rigour is sparse. In response, this article provides a census of all covariance-based SEM articles published up until 2013…

As the US continues to diversify, methods for accurately assessing human behavior must evolve. This paper offers multicultural research considerations at several stages of the research process for psychological research and consultation. Implications regarding the comparative research framework are discussed and suggestions are offered on how to…

The criterion-related validity of divergent thinking (DT) tests has been questioned because of relatively low correlations between DT test scores and creative performance. A possible inhibiting factor in previous correlations--heterogeneity of the sample--has been ignored. If groups with different DT profiles are involved in this line of research,…

The main aim of this study is to determine whether a significant difference exits among data collection with printed materials and with smart phones. The research was conducted with 282 teacher candidates who take pedagogical formation training. Three data collection tools were used throughout the study. As the results of the current research, no…