Limited research has investigated dissertation methodology choice and the factors that contribute to this choice. Quantitative research is based in mathematics and scientific positivism, and qualitative research is based in constructivism. These underlying philosophical differences posit the question if certain factors predict dissertation…

This paper presents a non-parametric imputation technique, named random forest, from the machine learning field. The random forest procedure has two main tuning parameters: the number of trees grown in the prediction and the number of predictors used. Fifty experimental conditions were created in the imputation procedure, with different…

For at least the last century researchers have advocated the use of student confidence as a form of educational assessment and the growth of online and mobile educational software has made the implementation of this measurement far easier. The following short paper discusses our first study of the dynamics of student confidence in an online math…

The nation's generation of "Baby Boomers" is now the grandparents of a new generation of students known as "Gen Y" and "Gen Z," respectively. "Gen X," parents of our current students, have the enormous task of raising their children as "digital natives" in a technological-savvy world. The idea of…

This paper discusses how a seldom-used statistical procedure, recursive regression (RR), can numerically and graphically illustrate data-driven nonlinear relationships and interaction of variables. This routine falls into the family of exploratory techniques, yet a few interesting features make it a valuable compliment to factor analysis and…

Contrary to popular opinion, significance testing does not inform the researcher of the likelihood of the replication of results from current research findings. Result replicability has been ignored by researchers because of an overreliance on significance testing. Several alternatives have been offered to provide the researcher with more…

The use of Procrustean rotation as a procedure for assessing the invariance of study results is proposed. Researchers have long relied on significance testing as a measure of judging the worthiness of empirical findings. However, significance testing has come under fire because it does not provide information about the importance or replicability…

A critical reanalysis of Barrett, Caldwell, and Alexander's (1985) critique of dynamic criteria. Summarizes and questions Barrett, et al.'s three definitions of dynamic criteria and their conclusion that reported temporal changes in criteria could be explained by methodological artifacts. A greater focus on dynamic criteria as constructs is…

Responds to Austin, Humphreys, and Hulin's (1989) critique of Barrett, Caldwell, and Alexander, suggesting that the burden of proof still rests on the advocates of the concept of dynamic criteria, and that empirical support is lacking for the existence of dynamic criteria as a simplex. Contrary evidence from educational, organizations, and…

A growing controversy surrounds the strict interpretation of statistical significance tests in social research. Statistical significance tests fail in particular to provide estimates for the stability of research results. Methods that do provide such estimates are known as invariance or cross-validation procedures. Invariance analysis is largely…

Problems with using stepwise analytic methods are discussed, and better alternatives are illustrated. To make the illustrations concrete, an actual data set, involving responses of 91 medical school admissions directors to 30 variables, was used. The 30 variables involved perceptions of barriers to medical school with respect to characteristics of…

Academic selectivity plays a dominant role in the public's understanding of what constitutes institutional excellence or quality in undergraduate education. In this study, we analyzed two independent data sets to estimate the net effect of three measures of college selectivity on dimensions of documented good practices in undergraduate education.…

Among the many problems faced by family researchers in conducting experimental research in field settings is that posed by nonequivalent and intact treatment and control groups. Nonequivalence refers to the assignment of individuals to treatments on a nonrandom basis, thus generating treatment groups with different expected values on one or more…

Magnitude of effect measures (MEMs), when adequately understood and correctly used, are important aids for researchers who do not want to rely solely on tests of statistical significance in substantive result interpretation. The MEM tells how much of the dependent variable can be controlled, predicted, or explained by the independent variables.…