The purpose of this dissertation is to develop principles and strategies for and identify limitations of multisite cluster randomized trials in the context of partially and fully nested designs. In the first study, I develop principles of estimation, sampling variability, and inference for studies that leverage multisite designs within the context…

As the international large-scale assessments (ILSAs) become more popular, policy makers and education practitioners are interested in collecting as much student background information as possible to better understand the learning context of their students. To collect such abundant information, administrators need to develop a lot of questions.…

Many education researchers have advocated grounding abstract mathematical and scientific concepts in students' lived experiences, environmental interactions, and perceptions. This dissertation explores the causal effects of various grounding strategies in instructional settings, specifically on the topic of statistical sampling. The first chapter…

Multilevel experiments have been widely used in education and social sciences to evaluate causal effects of interventions. Two key considerations in designing experimental studies are statistical power and the minimal use of resources. Optimal design framework simultaneously addresses both considerations. This dissertation extends previous optimal…

In education, sample characteristics can be complex due to the nested structure of students, teachers, classrooms, schools, and districts. In the past, not many considerations were given to such complex sampling schemes in statistical power analysis. More recently in the past two decades, however, education scholars have developed tools to conduct…

Recommended learning goals for students in introductory statistics courses include the ability to recognize and explain the key role of randomness in designing studies and in drawing conclusions from those studies involving generalizations to a population or causal claims (GAISE College Report ASA Revision Committee, 2016). The purpose of this…

The Personalized Integrated Educational System (PIES) design theory is a design recommendation regarding the function and features of Learning Managements Systems (LMS) that can support the information-age learner-centered paradigm of education. The purpose of this study was to improve the proposed functions and features of the PIES design theory…

Often researchers face situations where comparative studies between two or more programs are necessary to make causal inferences for informed policy decision-making. Experimental designs employing randomization provide the strongest evidence for causal inferences. However, many pragmatic and ethical challenges may preclude the use of randomized…

Findings from empirical research suggest that both self-efficacy beliefs and collaborative learning may have an influence upon student academic performance. However, the phenomena of self-efficacy beliefs, collaborative learning, and academic achievement have not been studied in concert with one another. Using quantitative research methods, I…

Using the framework of boundary theory as applied to the work-life-school construct, the study focused on part-time MBA students who worked full-time, their tendency to segment or integrate their numerous roles, and the coping tactics they utilized in redistributing their efforts as they added graduate school to these roles. The research…

Students choose to attend liberal arts institutions for a number of different reasons, including small class size, breadth of academic material, and emphasis on life-long learning (Astin, 1999; Pascarella, Cruce, Wolniak, & Blaich, 2004). Those attending small liberal arts colleges have come to expect that they will have a higher level of…