In many psychological and educational applications, it is imperative to obtain valid and reliable score estimates of multilevel processes. For example, in order to assess the quality and characteristics of high impact learning processes, one must compute accurate scores representative of student- and classroom-level constructs. Currently, there…

Young children are assessed to meet federal mandates and inform policy decisions, provide teachers with useful information to make instructional decisions and set reasonable learning goals, and facilitate communication with families. While young children are frequently assessed using whole-child assessments which often yield criterion-referenced…

High stakes test-based accountability systems primarily rely on aggregates and derivatives of scores from tests that were originally developed to measure individual student mastery of content specifications. Current validity models do not explicitly address this use of aggregate scores to measure the performance of teachers, administrators, and…

In randomized control trials (RCT), the recent focus has shifted to how an intervention yields positive results on its intended outcome. This aligns with the recent push of implementation science in healthcare (Bauer et al., 2015) but goes beyond this. RCTs have moved to evaluating the theoretical framing of the intervention as well as differing…

This study used a propensity score approach to estimate treatment effects in a multilevel setting. The propensity score approach involves the estimation of propensity scores for covariate balancing and the estimation of treatment effects. This study aimed at understanding how propensity scores estimated through a simple logistic regression compare…

Accurate placement into an initial college mathematics course is a key step toward the successful completion of college mathematics and, eventually, a college degree. Conversely, misplacement in mathematics may lead to a reduced likelihood of course completion and degree attainment. This study investigated the ability of two placement models to…

This study examined the development of noncognitive skills in a sample of 4,769 Hispanic/Latino students as they went through middle school and the first year of high school using ACT Engage 6-9, an assessment designed to predict student outcomes by measuring students' behaviors and psychosocial attributes. The scales of Academic Discipline,…

Despite almost a century of research, there is little consensus among researchers and educators about the role of oral reading accuracy in beginning reading progress of struggling readers. Should, for example, students be given easy books to read with high levels of accuracy to promote early reading development or does reading hard texts with…

This dissertation is comprised of three papers that propose and apply psychometric models to deal with complexities and challenges in large-scale assessments, focusing on modeling rater effects and complex learning progressions. In particular, three papers investigate extensions and applications of multilevel and multidimensional item response…

Propensity score analysis has been used to minimize the selection bias in observational studies to identify causal relationships. A propensity score is an estimate of an individual's probability of being placed in a treatment group given a set of covariates. Propensity score analysis aims to use the estimate to create balanced groups, akin to a…

When studying differential item functioning (DIF) with students with disabilities (SWD) focal groups typically suffer from small sample size, whereas the reference group population is usually large. This makes it possible for a researcher to select a sample from the reference population to be similar to the focal group on the ability scale. Doing…

Systematic studies on effectiveness of in-service teacher professional development (PD) are important for science education research and practice. Previous studies mostly focus on one certain aspect of the entire program, for example, effectiveness of PD on improvement of teachers' knowledge or students' learning outcomes. This study, however,…

Purpose: The purpose of this study was to evaluate the efficacy of the EMBRACE Spanish support intervention for at-risk dual language learners and to determine which verbal and nonverbal characteristics of students were related to benefit from the intervention. The first study examined oral language and reading characteristics and the second study…

Teacher professional development has long been of interest since it may affect teachers' learning, the practice of teaching, and student learning. Although empirical research has mainly explored the effect of specific professional development interventions on student achievement, these inventions have been initiated outside the school, and little…

This study examines student growth on mathematics and reading assessments across academic years (Spring 2006 through Spring 2009) using three different growth models: hierarchical linear model (HLM), value-added model (VAM), and student growth percentile model (SGP). Comparisons across these three growth models were conducted to investigate the…