Educators commonly use school climate survey scores to inform and evaluate interventions for equitably improving learning and reducing educational disparities. Unfortunately, validity evidence to support these (and other) score uses often falls short. In response, Whitehouse et al. proposed a collaborative, two-part validity testing framework for…

Item response theory (IRT) models are the main psychometric approach for the development, evaluation, and refinement of multi-item instruments and scaling of latent traits, whereas multilevel models are the primary statistical method when considering the dependence between person responses when primary units (e.g., students) are nested within…

Questions regarding the generalizability of results from educational experiments have been at the forefront of methods development over the past five years. This work has focused on methods for estimating the effect of an intervention in a well-defined inference population (e.g., Tipton, 2013; O'Muircheartaigh and Hedges, 2014); methods for…

Little is known empirically about intraclass correlations (ICCs) for multisite cluster randomized trial (MSCRT) designs, particularly in science education. In this study, ICCs suitable for science achievement studies using a three-level (students in schools in districts) MSCRT design that block on district are estimated and examined. Estimates of…

This exploratory study investigated potential sources of setting accommodation resulting in differential item functioning (DIF) on math and reading assessments for examinees with varied learning characteristics. The examinees were those who participated in large-scale assessments and were tested in either standardized or accommodated testing…

This study uses ecological momentary assessment (EMA) to simultaneously capture youths' perceptions of peer affiliates and social contexts to determine their association with youths' current and future mood states. A sample of 82 seventh grade students (36 at risk for developing or escalating rule breaking and substance use and 46 randomly…

Present national methodological standards for evaluating the credibility of the design of individual research studies have resulted in findings reporting the pre-­post effectiveness of Direct Instruction programs to be eliminated from consideration by educational leaders involved in making curricular decisions intended to advance local school…

The purpose of this study was to investigate the relationship between student mathematics performance of 4th, 8th, and 11th grade students in Nebraska and the mode of test administration, online and paper-pencil. Schools were allowed to select the mode of test administration for their school with some exceptions for students needing…

While outstanding teachers are any school system's most important investment, assessing the quality of instructional practice has proven to be an ongoing challenge for the profession. Despite assertions that effective teachers are the single most important school-related factor responsible for increased learning, no teacher's employment is…

This study examined the multilevel factors that influence mathematics and English performance on the Primary Leaving Examinations (PLEs) among primary seven pupils (i.e., equivalent to the United States [U.S.] 7th graders) in Uganda. Existing student state test data from the Wakiso District were obtained. In addition, a newly created Teacher…

The criteria for determining the student outcomes that define a school as having "turned around" are not well defined, and the definition of turnaround performance varies across studies. Although current policy initiatives offer guidelines for identifying CLP schools, there is no standard definition or methodology in common usage. This…

Alternatives to vertical scales are compared for measuring longitudinal academic growth and for producing school-level growth measures. The alternatives examined were empirical cross-grade regression, ordinary least squares and logistic regression, and multilevel models. The student data used for the comparisons were Arabic Grades 4 to 10 in…