The Cross-Classified Mixed Effects Model (CCMEM) has been demonstrated to be a flexible framework for evaluating reliability by measurement specialists. Reliability can be estimated based on the variance components of the test scores. Built upon their accomplishment, this study extends the CCMEM to be used for evaluating validity evidence.…

Student growth percentiles (SGPs) are currently used by several states and school districts to provide information about individual students as well as to evaluate teachers, schools, and school districts. For SGPs to be defensible for these purposes, they should be reliable. In this study, we examine the amount of systematic and random error in…

This study introduces the signal weighted teacher value-added model (SW VAM), a value-added model that weights student-level observations based on each student's capacity to signal their assigned teacher's quality. Specifically, the model leverages the repeated appearance of a given student to estimate student reliability and sensitivity…

The development of scientific thinking was assessed in 1,581 second, third, and fourth graders (8-, 9-, 10-year-olds) based on a conceptual model that posits developmental progression from naïve to more advanced conceptions. Using a 66-item scale, five components of scientific thinking were addressed, including experimental design, data…

Children's peer relationships are frequently assessed with peer nominations. An important methodological issue is whether to collect unlimited or limited nominations. Some researchers have argued that the psychometric differences between both methods are negligible, while others have claimed that one is superior over the other. The current study…

According to the Simple View of Reading, reading ability can be divided into decoding and language comprehension. In the present study, decoding and comprehension's contribution to reading ability was studied both in children with reading difficulties and in children with typical reading ability. Decoding and comprehension was further divided into…

This study used a Chinese-language version of the Index of Science Reading Awareness to explore the science reading metacognition and comprehension of Taiwanese students. Structural equation modelling results confirmed the underlying model comprised three clusters of metacognitive knowledge: beliefs and confidence in science reading, knowledge of…

Two Monte Carlo simulations were performed to compare methods for estimating and testing hypotheses of quadratic effects in latent variable regression models. The methods considered in the current study were (a) a 2-stage moderated regression approach using latent variable scores, (b) an unconstrained product indicator approach, (c) a latent…

Traditional medical model service delivery systems have facilitated the creation of nationwide mental health and education pandemics for children and youth. The characteristics and shortcomings of medical model approaches leading to these problems are explicated, including the focus of services on individuals rather than populations, relying…

The purpose of the authors in this study was to develop an instrument to assess fourth and fifth grade students' attitudes toward physical education. The methods for validation included (a) an elicitation study and instrument question development, (b) a pilot study, and (c) a series of analyses to assess, construct, and content validity and to…

This paper investigates whether inferences about school performance based on longitudinal models are consistent when different assessments and metrics are used as the basis for analysis. Using norm-referenced (NRT) and standards-based (SBT) assessment results from panel data of a large heterogeneous school district, we examine inferences based on…

Interest in Student Growth Modeling (SGM) and Value Added Modeling (VAM) arises from educators concerned with measuring the effectiveness of teaching and other school activities through changes in student performance as a companion and perhaps even an alternative to status. Several formal statistical models have been proposed for year-to-year…

This study examined the relationship of two climate constructs in academic optimism and organizational climate as each relates to school effectiveness. Academic optimism is an academic environment comprised of three dimensions: academic emphasis, collective efficacy, and faculty trust (Hoy, Tarter, & Hoy, 2006). The Organizational Climate…

Teacher effectiveness and evaluation using student growth measures is a popular reform strategy in education. Teachers can make a difference in student academic growth, but a question that begs an answer is how to go about measuring this impact. This study examines models of teacher effectiveness and the development of hierarchical linear models…

This study investigated the convergent and discriminant validity of the high-stakes Florida Comprehensive Assessment Test (FCAT) in both reading and writing at grade levels 4, 8, and 10. The data from the 2006 FCAT administration were analyzed via traditional multitrait-multimethod (MTMM) analysis to identify the factor structure and structural…