The Cross-Classified Mixed Effects Model (CCMEM) has been demonstrated to be a flexible framework for evaluating reliability by measurement specialists. Reliability can be estimated based on the variance components of the test scores. Built upon their accomplishment, this study extends the CCMEM to be used for evaluating validity evidence.…

Methods to handle ordered-categorical indicators in latent variable interactions have been developed, yet they have not been widely applied. This article compares the performance of two popular latent variable interaction modeling approaches in handling ordered-categorical indicators: unconstrained product indicator (UPI) and latent moderated…

Considering the importance of mathematics in modern society, it is crucial to understand the cognitive processes involved in the acquisition of complex mathematical competency. As a new generation of evaluation theory, cognitive diagnosis has its unique advantages in personalized evaluation. Based on the mathematical cognitive framework of Trends…

The present study compares two methods for assessing peer influence: the longitudinal actor-partner interdependence model (L-APIM) and the longitudinal social network analysis (L-SNA) Model. The data were drawn from 1,995 (49% girls and 51% boys) third grade students (M[subscript age] = 9.68 years). From this sample, L-APIM (n = 206…

This study introduces the signal weighted teacher value-added model (SW VAM), a value-added model that weights student-level observations based on each student's capacity to signal their assigned teacher's quality. Specifically, the model leverages the repeated appearance of a given student to estimate student reliability and sensitivity…

We present a logistic function of a monotonic polynomial with a lower asymptote, allowing additional flexibility beyond the three-parameter logistic model. We develop a maximum marginal likelihood based approach to estimate the item parameters. The new item response model is demonstrated on math assessment data from a state, and a computationally…

Students with significant cognitive disabilities present an assessment dilemma that centers on access and validity in large-scale testing programs. Typically, access is improved by eliminating construct-irrelevant barriers, while validity is improved, in part, through test standardization. In this article, one state's alternate assessment data…

This applied dissertation was designed to provide perceptual teacher data as well as summative testing data to educational leaders concerning the effects of implementing Investigations in Number, Data, and Space® (Investigations) in three Title I elementary school settings, two Title I schools, and one non-Title I school. Data collected during…

This study traces the development of a vocabulary measure designed to assess multiple types of word knowledge. The assessment, which was administered in conjunction with a science unit about weather and the water cycle for third-and-fourth graders, included items for six knowledge types--recognition, definition, classification/example, context,…

There is considerable interest in applying Response to Intervention (RtI) as a schoolwide methodology for instruction, assessment, and intervention for students who, early in their academic careers, are struggling academically. Supporters contend that the tiered service delivery model holds great promise for many students who otherwise would fall…

In accordance with the federal No Child Left Behind (NCLB) law of 2001, 100% of students were expected to become proficient on state assessments of reading and mathematics by the end of 2013-2014 academic year. Schools that consistently failed to meet the NCLB's Adequate Yearly Progress requirements were subject to penalties. In 2011, the U.S.…

The practical need for multidimensional measures of fidelity of implementation (FOI) of reform-based science, technology, engineering, and mathematics (STEM) instructional materials, combined with a theoretical need in the field for a shared conceptual framework that could support accumulating knowledge on specific enacted program elements across…

Some form of a short interrupted time series (ITS) is often used to evaluate state and national programs. An ITS design with a single treatment group assumes that the pretest functional form can be validly estimated and extrapolated into the postintervention period where it provides a valid counterfactual. This assumption is problematic. Ambiguous…

Anxiety disorders are prevalent in the school-aged population and are present across cultural groups. Scant research exists on culturally relevant prevention and intervention programs for mental health problems in the Aboriginal populations. An established cognitive behavioral program, FRIENDS for Life, was enriched to include content that was…

The purpose of this study was to investigate the relationship between student mathematics performance of 4th, 8th, and 11th grade students in Nebraska and the mode of test administration, online and paper-pencil. Schools were allowed to select the mode of test administration for their school with some exceptions for students needing…