The Cross-Classified Mixed Effects Model (CCMEM) has been demonstrated to be a flexible framework for evaluating reliability by measurement specialists. Reliability can be estimated based on the variance components of the test scores. Built upon their accomplishment, this study extends the CCMEM to be used for evaluating validity evidence.…

Considering the importance of mathematics in modern society, it is crucial to understand the cognitive processes involved in the acquisition of complex mathematical competency. As a new generation of evaluation theory, cognitive diagnosis has its unique advantages in personalized evaluation. Based on the mathematical cognitive framework of Trends…

The present study compares two methods for assessing peer influence: the longitudinal actor-partner interdependence model (L-APIM) and the longitudinal social network analysis (L-SNA) Model. The data were drawn from 1,995 (49% girls and 51% boys) third grade students (M[subscript age] = 9.68 years). From this sample, L-APIM (n = 206…

Methods to handle ordered-categorical indicators in latent variable interactions have been developed, yet they have not been widely applied. This article compares the performance of two popular latent variable interaction modeling approaches in handling ordered-categorical indicators: unconstrained product indicator (UPI) and latent moderated…

This article presents a new perspective on measuring gender differences in the large-scale assessment study Trends in International Science Study (TIMSS). The suggested empirical model is directly based on the theoretical competence model of the domain mathematics and thus includes the interaction between content and cognitive sub-competencies.…

We present a logistic function of a monotonic polynomial with a lower asymptote, allowing additional flexibility beyond the three-parameter logistic model. We develop a maximum marginal likelihood based approach to estimate the item parameters. The new item response model is demonstrated on math assessment data from a state, and a computationally…

The present study aimed to represent the innovative assessments that support students' learning in STEM education through using the integrative framework for Cognitive Diagnostic Modeling (CDM). This framework is based on three components, cognition, observation, and interpretation (National Research Council, 2001). Specifically, this dissertation…

The authors develop model analyses based on a U.S. Department of Education guide to illustrate procedures a State could use to compare and contrast school-level overall and English Learner accountability determinations for proficiency in reading/language arts under the options allowed by the Every Student Succeeds Act. As a technical reference,…

Houston's experience with the Educational Value-Added Assessment System (R) (EVAAS) raises questions that other districts should consider before buying the software and using it for high-stakes decisions. Researchers found that teachers in Houston, all of whom were under the EVAAS gun, but who taught relatively more racial minority students,…

How should a wide variety of educational activities be sequenced to maximize student learning? Although some experimental studies have addressed this question, educational data mining methods may be able to evaluate a wider range of possibilities and better handle many simultaneous sequencing constraints. We introduce Sequencing Constraint…

This applied dissertation was designed to provide perceptual teacher data as well as summative testing data to educational leaders concerning the effects of implementing Investigations in Number, Data, and Space® (Investigations) in three Title I elementary school settings, two Title I schools, and one non-Title I school. Data collected during…

This study traces the development of a vocabulary measure designed to assess multiple types of word knowledge. The assessment, which was administered in conjunction with a science unit about weather and the water cycle for third-and-fourth graders, included items for six knowledge types--recognition, definition, classification/example, context,…

There is considerable interest in applying Response to Intervention (RtI) as a schoolwide methodology for instruction, assessment, and intervention for students who, early in their academic careers, are struggling academically. Supporters contend that the tiered service delivery model holds great promise for many students who otherwise would fall…

Anxiety disorders are prevalent in the school-aged population and are present across cultural groups. Scant research exists on culturally relevant prevention and intervention programs for mental health problems in the Aboriginal populations. An established cognitive behavioral program, FRIENDS for Life, was enriched to include content that was…

The purpose of this study was to investigate the relationship between student mathematics performance of 4th, 8th, and 11th grade students in Nebraska and the mode of test administration, online and paper-pencil. Schools were allowed to select the mode of test administration for their school with some exceptions for students needing…