This dissertation provides a start-to-finish description of development, administration, and validation for an online middle-school physics test using a DCM framework with response-time. The first paper illustrated the process of implementing DCM with a careful selection of the content domain and a simulation approach for a Q-matrix construction.…

The study established the validity and reliability of a weighted individual performance-based assessment tool within the utility scope of middle school orchestral strings. The following research questions guided this study: 1. What specific string-playing behaviors and corresponding criteria validate a weighted individual performance-based…

The extent to which an intervention is perceived as socially valid significantly influences whether the intervention is selected, implemented, and maintained (Kern & Manz, 2004). Social skill interventions and evidence-based practices are often ranked with low social validity by adolescents (McCoy et al., 2016). Interventions delivered through…

Prosocial behaviors (e.g., sharing, helping) are important for adolescents' academic and social-emotional wellbeing and can be predicted by students' adoption of prosocial goals. Due to the recent uptick in experiences with learning online for adolescents, understanding what prosocial behaviors look like for students within this context, as well…

Mathematical justifications offer an approach to which students deepen and extend their mathematical thinking. This process has the potential to enhance students' conceptual understanding. Mathematical practices and process standards ask students to use critical thinking skills to justify their reasoning, but this is usually seen as proofs in high…

School climate is increasingly recognized by scholars and policymakers as a crucial factor associated with students' educational experiences. Hence, practitioners endeavor to equitably measure and improve school climate to promote favorable student academic and behavior outcomes. Unfortunately, school climate research is fragmented, and a…

The purpose of this dissertation was to validate scores for a new survey tool, The Virtual Learning Assessment. This 53-item measure was designed with the intent that if scores are validated it could provide a means in which student-teacher relationships and the attributes that enhance those relationships in a remote setting could be assessed. To…

In response to concerns about using only standardized multiple-choice assessments, some school districts have moved to using alternative ratings of student achievement with authentic assessments. However, such assessments are often limited in terms of the psychometric validity data supporting their use. The present study mixed quantitative and…

Data literacy is crucial for adolescents to access and navigate data in today's technology-driven world. Researchers emphasize the need for K-12 students to attain data literacy. However, few available instructions have incorporated validated assessments. Therefore, I developed and implemented the Data literacy Assessment for Middle graders…

Operationalism, representationalism, and pragmatism are three major philosophies of measurement in psychology and education. These philosophies play important roles in designing and conducting measurements, as well as interpreting results. When measurement results are available, validity evidence plays important roles in supporting the…

The purpose of this study is to develop and validate instrument-specific rating scales to evaluate the classroom performances of middle and high school students. The study is guided by the following research questions: 1. What does Rasch measurement analysis reveal about the psychometric properties (i.e., validity and reliability) of items,…

Teacher evaluation systems are designed to provide teachers with feedback to improve their practice. The feedback, however, is oftentimes not delivered in a way that considers the underlying cognitive processes that teachers experience when presented with performance feedback (Jordan & Audia, 2012). According to performance feedback theory,…

Adolescent mental health is a growing concern in the United States. Children who experience mental health issues struggle in the school environment if their needs are not met. Teachers play a critical role in the classroom when identifying students who struggle with mental health issues. The purposes of this convergent, parallel mixed-methods…

The aim of this research is to develop a measurement instrument that is valid and reliable, called the Middle School-Life Science Concept Inventory (MS-LSCI), for the purpose of measuring the life science conceptual understanding of middle school-level students. Although there are several existing concept inventories related to biology concepts…

In 2012, New Jersey implemented a broad change to the teacher evaluation system with the Teacher Effectiveness and Accountability for the Children of New Jersey (TEACHNJ) Act which identified the Marzano Causal Teacher evaluation system as one of the prescribe models for districts to adopt. This system provides a more differentiated teacher…