This dissertation focuses on three manuscripts all related to bolstering science achievement through recommendations from the National Research Council (NRC) regarding the teaching and learning of science. The manuscripts address meeting the NRC's call to incorporate curriculum and assessment that lead to more in-depth knowledge that can be…

In educational measurement, Item Response Theory (IRT) provides a means of quantifying student knowledge. Specifically, IRT models the probability of a student answering a particular item correctly as a function of the student's continuous-valued latent abilities [theta] (e.g. add, subtract, multiply, divide) and parameters associated with the…

Over past decade, districts throughout the United States have reformed their teacher evaluation systems in order to support teachers to improve teacher practices and to improve the composition of teachers in the workforce. Despite the widespread reform of evaluation systems, little research has examined the impacts these systems have on teacher…

Automated assessment using Natural Language Processing (NLP) has the potential to make English speaking assessments more reliable, authentic, and accessible. Yet without careful examination, NLP may exacerbate social prejudices based on gender or native language (L1). Current NLP-based assessments are prone to such biases, yet research and…

A major problem faced by instructors post-implementation of unsupervised online assessments is that they may lack real-time access to the students' actual learning behaviors. Limitations in student-feedback, limited know-how of accessing and analyzing log data, and large class sizes could restrict instructors' access to learners' behaviors. This…

This work presents a study that used distributed language representations of test items to model test item difficulty. Distributed language representations are low-dimensional numeric representations of written language inspired and generated by artificial neural network architecture. The research begins with a discussion of the importance of item…

Pragmatic competence has been increasingly recognized as a component of academic language proficiency assessment (Youn, 2018). However, the practicality of administering L2 pragmatic competence assessments involving interlocutors remains problematic (e.g., high labor cost) (Ikeda, 2017). The pandemic makes it even more difficult to administer…

The digital transformation in educational assessment has led to the proliferation of large-scale data, offering unprecedented opportunities to enhance language learning, and testing through machine learning (ML) techniques. Drawing on the extensive data generated by online English language assessments, this dissertation investigates the efficacy…

Aim: This study aimed to describe the practices and perceptions of nurse educators when developing NGN-style test items. Methods: This study used a qualitative descriptive methodology to explore the practices and perceptions of nursing faculty when developing NGN-style test items from nursing faculty in accredited prelicensure programs in the…

The purpose of this ethnographic study was to examine the relationship between focused keyboarding instruction and the required standardized assessments mandated by Federal and State authorities. Initial mandates required that the first assessment to be administered online would be the Writing Assessment by year 2014. The assessment given in…

Millions of public-school students in the United States are identified as English language learners (ELLs), whose academic success is tied to their second language (L2) English education. Previous research in adult populations indicates that L2 proficiency is related to the contextual variable of the prevalence of one's first language (L1) among…

This research study investigates the impact of the rapid transition from paper-based to online administration of the State of Texas Assessments of Academic Readiness (STAAR) exams on student performance in a South Texas school district. The transition, mandated by House Bill 3261, presented Texas public schools with a tight timeline for adapting…

This study will utilize a quantitative method to the explore the association between third grade students' home computer access and their ability to attain a proficient score on the Fall 2019 English Language Arts standardized state assessment. The secondary focus will explore the association between third grade students' home computer access and…

This study's primary purpose was to determine how students with a learning disability (LD) in mathematics react in different testing environments, and whether changing the testing parameters can improve the outcomes. Quantitative data was collected through questionnaires, heart rates, and math fluency probes. These data were used to test the…

The studies in this dissertation were conducted to better understand how to measure students' use of multiple representations in introductory science courses by expanding the possibilities of a variable representation assessment (VRA). The VRA is a computer-based assessment originally designed to measure general chemistry students' use of…