Because non-cognitive constructs can influence student success in education beyond academic achievement, it is essential that they are reliably conceptualized and measured. Within this context, there are several gaps in the literature related to correctly interpreting the meaning of scale scores when a non-standard response option like I do not…

Psychometricians at an organization named the Education and Training Evaluation Commission (ETEC) developed a new test scoring method called the latent D-scoring method (DSM-L) where it is believed that the new method itself is much easier and more efficient to use compared to the Item Response Theory (IRT) method. However, there are no studies…

Research literature provides evidence that new graduate nurses are often deficient in clinical judgment (CJ). One way to increase CJ is by using simulations. However, the literature is replete with descriptions of the high anxiety that simulation triggers. It is not currently known how anxiety in simulation affects clinical judgment for…

State-wide tests are designed to measure student overall ability on grade-level standards. School leaders want fine-grained information on student performance to inform curriculum and instruction. One currently used target scoring method, which compares student scores to expected values is currently used to give this feedback to schools, but there…

This study explores using transfer learning in machine learning for natural language processing (NLP) to create generic automated essay scoring (AES) models, providing instant online scoring for statewide writing assessments in K-12 education. The goal is to develop an instant online scorer that is generalizable to any prompt, addressing the…

Measurement errors attributable to cultural issues are complex and challenging for educational assessments. We need assessment tests sensitive to the cultural heterogeneity of populations, and psychometric methods appropriate to address fairness and equity concerns. Built on the research of culturally responsive assessment, this dissertation…

In light of the ever-increasing capability of computer technology and advancement in speech and natural language processing techniques, automated speech scoring of constructed responses is gaining popularity in many high-stakes assessment and low-stakes educational settings. Automated scoring is a highly interdisciplinary and complex subject, and…

While numerous recent authors have studied the effects of school accountability systems on student test performance, there has been very little research with regards to school mobility with school performance grades in an A-F system. For the purpose of this study, mobility is defined as a school's ability to have an increase or decrease in their…

The purpose of this study is to explore the perceptions of parents and teachers regarding the success of a standards-based grading initiative in meeting its goals. Furthermore, findings from this study will be used to inform decisions made in future grade level implementations. Standards-based grading meets all criteria for a problem of practice.…

Public schools and districts in Nebraska are required to be accredited. The Nebraska Department of Education allows two methods to reach accreditation, the Nebraska Frameworks model and AdvancED Accreditation model. This study examined the factors that drive accreditation activities in Nebraska public schools and districts. It sought to answer…

Precision medicine refers to the delivering of customized treatment to patients based on their individual characteristics, and aims to reduce adverse events, improve diagnostic methods, and enhance the efficacy of therapies. Among efforts to achieve the goals of precision medicine, researchers have used observational data for developing predictive…

This dissertation is comprised of three papers that propose and apply psychometric models to deal with complexities and challenges in large-scale assessments, focusing on modeling rater effects and complex learning progressions. In particular, three papers investigate extensions and applications of multilevel and multidimensional item response…

While significant progress has been made in recent years on technology enabled assessments (TEAs), including assessment systems that incorporate scaffolding into the assessment process, there is a dearth of research regarding psychometric scoring models that can be used to fully capture students' knowledge, skills and abilities as measured by…

With the increase in frequency of the use of mixed methods, both in research publications and in externally funded grants there are increasing calls for a set of standards to assess the quality of mixed methods research. The purpose of this mixed methods study was to conduct a multi-phase analysis to create a preliminary rubric to evaluate mixed…

The prevalence of flipped blended learning, where part of the lecture and face-to-face class time is moved from the classroom to online instruction prior to class, has increased in prevalence on college campuses throughout the United States. One concern with flipped blended learning is the reduced student-instructor contact time, which could…