Measurement errors attributable to cultural issues are complex and challenging for educational assessments. We need assessment tests sensitive to the cultural heterogeneity of populations, and psychometric methods appropriate to address fairness and equity concerns. Built on the research of culturally responsive assessment, this dissertation…

Pressures associated with accountability testing have resulted in a narrowing of both the curriculum and pedagogy that does not meet the needs of high ability learners. This study proposed that either a different measurement (an above-level computer adaptive assessment) or a different model (Tobit model) should be used to more accurately…

Binary item response theory (IRT) models are widely used in educational testing data. These models are not perfect because they simplify the individual item responding process, ignore the differences among different response patterns, cannot handle multidimensionality that lay behind options within a single item, and cannot manage missing response…

Testlets bring several perks in the development and administration of tests, such as 1) the construction of meaningful test items, 2) the avoidance of non-relevant context exposure, 3) the improvement of testing efficiency, and 4) the progression of testlet items requiring higher thinking skills. Thus, the inclusion of testlets in educational…

This dissertation is composed of three studies. The first and second examine the U.S. private tutoring industry which heretofore has gone largely undocumented by academic research. I show that not only has the industry grown precipitously within the last few decades, but that a disproportionate amount of that growth has taken place among areas…

This study explores using transfer learning in machine learning for natural language processing (NLP) to create generic automated essay scoring (AES) models, providing instant online scoring for statewide writing assessments in K-12 education. The goal is to develop an instant online scorer that is generalizable to any prompt, addressing the…

Multiteam systems (MTS) are an organizational form comprised of two or more independent teams which share at least one common goal. These "teams of teams" can be found in all areas of life, from business to medicine, science to the military. Accordingly, it is of great interest to determine how these systems function, and what makes a…

This work presents a study that used distributed language representations of test items to model test item difficulty. Distributed language representations are low-dimensional numeric representations of written language inspired and generated by artificial neural network architecture. The research begins with a discussion of the importance of item…

Recent research in multidimensional item response theory has introduced within-item interaction effects between latent dimensions in the prediction of item responses. The objective of this study was to extend this research to bifactor models to include an interaction effect between the general and specific latent variables measured by an item.…

Within polytomous items, differential item functioning (DIF) can take on various forms due to the number of response categories. The lack of invariance at this level is referred to as differential step functioning (DSF). The most common DSF methods in the literature are the adjacent category log odds ratio (AC-LOR) estimator and cumulative…

This qualitative case study examined the process Northcentral Technical College (NTC), a two-year institution, navigated to design and implement a standardized prior learning assessment (PLA) program. With the projected labor market shortage, PLA is one strategy colleges have been recommended to use to provide the opportunity for students to apply…

The purpose of this quantitative study was to determine if student perceptions of their advisor and the institution they attended were affected by either the developmental or prescriptive approach that their assigned academic advisor used. A group of academic advisors volunteered at the beginning of the study to be trained in the developmental…

Psychologists have become increasingly interested in the intra-individual variability of psychological measures as a meaningful distinguishing characteristic of persons. Assessments of intra-individual variability are frequently based on the repeated administration of self-report rating scale instruments, and extreme response style (ERS) has the…

In general, newer educational assessments are deemed more demanding challenges than students are currently prepared to face. Two types of factors may contribute to the test scores: (1) factors or dimensions that are of primary interest to the construct or test domain; and, (2) factors or dimensions that are irrelevant to the construct, causing…

The heightened importance of foreign languages (L2) in the post 9-11 world demands more L2 listening research as listening is considered the most critical skill for most American military linguists. Some larger studies show that lexical knowledge can positively affect L2 listening (Chang, 2007; Mehrpour & Rahimi, 2010; Staehr, 2009), yet…