Item Response Theory (IRT) models are a popular analytic method for self report data. We show how traditional IRT models can be vulnerable to specific kinds of asymmetric measurement error (AME) in self-report data, because the models spread the error to all estimates -- even those of items that do not contribute error. We quantify the impact of…

Categorical data become increasingly ubiquitous in the modern big data era. In this dissertation, we propose novel statistical learning and inference methods for large-scale categorical data, focusing on latent variable models and their applications to psychometrics. In psychometric assessments, the subjects' underlying aptitude often cannot be…

This dissertation develops and applies sophisticated Item Response Theory (IRT) methods to address fundamental measurement challenges in cognitive testing, focusing on the Armed Services Vocational Aptitude Battery (ASVAB) data from the National Longitudinal Survey of Youth (NLSY). The first chapter implements a confirmatory multidimensional IRT…

Foreign language placement testing, an important component in university foreign language programs, has received considerable, but not copious, attention over the years in second language (L2) testing research (Norris, 2004), and it has been mostly concentrated on L2 English. In contrast to validation research on L2 English placement testing, the…

In Huggins-Manley & Han (2017), it was shown that WLSMV global model fit indices used in structural equating modeling practice are sensitive to person parameter estimate RMSE and item difficulty parameter estimate RMSE that results from local dependence in 2-PL IRT models, particularly when conditioning on number of test items and sample size.…

Researchers are increasingly interested in the cognitive behaviors students display during tests. This interest has led researchers to look for innovative ways to collect this type of data. Due to the proliferation of computer-based assessments, process data has become popular for its ability to help show what students know, what students don't…

The purpose of this study was to develop a core HIV/AIDS knowledge assessment (CHAKA) for students enrolled in counseling-related degree programs. Although there are studies that examined counseling HIV/AIDS knowledge, the instruments that were used were limited in ways that may compromise the accuracy of the inferences that were made. This study…

The purpose of this study was to investigate the effect of complex structure on dimensionality assessment in compensatory and noncompensatory multidimensional item response models (MIRT) of assessment data using dimensionality assessment procedures based on conditional covariances (i.e., DETECT) and a factor analytical approach (i.e., NOHARM). …

Cross-national comparisons of responses to survey items are often affected by response style, particularly extreme response style (ERS). ERS varies across cultures, and has the potential to bias inferences in cross-national comparisons. For example, in both PISA and TIMSS assessments, it has been documented that when examined within countries,…

This study explored travelers' experiences in the era of network hospitality 2.0 using CouchSurfing.org as a case study. The following research questions guided this study: 1) what experience does CouchSurfing create for travelers before, during and after their travel? 2) how does couch surfers' experience relate to authenticity in context of…

Increasing demands for accountability from both the public and the government have resulted in increasing pressure for higher education professionals to use data to support their choices. There is significant speculation that professionals at all levels of education lack the knowledge to implement data-driven decision making. However, empirical…

The presence of outlying anchor items is an issue faced by many testing agencies. The decision to retain or remove an item is a difficult one, especially when the content representation of the anchor set becomes questionable by item removal decisions. Additionally, the reason for the aberrancy is not always clear, and if the performance of the…

The purpose of this study was to explore a cognitive approach to analyzing students' written responses to mathematics performance assessments to inform learning, instruction, and assessment design and development. The existing data used in this study were seventh grade students' written responses to, and item scores on, four released mathematics…

Grandparents of children with disabilities have an expanded grandparental role that can include performance of child care, raising the grandchildren, and in some instances taking legal custody of the grandchildren. Grandparents in the extended family of a child with a disability have needs that must be identified in order to facilitate the…