Measurement errors attributable to cultural issues are complex and challenging for educational assessments. We need assessment tests sensitive to the cultural heterogeneity of populations, and psychometric methods appropriate to address fairness and equity concerns. Built on the research of culturally responsive assessment, this dissertation…

With the widespread use of technology in the assessment field, many testing programs use both computer-based tests (CBTs) and paper-and-pencil tests (PPTs). Both the Standards for Educational and Psychological Testing (AERA, APA, & NCME, 2014) and the International Guidelines on Computer-Based and Internet Delivered Testing (International Test…

With the wide introduction of English-medium instruction (EMI) to higher education institutions throughout East Asian countries, many East Asian universities are using English proficiency tests that were not originally designed for this context to make admissions and placement decisions. To support the use of these tests in this new EMI context,…

This dissertation describes an experiment to investigate how learners with different levels of background in computer science learn core concepts of computer science, in particular, algorithms. We designed a study to focus on cognitive task analysis for eliciting the empirical mental elements of learning two graph algorithms. Cognitive workload…

According to the Entertainment Software Association (2020), 70% (51.1 million) of children under the age of 18 are gamers in the United States and consume an average of two and a half hours per day playing digital-based games, making these games one of the most widely known leisure activities worldwide. Today's Net Generation (Kindergarten through…

Students are expected to complete high-stakes standardized tests on computers, but many are disadvantaged due to their lack of technical skills and experience. While students complete a required state practice test, the brief overview of the technology used during testing is often not enough to ensure that students can successfully navigate the…

Self-testing is one of the most reliable and powerful memory benefits known to cognitive science. Unfortunately, many students omit this strategy in favor of less effective study techniques such as restudying. The superiority of self-testing to restudying is known as the testing effect (e.g., Roediger & Karpicke, 2006a). Applied interventions…

This study was conducted to analyze potential item parameter drift (IPD) impact on person ability estimates and classification accuracy when drift affects an examinee sub-group. Using a series of simulations, three factors were manipulated: (a) percentage of IPD items in the CAT exam, (b) percentage of examinees affected by IPD, and (c) item pool…

The purpose of this comparative study was to determine the effectiveness of 2 ACT intervention preparation programs. One was a face-to-face ACT intervention preparation program and the 2nd was a computer-based ACT intervention preparation program. Both of these intervention programs were used with at-risk high school juniors and seniors in a large…

Despite an emphasis on oral communication in most foreign language classrooms, the resource-intensive nature (i.e. time and manpower) of speaking tests hinder regular oral assessments. A possible solution is the development of a (semi-) automated scoring system. When it is used in conjunction with human raters, the consistency of computers can…

Vocabulary researchers have started expanding their assessment toolbox by incorporating timed tasks and psycholinguistic instruments (e.g., priming tasks) to gain insights into lexical development (e.g., Elgort, 2011; Godfroid, 2020b; Nakata & Elgort, 2020; Vandenberghe et al., 2021). These timed sensitive and implicit word measures differ…

To meet the needs of complex and/or underserved patient populations, health care professionals must possess diverse backgrounds, qualities, and skill sets. Holistic review has been used to diversify student admissions through examination of non-cognitive attributes of health care applicants. The objective of this study was to develop a novel…

Computer-based assessments allow practitioners to collect rich process data by logging students' interactions with assessment tasks. In addition to providing final responses to test questions, computer-based assessments promise to furnish more evidence to support claims about what a student knows and can do through logging process data in log…

With over one million emergent bilinguals enrolled in Texas public schools, a call to action and a review of high-stakes online assessment policy for this student population is essential to achieve equity in education. The purpose of this phenomenological study aimed to explore teachers' perceptions of high-stakes online TELPAS testing and digital…

The assessment of oral proficiency in English for Specific Purposes (ESP) contexts remains a central challenge for researchers, test developers, and classroom teachers (Knoch & Macqueen, 2020). This problem is apparent especially in Tourism and Hotel Management (THM) programs, where students are tested mostly based on grammar, vocabulary, and…