While multimodality and multiliteracies has been a concept for 25 years (Kalantzis & Cope, 2023; The New London Group, 1996), research on and application of the concept within text complexity measures has been limited. Attempts to assess multiliteracies and multimodality (Jacobs, 2013; Schmerbeck & Lucht, 2017; Wyatt-Smith & Kimber,…

The purpose of this multiple-paper dissertation is to design a digital game and stealth assessments within the game to assess young second language learners' Chinese reading proficiency. In Chapter 2 (Paper 1), I describe the game designed for this dissertation and how it was implemented in a dual language immersion classroom. This study found…

This dissertation describes an experiment to investigate how learners with different levels of background in computer science learn core concepts of computer science, in particular, algorithms. We designed a study to focus on cognitive task analysis for eliciting the empirical mental elements of learning two graph algorithms. Cognitive workload…

In this study, I investigated the effectiveness of a creativity-support system that I developed in the level editor of a learning game called "Physics Playground" on improving college students' creativity. Moreover, I investigated the validity and reliability of an in-game assessment of creativity to measure students' creativity.…

This study created and validated the Early Language Leadership Attitude instrument in order to understand elementary principals' attitudes towards early start language programs in the state of Connecticut. The Early Language Leadership Attitude instrument assesses attitudes towards early start language programming with 8 items. The 5-point Likert…

Background: Service learning is an educational pedagogy that provides students with an opportunity to apply classroom knowledge to real-life situations. There are three components of service learning: course outcomes, service, and reflection. One barrier to incorporating service learning into nursing curriculum is the lack of a standardized…

Teaching effectiveness in higher education has been studied for a long time. The widely used student evaluation of teachers has limitations on measuring teaching effectiveness by directly assessing teacher-centered practices. Additionally, there is little evidence to support the usefulness of student evaluation data to improve and shape the…

The emergence of digital-first assessments is prompting reconsideration of, and innovation in, aspects of psychometrics, test validation, and test use. Using the Duolingo English Test (DET) as an example, this three-paper series seeks to address issues concerning the estimation of classification consistency and the reporting of results for such…

Adolescent mental health is a growing concern in the United States. Children who experience mental health issues struggle in the school environment if their needs are not met. Teachers play a critical role in the classroom when identifying students who struggle with mental health issues. The purposes of this convergent, parallel mixed-methods…

School systems across the United States increasingly use performance-based assessments (PBAs) as alternatives to traditional standardized tests, like the SAT, to make post-secondary and workforce readiness (PWR) determinations. However, very little research has been conducted to validate such alternative assessments as valid indicators of a…

In educational measurement, Item Response Theory (IRT) provides a means of quantifying student knowledge. Specifically, IRT models the probability of a student answering a particular item correctly as a function of the student's continuous-valued latent abilities [theta] (e.g. add, subtract, multiply, divide) and parameters associated with the…

Pragmatic competence has been increasingly recognized as a component of academic language proficiency assessment (Youn, 2018). However, the practicality of administering L2 pragmatic competence assessments involving interlocutors remains problematic (e.g., high labor cost) (Ikeda, 2017). The pandemic makes it even more difficult to administer…

The Academic Behaviors and Skills of College Students (ABS-C) Scale is a measure that assesses in- and out-of-classroom behaviors and skills that may be affecting current academic standing. The measure inquires for self-perceptions of why college students may be having difficulty in courses. The ABS-C Scale demonstrates promising utility as a…

The purpose of this study was to develop a reliable and valid Likert scaled instrument to predict adult non-high school degree holders who would perform well academically in a project-based learning (PBL) assessment environment to obtain their high school diploma as opposed to traditional standardized tests such as the General Educational…

This study applied the stages of transformative learning to faculty perceptions and application of best practices to online learning. Research questions included: Can transformative learning theory constructs be used to identify potential barriers in faculty development and delivery of online instruction?; How does the stage of transformative…