Unlike the traditional multiple-choice (MC) format, the discrete-option multiple-choice (DOMC) format does not necessarily reveal all answer options to an examinee. The purpose of this study was to determine whether the reduced exposure of item content affects test security. We conducted an experiment in which participants were allowed to view…

Much psychological research depends on participants' diligence in filling out materials such as surveys. However, not all participants are motivated to respond attentively, which leads to unintended issues with data quality, known as careless responding. Our question is: how do different modes of data collection--paper/pencil, computer/web-based,…

With the use of computerized testing, ordinary assessments can capture both answer accuracy and answer response time. For the Canadian Programme for the International Assessment of Adult Competencies (PIAAC) numeracy and literacy subtests, person ability, person speed, question difficulty, question time intensity, fluency (rate), person fluency…

Although educators are using various ways in evaluating students' learning, traditional paper pencil final exams are usually held at the end of the school year to conclude the course. During the school suspension due to the COVID-19 outbreak, this traditional approach is no longer applicable to some schools. In this article, alternative final…

Instructional coaching has been implemented in schools to improve student achievement; however, literature shows a lack of evidence of the efficacy of improving student reading achievement. The problem addressed in this study was that school districts have implemented instructional coaching to improve student reading achievement, but the…

Administering exams in large enrollment courses is challenging and systems in place for accomplishing this task were upended in the spring of 2020 when a sudden transformation to online instruction and testing occurred due to the COVID-19 pandemic. In the following year, when courses remained online, approaches to improve exam security included…

Mobile-assisted Language Learning (MALL) has been widely adopted in teaching and learning, yet there has been scant research concerning speaking test adaptation. An emerging type of mobile application is designed to facilitate test takers' performance in a high-stakes speaking test (e.g., the International English Language Testing System (IELTS)).…

Classical automated test assembly (ATA) methods assume fixed and known coefficients for the constraints and the objective function. This hypothesis is not true for the estimates of item response theory parameters, which are crucial elements in test assembly classical models. To account for uncertainty in ATA, we propose a chance-constrained…

The Progress in International Reading Literacy Study (PIRLS) has been monitoring international trends in reading achievement among fourth-grade students for 25 years. As a critical point in a student's education, the fourth year of schooling establishes the foundations of literacy, with reading becoming increasingly central to learning across all…

Teaching physiology can be challenging as students are initially required to understand basic and abstract concepts. Thus students typically view physiology as a "difficult" subject and place an emphasis on rote learning and memorization. Here, we attempted to address this knowledge gap by introducing a pedagogical intervention into the…

This dissertation develops and applies sophisticated Item Response Theory (IRT) methods to address fundamental measurement challenges in cognitive testing, focusing on the Armed Services Vocational Aptitude Battery (ASVAB) data from the National Longitudinal Survey of Youth (NLSY). The first chapter implements a confirmatory multidimensional IRT…

In the swiftly evolving landscape of education, the fusion of Artificial Intelligence's ingenuity with the dynamic capabilities of chat-bot technology has ignited a transformative paradigm shift. This convergence is not merely a technological integration but a profound reshaping of the fundamental principles of pedagogy, fundamentally redefining…

Written instructions seldom need to be read when playing videogames. Instead, gaming often involves early information foraging and expansive exploration behaviors. We use data from the Programme for International Student Assessment (PISA) to explore whether students who regularly play videogames (daily gamers) adopt behaviors that are typical of…

In this research, we use a process data analysis approach to gather additional evidence about students' argumentation skills beyond their performance scores in a computer-based assessment. This game-enhanced scenario-based assessment (named Seaball) included five activities that require students to demonstrate their argumentation skills within a…

Despite growing pressure to increase technology-enhanced assessment, research has repeatedly demonstrated a lack of widespread meaningful integration of technology in higher education. This is in part due to faculty reluctance which is compounded by lack of training and incentives. This qualitative research grounded in the scholarship of teaching…