This study investigated the impact of scoring polytomous items later on measurement precision, classification accuracy, and test security in mixed-format adaptive testing. Utilizing the shadow test approach, a simulation study was conducted across various test designs, lengths, number and location of polytomous item. Results showed that while…

Multistage adaptive testing (MST) has become popular in the testing industry because the research has shown that it combines the advantages of both linear tests and item-level computer adaptive testing (CAT). The previous research efforts primarily focused on MST design issues such as panel design, module length, test length, distribution of test…

The purpose of this qualitative research study is to understand the process used for teacher-created online math assessments and the effect that online math assessments have on student engagement. Data for this qualitative study was collected and analyzed using Braun and Clarke's (2006) thematic analysis which uses key conceptual foundations in a…

As assessments move towards computerized testing and making continuous testing available the need for rapid assembly of forms is increasing. The objective of this study was to investigate variability in assembled forms through the lens of first- and second-order equity properties of equating, by examining three factors and their interactions. Two…

Computer-based technological tools can be an efficient and effective way to enhance mathematics classroom activities like formative assessment. Whilst there are a number of theoretical frameworks and standards to help pre- and in-service teachers understand the individual complexities of mathematics pedagogy, technology integration, and formative…

Pragmatic competence has been increasingly recognized as a component of academic language proficiency assessment (Youn, 2018). However, the practicality of administering L2 pragmatic competence assessments involving interlocutors remains problematic (e.g., high labor cost) (Ikeda, 2017). The pandemic makes it even more difficult to administer…

Aim: This study aimed to describe the practices and perceptions of nurse educators when developing NGN-style test items. Methods: This study used a qualitative descriptive methodology to explore the practices and perceptions of nursing faculty when developing NGN-style test items from nursing faculty in accredited prelicensure programs in the…

With the widespread use of technology in the assessment field, many testing programs use both computer-based tests (CBTs) and paper-and-pencil tests (PPTs). Both the Standards for Educational and Psychological Testing (AERA, APA, & NCME, 2014) and the International Guidelines on Computer-Based and Internet Delivered Testing (International Test…

The assessment of oral proficiency in English for Specific Purposes (ESP) contexts remains a central challenge for researchers, test developers, and classroom teachers (Knoch & Macqueen, 2020). This problem is apparent especially in Tourism and Hotel Management (THM) programs, where students are tested mostly based on grammar, vocabulary, and…

In recent years, the multistage adaptive test (MST) has gained increasing popularity in the field of educational measurement and operational testing. MST refers to a test in which pre-constructed sets of items are administered adaptively and are scored as a unit (Hendrickson, 2007). As a special case of Computerized Adaptive Testing (CAT), a MST…

Divergent thinking (DT) tests are the most frequently used types of creativity assessment and have been administered in traditional paper and pencil format for more than a half century. With the prevalence of computer-based testing and increasing demands for large-scale, faster, and more flexible testing procedures, it is necessary to explore and…

The purpose of this research is to provide information about the psychometric properties of technology-enhanced (TE) items and the effects these items have on the content validity of an assessment. Specifically, this research investigated the impact that the inclusion of TE items has on the construct of a mathematics test, the technical properties…

This study is part of a larger design study that iteratively improves a robotics programming curriculum as well as a computational thinking (CT) instrument. Its focus was majorly on CT assessment and particularly on an online CT instrument with logging functionality that can store a student's problem-solving process by recording interactions…

With the advent of the newly developed Common Core State Standards and the Next Generation Science Standards, innovative assessments, including technology-enhanced items and tasks, will be needed to meet the challenges of developing valid and reliable assessments in a world of computer-based testing. In a recent critique of the next generation…

Emotion plays an ever-present role in human existence, impacting nearly every behavior and decision in some way. Research in the behavioral sciences is rife with exploration of emotion and the role it plays in everything from business decision making to health-related behavior. However, affect, the feeling or experience of emotion, is complex and…