This research derived information functions and proposed new scalar information indices to examine the quality of multidimensional forced choice (MFC) items based on the RANK model. We also explored how GGUM-RANK information, latent trait recovery, and reliability varied across three MFC formats: pairs (two response alternatives), triplets (three…

Diagnostic classification models (DCMs) can provide multidimensional diagnostic feedback about students' mastery levels of knowledge components or attributes. One advantage of using DCMs is the ability to accurately and reliably classify students into mastery levels with a relatively small number of items per attribute. Combining DCMs with…

In this study we developed and evaluated a crowdsourcing-based latent semantic analysis (LSA) approach to computerized summary scoring (CSS). LSA is a frequently used mathematical component in CSS, where LSA similarity represents the extent to which the to-be-graded target summary is similar to a model summary or a set of exemplar summaries.…

With the widespread use of technology in the assessment field, many testing programs use both computer-based tests (CBTs) and paper-and-pencil tests (PPTs). Both the Standards for Educational and Psychological Testing (AERA, APA, & NCME, 2014) and the International Guidelines on Computer-Based and Internet Delivered Testing (International Test…

As large-scale standardized tests move from paper-based to computer-based delivery, opportunities arise for test developers to make use of items beyond traditional selected and constructed response types. Technology-enhanced items (TEIs) have the potential to provide advantages over conventional items, including broadening construct measurement,…

VocQGen is an automated tool designed to generate multiple-choice cloze (MCC) questions for vocabulary assessment in second language learning contexts. It leverages several natural language processing (NLP) tools and OpenAI's GPT-4 model to produce MCC items quickly from user-specified word lists. To evaluate its effectiveness, we used the first…

This research endeavors to assess the efficacy of Mobile Assisted Language Learning (MALL) in elevating students' English proficiency to the Common European Framework of Reference (CEFR) B1 level. The study involves identifying the most suitable mobile application for formative assessment, implementing it to enhance students' English competency,…

In a technology-enhanced learning environment and underpinned by a unique hybrid pedagogic model that borrows from gamification, constructivism, and experiential learning approaches, badges were purposefully used to foster engagement. This approach promoted the development of a mindset that identifies and appreciates the worth of a portfolio of…

The current assessment is demanding for a more personalised and less-time consuming testing environment. Computer Adaptive Testing (CAT) is seemed as a more effective alternative testing method in comparison to conventional test in meeting the current standard of assessment. This research reports on the calibration of the released Grade 8 Science…

As one of the most popular Online Student Response Systems (OSRSs), "Socrative" is defined as a web-based platform that can be accessed using any browser that is connected to the Internet (Mork, 2014). In an attempt to guide EFL teachers on their journey towards transforming their traditional paper-based formative assessment into using…

Artificial Intelligence (AI) is growing -- as can be clearly observed not only from the rising recognition of assistance tools such as Siri (Apple) but also from the newly introduced Google Voiced Translator. Yet, some crucial benchmarks still have to be supplied before it can act as a proxy for a real instructor: imagination, creativity, and…

The development of six online quizzes to support students' study of an introductory mathematics masters module at The Open University is described and their use evaluated. The quizzes were implemented using the "STACK" online e-assessment system, which is powered by a computer-algebra engine. Evaluation of student feedback and an initial…

Curriculum-based measurement (CBM) tools are increasingly administered through technology-based modalities such as computers and tablets. Two studies were conducted to examine whether students perform similarly on paper-based and tablet-based math fact probes. Ten students completed 1-min addition or multiplication math probes using a single-case…

Effective assessment is an extremely important area of chemistry education. Typically tests measure students' knowledge of critical thinking skills, chemistry vocabulary, and application of concepts from one chapter to another. While it is relatively straightforward to measure concepts such as chemical vocabulary and algorithmic problem solving…

Two key topics of many second-year organic chemistry courses are substitution and elimination reactions. Predicting and explaining substitution and elimination reactions tends to be a challenging task for students, as documented in the research literature. Motivated by the many documented challenges experienced by students when learning these…