Effective educational measurement relies heavily on the curation of well-designed item pools. However, item calibration is time consuming and costly, requiring a sufficient number of respondents to estimate the psychometric properties of items. In this study, we explore the potential of six different large language models (LLMs; GPT-3.5, GPT-4,…

This article explores the impact of collaboration on target text quality in translator training. By comparing team translations with those by individual peers, and analysing the highest and lowest scoring teams, the authors aimed to understand the impact of collaboration on quality. The comparison indicates that translations in a skills lab…

Gaining knowledge of statistics is important in most (under)graduate programs within the social and behavioral sciences and requires repeated study by students, highlighting the need for good practice materials. We describe the development of an open item bank of statistics exercises by a community of instructors from Dutch universities: the…

Understanding the concepts related to real function is essential in learning mathematics. To determine how students understand these concepts, it is necessary to have an appropriate measurement tool. In this paper, we have created a web application using 32 items from conceptual understanding of real functions (CURF) item bank. We conducted a…

The test blueprint is important in test development, where it guides the test item writer in creating test items according to the desired objectives and specifications or characteristics (so-called a priori item characteristics), such as the level of item difficulty in the category and the distribution of items based on their difficulty level.…

Item banks are generally considered the basis of a new generation of educational measurement. In combination with specialized software, they can facilitate the computerized assembling of multiple pre-equated test forms. However, for advantages of item banks to become fully realized it is important that the item banks store a relatively large…

In the last decades, the development of computerized adaptive testing (CAT) has allowed more precise measurements with a smaller number of items. In this study, we develop an item bank (IB) to generate the adaptive algorithm and simulate the functioning of CAT to assess the domains of mathematical knowledge in Argentinian university students…

Many large universities, community colleges and some smaller four-year colleges are turning to hybrid or online instruction for remedial and entry level mathematics courses, often assessed using online exams in a proctored computer lab environment. Faculty face the task of choosing questions from a publisher's text bank with very little, if any,…

It is known that students have many misconceptions about concepts related to function. By discovering misconceptions using an appropriate measurement instrument, we can determine what changes we need to make in the real functions curriculum to improve learning outcomes. Therefore, we designed an item bank for measuring conceptual understandings of…

Games are a great source of entertainment and are used by people of all ages; they motivate and engage people and affect their behavior. Therefore, games have been widely studied in many non-game contexts. Education is one of those areas where gamified, and game-based learning strategies have been implemented and explored. To engage and motivate…

The arrangement of response options in multiple-choice (MC) items, especially the location of the most attractive distractor, is considered critical in constructing high-quality MC items. In the current study, a sample of 496 undergraduate students taking an educational assessment course was given three test forms consisting of the same items but…

Past research has pointed out that a good grouping strategy can improve the learning effectiveness of collaborative learning. However, the grouping strategy adopted in most past research is static grouping. This results in some disadvantages. Therefore, this study developed an item bank-based collaborative practice system and proposed a dynamic…

Figural matrices tasks are one of the most prominent item formats used in intelligence tests, and their relevance for the assessment of cognitive abilities is unquestionable. However, despite endeavors of the open science movement to make scientific research accessible on all levels, there is a lack of royalty-free figural matrices tests. The Open…

Production of high-quality multiple-choice questions (MCQs) for both formative and summative assessments is a time-consuming task requiring great skill, creativity and insight. The transition to online examinations, with the concomitant exposure of previously tried-and-tested MCQs, exacerbates the challenges of question production and highlights…

We present a question bank consisting of over 250 multiple-choice and true--false questions covering a broad range of material typically taught in an introductory undergraduate course in numerical analysis or computational science. The questions are ideal for polling students during lectures by means of a student response system that uses…