Brief multiple-choice question workshops are a prevalent part of the faculty development landscape. But do they work? Studies have documented that faculty member-written multiple-choice questions (fMCQs) are frequently flawed and do not live up to quality standards. Poor fMCQs have real consequences for students beyond annoyance. Fourteen studies…

In order to design learning environments that foster students' research skills, one can draw on instructional design models for complex learning, such as the 4C/ID model (in: van Merriënboer and Kirschner, Ten steps to complex learning, Routledge, London, 2018). However, few attempts have been undertaken to foster students' "motivation"…

This study sets out to investigate possible effects of previously learned languages on the acquisition of English as a third language by examining six prepositions (in, on, at, behind, over, to) when they denote spatial relations. Two picture description tasks were employed to find out which of the two known languages (L1 and/or L2) is the major…

Over the years, we have been witnessing the burgeoning of interdisciplinary interest in the use of ideological discourses and enactment of representations through linguistic and semiotic choices in positioning, (re)constructing and expressing identities. In this picture, there is an evident paucity of research investigating the kinds of…

This research is conducted to identify the scientific conceptual cognition of ecosystem and the corresponding alternative conceptions by lower-secondary school students in Taiwan. Concept mapping, interviewing, and two-tier diagnostic test cannot make explicit reasoning pathways that students may use. Therefore, its purpose is to develop,…

This study investigates the effects of four online vocabulary tasks on second language (L2) vocabulary acquisition among learners of different proficiency levels. While tasks are widely used to support L2 vocabulary learning, the efficacy of a task depends on the interplay between task and learner factors. Thus, choosing an appropriate task…

Arabic is one of the largest donor languages to Malay and Persian. This study explores the benefits of Arabic vocabulary in teaching Malay words of Arabic origin to Persian-speaking students using a vocabulary survey containing 40 Malay words of Arabic origin, most of which retain phonetic or semantic similarity in Persian. Participants were 20…

How data are collected and how they are analyzed is typically described in the literature, but how the data are encoded is often not described in detail. In this paper, we discuss how data typically gathered in PER are encoded and how the choice of encoding plays a role in data analysis. We describe the kinds of data that are found when using…

The evidence is mounting regarding the guidance to employ more three-option multiple-choice items. From theoretical analyses, empirical results, and practical considerations, such items are of equal or higher quality than four- or five-option items, and more items can be administered to improve content coverage. This study looks at 58 tests,…

The present study explored the generation and retrieval practice effects within a college classroom using a free, online tool called PeerWise (PW). PW allows students to create their own multiple-choice questions, share them with peers, and answer the shared questions written by their peers. Forty students from two sections of an upper level…

Context: The accuracy of summative assessment scoring and discriminating the level of knowledge in subject matter is critical in fairness to learners in health care professional programs and to ensure stakeholders of competent providers. An evidence-based approach to determine examination quality for the assessment of applied knowledge is…

VocQGen is an automated tool designed to generate multiple-choice cloze (MCC) questions for vocabulary assessment in second language learning contexts. It leverages several natural language processing (NLP) tools and OpenAI's GPT-4 model to produce MCC items quickly from user-specified word lists. To evaluate its effectiveness, we used the first…

For a multiple-choice test under development or redesign, it is important to choose the optimal number of options per item so that the test possesses the desired psychometric properties. On the basis of available data for a multiple-choice assessment with 8 options, we evaluated the effects of changing the number of options on test properties…

Different versions of multiple-choice exams were administered to an undergraduate class in human physiology as part of normal testing in the classroom. The goal was to evaluate whether the number of options (possible answers) per question influenced the effectiveness of this assessment. Three exams (each with three versions) were given to each of…

Background: Chi and colleagues have argued that some of the most challenging engineering concepts exhibit properties of emergent systems. However, students often lack a mental framework, or schema, for understanding emergence. Slotta and Chi posited that helping students develop a schema for emergent systems, referred to as schema training, would…